2024-08-17T02:35:01.388 INFO:root:teuthology version: 1.2.0 2024-08-17T02:35:01.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:35:01.501 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858299 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858299' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: enable_coprs: - ceph/el9 flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMrIN7lqmyXd7EwDdHVrRj/m48AbYq7fIPdVLsL/9dtbxdjq+Ds4FCdFdKy0P9jT29KKO3VoQUsr1H0BjOyVCdQ= smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBiXHv6yw/bVytj/NwPsDvus8deAS8MWPgKPlE+RWYyqSAu+Ds+88T65Jh2R9fvWs8oS3o6ZInOyC7TYynDDBJc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:10:27 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:35:01.501 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:35:01.501 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:35:01.502 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:35:01.503 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:35:01.531 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:35:01.531 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:35:01.532 INFO:teuthology.packaging:ref: None 2024-08-17T02:35:01.532 INFO:teuthology.packaging:tag: None 2024-08-17T02:35:01.532 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:35:01.532 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:35:01.532 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:35:01.682 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375.g2577e813 2024-08-17T02:35:01.683 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:35:01.691 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:35:01.691 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:35:01.713 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:35:01.728 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:35:01.736 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:35:01.762 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858299', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:29:51.833763', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMrIN7lqmyXd7EwDdHVrRj/m48AbYq7fIPdVLsL/9dtbxdjq+Ds4FCdFdKy0P9jT29KKO3VoQUsr1H0BjOyVCdQ='} 2024-08-17T02:35:01.783 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858299', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:29:51.832383', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBiXHv6yw/bVytj/NwPsDvus8deAS8MWPgKPlE+RWYyqSAu+Ds+88T65Jh2R9fvWs8oS3o6ZInOyC7TYynDDBJc='} 2024-08-17T02:35:01.784 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:35:01.791 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:35:01.791 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:35:01.791 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:35:01.844 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9c46c13ac0>, signals=[15]) 2024-08-17T02:35:01.845 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:35:01.852 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:35:01.852 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:35:01.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:35:01.930 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:35:01.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:35:02.004 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:35:02.012 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-08-17T02:35:02.030 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-08-17T02:35:02.030 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-08-17T02:35:02.089 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-08-17T02:35:02.089 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-08-17T02:35:02.089 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-08-17T02:35:02.089 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:35:02.089 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-08-17T02:35:02.089 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:35:02.089 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:35:02.090 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-08-17T02:35:02.090 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:35:02.090 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:35:02.090 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:35:02.090 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:35:02.090 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:35:02.090 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:35:02.091 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-08-17T02:35:02.114 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-08-17T02:35:02.131 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-08-17T02:35:02.131 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-08-17T02:35:02.188 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-08-17T02:35:02.188 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-08-17T02:35:02.188 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-08-17T02:35:02.188 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:35:02.188 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-08-17T02:35:02.188 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:35:02.188 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:35:02.188 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-08-17T02:35:02.188 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:35:02.189 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:35:02.189 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:35:02.189 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:35:02.189 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:35:02.189 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:35:02.189 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-08-17T02:35:02.213 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:35:02.223 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:35:02.230 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:35:02.230 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:35:02.233 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:35:02.248 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:35:02.256 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:35:02.256 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:35:02.290 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:35:02.350 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:35:02.406 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:35:02.435 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:35:02.436 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-08-17T02:35:02.436 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-08-17T02:35:02.436 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:35:02.436 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:35:02.452 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:35:02.453 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:35:02.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:35:02.456 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:35:02.620 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:35:02.620 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:35:02.620 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-08-17T02:35:02.629 DEBUG:teuthology.task.kernel:sha1 for client.1 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:35:02.629 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:35:02.629 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-08-17T02:35:02.637 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:35:02.638 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:35:02.638 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:35:02.638 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum upgrade -y linux-firmware 2024-08-17T02:35:02.646 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:35:02.646 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:35:02.646 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:35:02.646 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum upgrade -y linux-firmware 2024-08-17T02:35:05.153 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.2 MB 00:00 2024-08-17T02:35:05.223 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 8.3 MB/s | 8.2 MB 00:00 2024-08-17T02:35:07.104 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-08-17T02:35:08.015 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-08-17T02:35:11.688 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.6 MB 00:00 2024-08-17T02:35:12.433 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.6 MB 00:00 2024-08-17T02:35:13.188 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 111 kB/s | 18 kB 00:00 2024-08-17T02:35:13.941 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 18 kB 00:00 2024-08-17T02:35:14.042 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 31 MB/s | 22 MB 00:00 2024-08-17T02:35:14.954 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 26 MB/s | 22 MB 00:00 2024-08-17T02:35:19.447 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-17T02:35:20.493 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-08-17T02:35:21.532 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-08-17T02:35:21.544 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-08-17T02:35:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-08-17T02:35:21.544 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-08-17T02:35:21.544 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-08-17T02:35:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:35:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:35:21.544 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-08-17T02:35:21.544 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-08-17T02:35:21.544 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 1 Package 2024-08-17T02:35:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:35:21.545 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 383 M 2024-08-17T02:35:21.545 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-08-17T02:35:22.668 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-08-17T02:35:22.675 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-08-17T02:35:22.675 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-08-17T02:35:22.675 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-08-17T02:35:22.675 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-08-17T02:35:22.675 INFO:teuthology.orchestra.run.smithi005.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:35:22.675 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:35:22.675 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-08-17T02:35:22.675 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-08-17T02:35:22.675 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 1 Package 2024-08-17T02:35:22.675 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:35:22.675 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 383 M 2024-08-17T02:35:22.676 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-08-17T02:35:28.639 INFO:teuthology.orchestra.run.smithi107.stdout:linux-firmware-20240716-145.el9.noarch.rpm 54 MB/s | 383 MB 00:07 2024-08-17T02:35:28.640 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:35:28.640 INFO:teuthology.orchestra.run.smithi107.stdout:Total 54 MB/s | 383 MB 00:07 2024-08-17T02:35:31.719 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-08-17T02:35:31.840 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-08-17T02:35:31.840 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-08-17T02:35:34.210 INFO:teuthology.orchestra.run.smithi005.stdout:linux-firmware-20240716-145.el9.noarch.rpm 34 MB/s | 383 MB 00:11 2024-08-17T02:35:34.210 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:35:34.211 INFO:teuthology.orchestra.run.smithi005.stdout:Total 33 MB/s | 383 MB 00:11 2024-08-17T02:35:35.106 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-08-17T02:35:35.106 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-08-17T02:35:37.451 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-08-17T02:35:37.542 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-08-17T02:35:37.542 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-08-17T02:35:40.985 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-08-17T02:35:40.985 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-08-17T02:35:44.156 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-08-17T02:35:44.801 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:35:44.882 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:35:45.728 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:35:45.728 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:35:46.455 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:35:46.455 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:35:46.455 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-08-17T02:35:46.455 INFO:teuthology.orchestra.run.smithi107.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:35:46.455 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:35:46.455 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-08-17T02:35:46.759 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:35:46.760 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:35:46.908 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:35:46.908 DEBUG:teuthology.orchestra.run.smithi107:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:35:46.910 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi107.front.sepia.ceph.com to complete... 2024-08-17T02:35:50.368 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-08-17T02:35:51.155 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:35:51.246 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:35:51.923 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:35:51.923 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:35:52.608 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:35:52.608 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:35:52.608 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-08-17T02:35:52.609 INFO:teuthology.orchestra.run.smithi005.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:35:52.609 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:35:52.609 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-08-17T02:35:52.921 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:35:52.921 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:35:53.067 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:35:53.068 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:35:53.071 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi005.front.sepia.ceph.com to complete... 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17 02:35:53 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:FINISHED --2024-08-17 02:35:53-- 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:Total wall clock time: 6.3s 2024-08-17T02:35:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:Downloaded: 1 files, 344M in 6.1s (56.6 MB/s) 2024-08-17T02:35:53.286 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:35:53.287 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:35:55.357 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying... ######################################## 2024-08-17T02:35:55.406 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing... ######################################## 2024-08-17T02:35:55.456 INFO:teuthology.orchestra.run.smithi107.stdout:Updating / installing... 2024-08-17T02:35:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17 02:35:59 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:35:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:FINISHED --2024-08-17 02:35:59-- 2024-08-17T02:35:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:Total wall clock time: 6.4s 2024-08-17T02:35:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:Downloaded: 1 files, 344M in 6.1s (56.8 MB/s) 2024-08-17T02:35:59.452 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:35:59.452 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:36:01.622 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying... ######################################## 2024-08-17T02:36:01.672 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing... ######################################## 2024-08-17T02:36:01.726 INFO:teuthology.orchestra.run.smithi005.stdout:Updating / installing... 2024-08-17T02:36:03.476 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:36:10.097 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:36:43.476 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:36:43.476 DEBUG:teuthology.orchestra.run.smithi107:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:36:43.558 INFO:teuthology.orchestra.run.smithi107.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:43.558 INFO:teuthology.orchestra.run.smithi107.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:43.559 INFO:teuthology.orchestra.run.smithi107.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:43.559 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:43.559 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:36:43.559 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:36:43.559 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:36:43.559 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:36:43.559 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:36:43.559 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:36:43.559 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:36:43.559 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:36:43.559 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:36:43.559 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:36:43.559 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:36:43.559 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:36:43.560 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:36:43.560 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:36:43.560 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:36:43.560 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:36:43.560 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:36:43.560 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:36:43.560 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:36:43.560 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:36:43.560 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:36:43.560 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:36:43.560 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:36:43.560 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:36:43.560 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:36:43.561 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:36:43.561 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:36:43.561 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:36:43.561 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:36:43.561 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:36:43.561 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:36:43.561 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:36:43.561 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:36:43.561 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:36:43.561 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:36:43.561 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:36:43.561 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:36:43.561 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:36:43.562 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:36:43.562 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:36:43.562 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:36:43.562 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:36:43.562 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:36:43.562 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:36:43.562 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:36:43.562 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:36:43.562 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:36:43.562 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:36:43.562 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:36:43.562 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:36:43.563 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:36:43.563 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:36:43.563 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:36:43.563 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:36:43.563 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:36:43.563 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:36:43.563 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:36:43.563 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:36:43.563 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:36:43.563 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:36:43.563 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:36:43.563 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:36:43.563 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:36:43.563 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:36:43.563 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:36:43.564 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:36:43.564 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:36:43.564 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:36:43.564 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:36:43.564 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:36:43.564 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:36:43.564 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:36:43.564 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:36:43.564 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:36:43.564 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:36:43.564 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:36:43.564 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:36:43.564 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:36:43.564 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:36:43.565 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:36:43.565 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:36:43.565 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:36:43.565 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:36:43.565 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:36:43.565 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:36:43.565 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:36:43.565 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:36:43.565 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:36:43.565 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:36:43.565 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:36:43.565 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:36:43.565 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:36:43.566 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:36:43.566 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:36:43.566 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:36:43.566 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:36:43.566 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:36:43.566 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:36:43.566 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:36:43.566 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:36:43.566 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:36:43.566 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:36:43.566 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:36:43.566 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:36:43.566 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:36:43.567 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:36:43.567 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:36:43.567 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:36:43.567 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:36:43.567 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:36:43.567 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:36:43.567 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:36:43.567 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:36:43.567 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:36:43.567 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:36:43.567 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:36:43.567 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:36:43.568 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:36:43.568 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:36:43.568 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:36:43.568 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:36:43.568 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:36:43.568 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:36:43.568 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:36:43.568 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:36:43.568 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:36:43.568 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:36:43.568 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:36:43.568 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:36:43.568 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:36:43.568 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:36:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:36:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:36:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:36:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:36:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:36:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:36:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:36:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:36:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:36:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:36:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:36:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:36:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:36:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:36:43.570 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:36:43.570 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:36:43.570 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:36:43.570 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:36:43.570 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:36:43.570 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:36:43.570 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:36:43.570 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:36:43.570 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:36:43.570 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:36:43.570 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:36:43.570 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:36:43.570 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:36:43.571 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:36:43.571 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:36:43.571 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:36:43.571 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:36:43.571 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:36:43.571 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:36:43.571 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:36:43.571 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:36:43.571 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:36:43.571 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:36:43.571 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:36:43.571 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:36:43.571 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:36:43.571 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:36:43.571 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:36:43.572 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:36:43.572 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:36:43.572 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:36:43.572 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:36:43.572 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:36:43.572 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:36:43.572 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:36:43.572 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:36:43.572 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:36:43.572 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:36:43.572 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:36:43.572 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:36:43.572 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:36:43.572 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:36:43.572 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:36:43.573 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:36:43.573 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:36:43.573 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:36:43.573 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:36:43.573 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:36:43.573 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:36:43.573 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:36:43.573 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:36:43.573 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:36:43.573 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:36:43.573 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:36:43.573 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:36:43.573 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:36:43.573 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:36:43.573 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:36:43.574 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:36:43.574 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:36:43.574 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:36:43.574 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:36:43.574 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:36:43.574 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:36:43.574 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:36:43.574 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:36:43.574 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:36:43.574 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:36:43.574 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:36:43.574 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:36:43.575 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:36:43.575 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:36:43.575 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:36:43.575 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:36:43.575 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:36:43.575 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:36:43.575 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:36:43.575 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:36:43.575 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:36:43.575 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:36:43.575 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:36:43.575 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:36:43.575 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:36:43.575 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:36:43.576 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:36:43.576 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:36:43.576 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:36:43.576 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:36:43.576 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:36:43.576 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:36:43.576 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:36:43.576 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:36:43.576 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:36:43.576 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:36:43.576 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:36:43.576 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:36:43.576 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:36:43.577 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:36:43.577 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:36:43.577 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:36:43.577 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:36:43.577 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:36:43.577 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:36:43.577 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:36:43.577 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:36:43.577 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:36:43.577 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:36:43.577 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:36:43.577 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:36:43.577 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:36:43.578 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:36:43.578 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:36:43.578 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:36:43.578 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:36:43.578 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:36:43.578 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:36:43.578 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:36:43.578 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:36:43.578 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:36:43.578 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:36:43.578 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:36:43.578 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:36:43.579 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:36:43.579 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:36:43.579 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:36:43.579 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:36:43.579 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:36:43.579 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:36:43.579 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:36:43.579 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:36:43.579 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:36:43.579 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:36:43.579 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:36:43.579 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:36:43.580 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:36:43.580 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:36:43.580 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:36:43.580 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:36:43.580 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:36:43.580 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:36:43.580 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:36:43.580 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:36:43.580 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:36:43.580 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:36:43.580 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:36:43.580 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:36:43.580 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:36:43.580 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:36:43.580 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:36:43.581 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:36:43.581 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:36:43.581 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:36:43.581 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:36:43.581 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:36:43.581 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:36:43.581 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:36:43.581 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:36:43.581 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:36:43.581 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:36:43.581 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:36:43.581 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:36:43.581 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:36:43.581 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:36:43.582 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:36:43.582 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:36:43.582 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:36:43.582 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:36:43.582 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:36:43.582 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:36:43.582 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:36:43.582 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:36:43.582 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:36:43.582 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:36:43.582 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:36:43.582 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:36:43.583 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:36:43.583 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:36:43.583 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:36:43.583 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:36:43.583 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:36:43.583 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:36:43.583 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:36:43.583 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:36:43.583 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:36:43.583 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:36:43.583 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:36:43.583 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:36:43.583 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:36:43.583 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:36:43.584 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:36:43.584 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:36:43.584 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:36:43.584 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:36:43.584 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:36:43.584 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:36:43.584 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:36:43.584 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:36:43.584 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:36:43.584 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:36:43.584 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:36:43.585 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:36:43.585 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:36:43.585 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:36:43.585 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:36:43.585 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:36:43.585 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:36:43.585 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:36:43.585 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:36:43.585 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:36:43.585 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:36:43.585 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:36:43.585 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:36:43.585 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:36:43.585 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:36:43.586 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:36:43.586 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:36:43.586 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:36:43.586 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:36:43.586 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:36:43.586 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:36:43.586 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:36:43.586 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:36:43.586 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:36:43.586 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:36:43.586 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:36:43.586 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:36:43.586 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:36:43.586 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:36:43.587 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:36:43.587 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:36:43.587 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:36:43.587 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:36:43.587 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:36:43.587 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:36:43.587 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:36:43.587 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:36:43.587 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:36:43.587 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:36:43.587 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:36:43.587 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:36:43.587 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:36:43.587 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:36:43.588 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:36:43.588 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:36:43.588 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:36:43.588 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:36:43.588 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:36:43.588 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:36:43.588 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:36:43.588 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:36:43.588 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:36:43.588 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:36:43.588 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:36:43.588 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:36:43.588 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:36:43.588 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:36:43.589 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:36:43.589 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:36:43.589 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:36:43.589 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:36:43.589 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:36:43.589 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:36:43.589 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:36:43.589 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:36:43.589 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:36:43.589 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:36:43.589 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:36:43.589 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:36:43.589 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:36:43.589 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:36:43.590 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:36:43.590 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:36:43.590 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:36:43.590 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:36:43.590 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:36:43.590 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:36:43.590 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:36:43.590 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:36:43.590 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:36:43.590 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:36:43.590 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:36:43.590 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:36:43.591 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:36:43.591 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:36:43.591 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:36:43.591 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:36:43.591 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:36:43.591 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:36:43.591 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:36:43.591 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:36:43.591 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:36:43.591 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:36:43.591 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:36:43.591 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:36:43.591 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:36:43.591 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:36:43.591 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:36:43.592 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:36:43.592 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:36:43.592 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:36:43.592 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:36:43.592 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:36:43.592 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:36:43.592 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:36:43.592 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:36:43.592 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:36:43.592 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:36:43.592 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:36:43.592 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:36:43.592 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:36:43.593 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:36:43.593 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:36:43.593 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:36:43.593 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:36:43.593 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:36:43.593 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:36:43.593 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:36:43.593 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:36:43.593 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:36:43.593 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:36:43.593 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:36:43.593 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:36:43.593 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:36:43.594 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:36:43.594 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:36:43.594 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:36:43.594 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:36:43.594 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:36:43.594 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:36:43.594 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:36:43.594 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:36:43.594 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:36:43.594 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:36:43.594 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:36:43.595 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:36:43.595 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:36:43.595 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:36:43.595 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:36:43.595 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:36:43.595 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:36:43.595 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:36:43.595 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:36:43.595 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:36:43.595 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:36:43.595 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:36:43.595 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:36:43.596 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:36:43.596 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:36:43.596 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:36:43.596 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:36:43.596 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:36:43.596 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:36:43.596 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:36:43.596 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:36:43.596 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:36:43.596 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:36:43.596 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:36:43.596 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:36:43.596 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:36:43.596 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:36:43.597 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:36:43.597 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:36:43.597 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:36:43.597 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:36:43.597 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:36:43.597 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:36:43.597 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:36:43.597 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:36:43.597 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:36:43.597 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:36:43.597 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:36:43.597 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:36:43.597 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:36:43.597 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:36:43.598 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:36:43.598 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:36:43.598 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:36:43.598 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:36:43.598 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:36:43.598 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:36:43.598 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:36:43.598 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:36:43.598 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:36:43.598 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:36:43.598 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:36:43.598 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:36:43.598 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:36:43.598 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:36:43.599 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:36:43.599 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:36:43.599 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:36:43.599 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:36:43.599 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:36:43.599 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:36:43.599 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:36:43.599 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:36:43.599 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:36:43.599 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:36:43.599 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:36:43.599 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:36:43.599 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:36:43.600 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:36:43.600 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:36:43.600 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:36:43.600 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:36:43.600 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:36:43.600 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:36:43.600 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:36:43.600 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:36:43.600 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:36:43.600 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:36:43.600 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:36:43.600 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:36:43.600 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:36:43.600 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:36:43.601 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:36:43.601 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:36:43.601 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:36:43.601 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:36:43.601 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:36:43.601 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:36:43.601 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:36:43.601 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:36:43.601 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:36:43.601 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:36:43.601 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:36:43.601 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:36:43.602 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:36:43.602 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:36:43.602 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:36:43.602 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:36:43.602 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:36:43.602 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:36:43.602 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:36:43.602 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:36:43.602 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:36:43.602 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:36:43.602 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:36:43.602 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:36:43.602 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:36:43.602 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:36:43.603 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:36:43.603 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:36:43.603 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:36:43.603 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:36:43.603 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:36:43.603 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:36:43.603 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:36:43.603 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:36:43.603 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:36:43.603 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:36:43.603 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:36:43.603 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:36:43.603 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:36:43.603 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:36:43.604 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:36:43.604 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:36:43.604 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:36:43.604 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:36:43.604 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:36:43.604 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:36:43.604 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:36:43.604 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:36:43.604 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:36:43.604 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:36:43.604 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:36:43.604 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:36:43.604 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:36:43.605 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:36:43.605 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:36:43.605 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:36:43.605 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:36:43.605 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:36:43.605 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:36:43.605 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:36:43.605 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:36:43.605 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:36:43.605 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:36:43.605 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:36:43.605 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:36:43.606 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:36:43.606 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:36:43.606 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:36:43.606 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:36:43.606 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:36:43.606 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:36:43.606 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:36:43.606 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:36:43.606 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:36:43.606 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:36:43.606 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:36:43.606 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:36:43.606 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:36:43.606 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:36:43.607 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:36:43.607 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:36:43.607 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:36:43.607 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:36:43.607 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:36:43.607 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:36:43.607 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:36:43.607 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:36:43.607 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:36:43.607 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:36:43.607 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:36:43.607 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:36:43.607 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:36:43.607 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:36:43.607 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:36:43.608 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:36:43.608 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:36:43.608 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:36:43.608 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:36:43.608 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:36:43.608 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:36:43.608 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:36:43.608 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:36:43.608 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:36:43.608 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:36:43.608 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:36:43.608 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:36:43.608 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:36:43.608 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:36:43.609 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:36:43.609 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:36:43.609 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:36:43.609 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:36:43.609 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:36:43.609 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:36:43.609 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:36:43.609 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:36:43.609 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:36:43.609 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:36:43.609 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:36:43.609 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:36:43.610 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:36:43.610 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:36:43.610 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:36:43.610 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:36:43.610 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:36:43.610 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:36:43.610 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:36:43.610 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:36:43.610 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:36:43.610 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:36:43.610 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:36:43.610 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:36:43.610 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:36:43.611 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:36:43.611 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:36:43.611 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:36:43.611 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:36:43.611 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:36:43.611 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:36:43.611 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:36:43.611 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:36:43.611 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:36:43.611 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:36:43.611 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:36:43.611 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:36:43.612 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:36:43.612 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:36:43.612 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:36:43.612 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:36:43.612 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:36:43.612 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:36:43.612 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:36:43.612 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:36:43.612 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:36:43.612 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:36:43.612 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:36:43.612 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:36:43.613 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:36:43.613 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:36:43.613 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:36:43.613 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:36:43.613 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:36:43.613 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:36:43.613 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:36:43.613 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:36:43.613 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:36:43.613 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:36:43.613 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:36:43.613 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:36:43.613 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:36:43.614 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:36:43.614 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:36:43.614 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:36:43.614 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:36:43.614 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:36:43.614 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:36:43.614 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:36:43.614 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:36:43.614 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:36:43.614 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:36:43.614 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:36:43.614 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:36:43.615 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:36:43.615 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:36:43.615 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:36:43.615 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:36:43.615 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:36:43.615 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:36:43.615 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:36:43.615 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:36:43.615 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:36:43.615 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:36:43.615 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:36:43.615 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:36:43.616 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:36:43.617 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:36:43.617 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:36:43.617 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:36:43.617 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:36:43.617 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:36:43.618 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:36:43.618 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:36:43.618 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:36:43.618 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:36:43.618 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:36:43.618 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:36:43.618 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:36:43.618 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:36:43.618 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:36:43.618 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:36:43.618 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:36:43.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:36:43.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:36:43.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:36:43.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:36:43.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:36:43.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:36:43.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:36:43.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:36:43.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:36:43.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:36:43.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:36:43.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:36:43.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:36:43.620 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:36:43.620 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:36:43.620 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:36:43.620 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:36:43.620 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:36:43.620 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:36:43.620 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:36:43.620 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:36:43.620 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:36:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:36:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:36:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:36:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:36:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:36:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:36:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:36:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:36:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:36:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:36:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:36:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:36:43.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:36:43.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:36:43.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:36:43.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:36:43.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:36:43.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:36:43.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:36:43.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:36:43.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:36:43.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:36:43.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:36:43.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:36:43.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:36:43.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:36:43.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:36:43.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:36:43.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:36:43.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:36:43.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:36:43.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:36:43.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:36:43.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:36:43.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:36:43.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:36:43.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:36:43.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:36:43.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:36:43.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:36:43.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:36:43.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:36:43.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:36:43.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:36:43.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:36:43.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:36:43.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:36:43.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:36:43.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:36:43.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:36:43.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:36:43.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:36:43.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:36:43.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:36:43.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:36:43.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:36:43.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:36:43.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:36:43.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:36:43.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:36:43.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:36:43.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:36:43.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:36:43.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:36:43.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:36:43.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:36:43.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:36:43.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:36:43.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:36:43.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:36:43.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:36:43.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:36:43.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:36:43.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:36:43.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:36:43.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:36:43.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:36:43.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:36:43.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:36:43.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:36:43.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:36:43.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:36:43.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:36:43.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:36:43.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:36:43.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:36:43.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:36:43.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:36:43.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:36:43.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:36:43.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:36:43.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:36:43.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:36:43.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:36:43.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:36:43.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:36:43.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:36:43.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:36:43.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:36:43.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:36:43.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:36:43.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:36:43.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:36:43.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:36:43.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:36:43.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:36:43.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:36:43.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:36:43.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:36:43.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:36:43.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:36:43.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:36:43.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:36:43.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:36:43.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:36:43.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:36:43.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:36:43.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:36:43.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:36:43.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:36:43.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:36:43.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:36:43.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:36:43.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:36:43.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:36:43.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:36:43.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:36:43.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:36:43.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:36:43.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:36:43.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:36:43.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:36:43.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:36:43.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:36:43.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:36:43.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:36:43.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:36:43.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:36:43.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:36:43.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:36:43.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:36:43.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:36:43.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:36:43.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:36:43.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:36:43.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:36:43.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:36:43.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:36:43.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:36:43.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:36:43.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:36:43.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:36:43.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:36:43.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:36:43.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:36:43.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:36:43.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:36:43.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:36:43.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:36:43.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:36:43.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:36:43.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:36:43.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:36:43.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:36:43.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:36:43.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:36:43.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:36:43.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:36:43.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:36:43.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:36:43.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:36:43.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:36:43.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:36:43.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:36:43.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:36:43.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:36:43.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:36:43.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:36:43.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:36:43.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:36:43.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:36:43.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:36:43.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:36:43.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:36:43.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:36:43.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:36:43.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:36:43.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:36:43.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:36:43.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:36:43.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:36:43.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:36:43.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:36:43.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:36:43.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:36:43.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:36:43.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:36:43.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:36:43.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:36:43.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:36:43.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:36:43.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:36:43.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:36:43.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:36:43.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:36:43.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:36:43.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:36:43.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:36:43.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:36:43.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:36:43.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:36:43.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:36:43.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:36:43.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:36:43.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:36:43.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:36:43.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:36:43.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:36:43.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:36:43.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:36:43.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:36:43.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:36:43.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:36:43.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:36:43.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:36:43.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:36:43.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:36:43.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:36:43.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:36:43.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:36:43.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:36:43.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:36:43.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:36:43.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:36:43.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:36:43.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:36:43.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:36:43.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:36:43.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:36:43.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:36:43.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:36:43.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:36:43.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:36:43.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:36:43.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:36:43.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:36:43.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:36:43.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:36:43.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:36:43.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:36:43.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:36:43.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:36:43.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:36:43.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:36:43.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:36:43.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:36:43.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:36:43.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:36:43.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:36:43.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:36:43.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:36:43.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:36:43.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:36:43.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:36:43.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:36:43.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:36:43.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:36:43.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:36:43.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:36:43.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:36:43.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:36:43.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:36:43.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:36:43.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:36:43.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:36:43.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:36:43.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:36:43.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:36:43.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:36:43.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:36:43.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:36:43.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:36:43.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:36:43.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:36:43.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:36:43.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:36:43.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:36:43.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:36:43.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:36:43.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:36:43.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:36:43.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:36:43.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:36:43.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:36:43.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:36:43.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:36:43.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:36:43.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:36:43.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:36:43.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:36:43.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:36:43.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:36:43.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:36:43.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:36:43.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:36:43.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:36:43.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:36:43.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:36:43.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:36:43.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:36:43.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:36:43.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:36:43.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:36:43.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:36:43.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:36:43.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:36:43.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:36:43.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:36:43.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:36:43.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:36:43.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:36:43.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:36:43.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:36:43.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:36:43.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:36:43.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:36:43.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:36:43.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:36:43.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:36:43.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:36:43.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:36:43.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:36:43.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:36:43.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:36:43.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:36:43.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:36:43.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:36:43.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:36:43.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:36:43.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:36:43.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:36:43.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:36:43.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:36:43.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:36:43.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:36:43.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:36:43.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:36:43.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:36:43.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:36:43.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:36:43.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:36:43.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:36:43.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:36:43.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:36:43.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:36:43.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:36:43.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:36:43.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:36:43.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:36:43.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:36:43.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:36:43.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:36:43.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:36:43.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:36:43.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:36:43.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:36:43.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:36:43.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:36:43.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:36:43.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:36:43.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:36:43.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:36:43.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:36:43.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:36:43.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:36:43.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:36:43.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:36:43.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:36:43.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:36:43.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:36:43.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:36:43.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:36:43.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:36:43.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:36:43.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:36:43.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:36:43.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:36:43.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:36:43.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:36:43.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:36:43.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:36:43.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:36:43.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:36:43.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:36:43.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:36:43.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:36:43.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:36:43.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:36:43.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:36:43.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:36:43.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:36:43.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:36:43.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:36:43.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:36:43.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:36:43.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:36:43.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:36:43.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:36:43.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:36:43.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:36:43.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:36:43.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:36:43.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:36:43.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:36:43.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:36:43.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:36:43.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:36:43.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:36:43.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:36:43.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:36:43.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:36:43.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:36:43.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:36:43.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:36:43.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:36:43.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:36:43.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:36:43.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:36:43.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:36:43.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:36:43.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:36:43.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:36:43.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:36:43.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:36:43.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:36:43.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:36:43.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:36:43.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:36:43.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:36:43.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:36:43.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:36:43.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:36:43.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:36:43.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:36:43.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:36:43.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:36:43.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:36:43.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:36:43.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:36:43.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:36:43.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:36:43.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:36:43.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:36:43.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:36:43.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:36:43.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:36:43.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:36:43.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:36:43.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:36:43.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:36:43.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:36:43.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:36:43.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:36:43.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:36:43.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:36:43.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:36:43.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:36:43.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:36:43.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:36:43.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:36:43.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:36:43.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:36:43.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:36:43.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:36:43.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:36:43.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:36:43.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:36:43.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:36:43.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:36:43.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:36:43.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:36:43.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:36:43.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:36:43.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:36:43.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:36:43.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:36:43.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:36:43.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:36:43.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:36:43.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:36:43.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:36:43.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:36:43.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:36:43.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:36:43.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:36:43.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:36:43.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:36:43.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:36:43.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:36:43.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:36:43.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:36:43.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:36:43.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:36:43.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:36:43.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:36:43.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:36:43.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:36:43.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:36:43.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:36:43.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:36:43.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:36:43.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:36:43.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:36:43.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:36:43.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:36:43.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:36:43.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:36:43.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:36:43.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:36:43.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:36:43.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:36:43.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:36:43.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:36:43.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:36:43.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:36:43.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:36:43.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:36:43.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:36:43.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:36:43.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:36:43.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:36:43.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:36:43.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:36:43.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:36:43.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:36:43.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:36:43.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:36:43.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:36:43.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:36:43.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:36:43.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:36:43.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:36:43.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:36:43.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:36:43.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:36:43.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:36:43.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:36:43.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:36:43.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:36:43.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:36:43.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:36:43.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:36:43.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:36:43.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:36:43.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:36:43.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:36:43.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:36:43.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:36:43.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:36:43.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:36:43.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:36:43.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:36:43.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:36:43.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:36:43.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:36:43.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:36:43.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:36:43.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:36:43.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:36:43.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:36:43.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:36:43.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:36:43.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:36:43.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:36:43.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:36:43.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:36:43.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:36:43.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:36:43.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:36:43.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:36:43.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:36:43.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:36:43.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:36:43.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:36:43.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:36:43.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:36:43.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:36:43.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:36:43.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:36:43.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:36:43.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:36:43.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:36:43.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:36:43.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:36:43.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:36:43.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:36:43.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:36:43.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:36:43.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:36:43.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:36:43.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:36:43.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:36:43.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:36:43.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:36:43.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:36:43.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:36:43.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:36:43.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:36:43.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:36:43.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:36:43.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:36:43.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:36:43.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:36:43.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:36:43.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:36:43.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:36:43.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:36:43.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:36:43.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:36:43.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:36:43.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:36:43.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:36:43.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:36:43.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:36:43.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:36:43.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:36:43.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:36:43.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:36:43.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:36:43.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:36:43.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:36:43.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:36:43.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:36:43.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:36:43.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:36:43.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:36:43.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:36:43.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:36:43.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:36:43.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:36:43.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:36:43.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:36:43.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:36:43.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:36:43.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:36:43.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:36:43.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:36:43.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:36:43.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:36:43.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:36:43.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:36:43.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:36:43.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:36:43.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:36:43.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:36:43.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:36:43.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:36:43.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:36:43.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:36:43.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:36:43.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:36:43.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:36:43.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:36:43.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:36:43.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:36:43.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:36:43.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:36:43.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:36:43.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:36:43.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:36:43.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:36:43.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:36:43.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:36:43.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:36:43.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:36:43.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:36:43.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:36:43.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:36:43.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:36:43.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:36:43.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:36:43.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:36:43.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:36:43.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:36:43.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:36:43.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:36:43.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:36:43.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:36:43.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:36:43.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:36:43.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:36:43.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:36:43.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:36:43.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:36:43.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:36:43.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:36:43.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:36:43.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:36:43.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:36:43.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:36:43.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:36:43.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:36:43.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:36:43.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:36:43.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:36:43.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:36:43.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:36:43.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:36:43.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:36:43.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:36:43.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:36:43.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:36:43.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:36:43.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:36:43.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:36:43.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:36:43.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:36:43.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:36:43.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:36:43.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:36:43.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:36:43.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:36:43.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:36:43.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:36:43.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:36:43.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:36:43.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:36:43.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:36:43.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:36:43.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:36:43.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:36:43.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:36:43.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:36:43.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:36:43.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:36:43.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:36:43.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:36:43.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:36:43.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:36:43.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:36:43.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:36:43.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:36:43.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:36:43.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:36:43.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:36:43.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:36:43.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:36:43.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:36:43.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:36:43.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:36:43.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:36:43.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:36:43.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:36:43.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:36:43.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:36:43.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:36:43.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:36:43.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:36:43.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:36:43.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:36:43.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:36:43.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:36:43.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:36:43.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:36:43.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:36:43.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:36:43.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:36:43.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:36:43.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:36:43.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:36:43.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:36:43.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:36:43.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:36:43.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:36:43.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:36:43.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:36:43.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:36:43.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:36:43.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:36:43.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:36:43.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:36:43.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:36:43.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:36:43.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:36:43.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:36:43.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:36:43.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:36:43.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:36:43.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:36:43.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:36:43.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:36:43.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:36:43.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:36:43.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:36:43.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:36:43.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:36:43.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:36:43.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:36:43.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:36:43.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:36:43.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:36:43.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:36:43.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:36:43.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:36:43.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:36:43.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:36:43.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:36:43.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:36:43.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:36:43.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:36:43.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:36:43.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:36:43.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:36:43.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:36:43.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:36:43.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:36:43.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:36:43.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:36:43.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:36:43.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:36:43.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:36:43.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:36:43.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:36:43.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:36:43.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:36:43.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:36:43.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:36:43.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:36:43.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:36:43.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:36:43.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:36:43.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:36:43.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:36:43.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:36:43.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:36:43.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:36:43.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:36:43.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:36:43.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:36:43.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:36:43.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:36:43.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:36:43.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:36:43.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:36:43.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:36:43.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:36:43.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:36:43.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:36:43.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:36:43.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:36:43.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:36:43.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:36:43.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:36:43.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:36:43.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:36:43.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:36:43.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:36:43.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:36:43.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:36:43.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:36:43.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:36:43.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:36:43.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:36:43.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:36:43.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:36:43.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:36:43.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:36:43.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:36:43.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:36:43.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:36:43.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:36:43.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:36:43.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:36:43.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:36:43.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:36:43.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:36:43.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:36:43.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:36:43.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:36:43.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:36:43.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:36:43.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:36:43.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:36:43.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:36:43.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:36:43.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:36:43.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:36:43.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:36:43.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:36:43.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:36:43.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:36:43.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:36:43.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:36:43.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:36:43.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:36:43.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:36:43.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:36:43.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:36:43.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:36:43.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:36:43.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:36:43.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:36:43.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:36:43.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:36:43.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:36:43.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:36:43.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:36:43.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:36:43.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:36:43.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:36:43.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:36:43.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:36:43.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:36:43.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:36:43.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:36:43.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:36:43.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:36:43.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:36:43.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:36:43.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:36:43.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:36:43.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:36:43.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:36:43.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:36:43.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:36:43.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:36:43.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:36:43.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:36:43.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:36:43.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:36:43.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:36:43.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:36:43.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:36:43.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:36:43.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:36:43.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:36:43.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:36:43.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:36:43.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:36:43.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:36:43.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:36:43.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:36:43.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:36:43.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:36:43.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:36:43.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:36:43.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:36:43.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:36:43.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:36:43.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:36:43.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:36:43.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:36:43.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:36:43.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:36:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:36:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:36:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:36:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:36:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:36:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:36:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:36:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:36:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:36:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:36:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:36:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:36:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:36:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:36:43.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:36:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:36:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:36:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:36:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:36:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:36:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:36:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:36:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:36:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:36:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:36:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:36:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:36:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:36:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:36:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:36:43.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:36:43.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:36:43.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:36:43.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:36:43.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:36:43.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:36:43.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:36:43.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:36:43.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:36:43.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:36:43.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:36:43.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:36:43.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:36:43.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:36:43.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:36:43.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:36:43.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:36:43.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:36:43.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:36:43.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:36:43.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:36:43.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:36:43.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:36:43.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:36:43.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:36:43.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:36:43.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:36:43.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:36:43.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:36:43.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:36:43.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:36:43.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:36:43.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:36:43.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:36:43.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:36:43.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:36:43.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:36:43.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:36:43.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:36:43.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:36:43.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:36:43.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:36:43.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:36:43.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:36:43.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:36:43.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:36:43.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:36:43.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:36:43.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:36:43.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:36:43.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:36:43.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:36:43.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:36:43.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:36:43.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:36:43.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:36:43.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:36:43.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:36:43.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:36:43.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:36:43.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:36:43.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:36:43.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:36:43.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:36:43.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:36:43.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:36:43.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:36:43.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:36:43.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:36:43.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:36:43.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:36:43.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:36:43.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:36:43.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:36:43.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:36:43.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:36:43.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:36:43.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:36:43.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:36:43.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:36:43.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:36:43.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:36:43.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:36:43.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:36:43.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:36:43.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:36:43.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:36:43.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:36:43.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:36:43.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:36:43.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:36:43.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:36:43.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:36:43.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:36:43.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:36:43.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:36:43.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:36:43.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:36:43.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:36:43.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:36:43.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:36:43.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:36:43.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:36:43.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:36:43.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:36:43.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:36:43.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:36:43.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:36:43.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:36:43.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:36:43.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:36:43.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:36:43.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:36:43.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:36:43.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:36:43.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:36:43.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:36:43.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:36:43.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:36:43.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:36:43.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:36:43.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:36:43.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:36:43.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:36:43.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:36:43.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:36:43.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:36:43.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:36:43.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:36:43.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:36:43.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:36:43.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:36:43.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:36:43.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:36:43.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:36:43.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:36:43.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:36:43.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:36:43.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:36:43.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:36:43.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:36:43.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:36:43.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:36:43.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:36:43.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:36:43.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:36:43.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:36:43.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:36:43.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:36:43.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:36:43.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:36:43.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:36:43.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:36:43.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:36:43.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:36:43.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:36:43.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:36:43.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:36:43.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:36:43.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:36:43.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:36:43.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:36:43.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:36:43.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:36:43.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:36:43.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:36:43.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:36:43.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:36:43.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:36:43.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:36:43.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:36:43.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:36:43.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:36:43.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:36:43.713 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:43.713 DEBUG:teuthology.orchestra.run.smithi107:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:36:43.734 INFO:teuthology.orchestra.run.smithi107.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:36:43.735 INFO:teuthology.orchestra.run.smithi107.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:36:43.735 INFO:teuthology.orchestra.run.smithi107.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:36:43.735 INFO:teuthology.orchestra.run.smithi107.stdout:fi 2024-08-17T02:36:43.735 INFO:teuthology.orchestra.run.smithi107.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:36:43.735 INFO:teuthology.orchestra.run.smithi107.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:36:43.735 INFO:teuthology.orchestra.run.smithi107.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:36:43.735 INFO:teuthology.orchestra.run.smithi107.stdout: fi 2024-08-17T02:36:43.735 INFO:teuthology.orchestra.run.smithi107.stdout:done 2024-08-17T02:36:43.735 INFO:teuthology.orchestra.run.smithi107.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:36:43.735 INFO:teuthology.orchestra.run.smithi107.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:36:43.735 INFO:teuthology.orchestra.run.smithi107.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:36:43.735 INFO:teuthology.orchestra.run.smithi107.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:36:43.735 INFO:teuthology.orchestra.run.smithi107.stdout:fi 2024-08-17T02:36:43.735 INFO:teuthology.orchestra.run.smithi107.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:36:43.736 INFO:teuthology.orchestra.run.smithi107.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:43.736 INFO:teuthology.orchestra.run.smithi107.stdout:fi 2024-08-17T02:36:43.736 INFO:teuthology.orchestra.run.smithi107.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:36:43.736 INFO:teuthology.orchestra.run.smithi107.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:36:43.736 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:43.736 INFO:teuthology.orchestra.run.smithi107.stdout:fi 2024-08-17T02:36:43.737 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -qi grub2-tools 2024-08-17T02:36:43.807 INFO:teuthology.orchestra.run.smithi107.stdout:Name : grub2-tools 2024-08-17T02:36:43.807 INFO:teuthology.orchestra.run.smithi107.stdout:Epoch : 1 2024-08-17T02:36:43.807 INFO:teuthology.orchestra.run.smithi107.stdout:Version : 2.06 2024-08-17T02:36:43.807 INFO:teuthology.orchestra.run.smithi107.stdout:Release : 68.el9 2024-08-17T02:36:43.807 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: x86_64 2024-08-17T02:36:43.807 INFO:teuthology.orchestra.run.smithi107.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:36:43.808 INFO:teuthology.orchestra.run.smithi107.stdout:Group : Unspecified 2024-08-17T02:36:43.808 INFO:teuthology.orchestra.run.smithi107.stdout:Size : 8264254 2024-08-17T02:36:43.808 INFO:teuthology.orchestra.run.smithi107.stdout:License : GPLv3+ 2024-08-17T02:36:43.808 INFO:teuthology.orchestra.run.smithi107.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:36:43.808 INFO:teuthology.orchestra.run.smithi107.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:36:43.808 INFO:teuthology.orchestra.run.smithi107.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:36:43.808 INFO:teuthology.orchestra.run.smithi107.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:36:43.808 INFO:teuthology.orchestra.run.smithi107.stdout:Packager : builder@centos.org 2024-08-17T02:36:43.808 INFO:teuthology.orchestra.run.smithi107.stdout:Vendor : CentOS 2024-08-17T02:36:43.808 INFO:teuthology.orchestra.run.smithi107.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:36:43.808 INFO:teuthology.orchestra.run.smithi107.stdout:Summary : Support tools for GRUB. 2024-08-17T02:36:43.808 INFO:teuthology.orchestra.run.smithi107.stdout:Description : 2024-08-17T02:36:43.808 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:36:43.808 INFO:teuthology.orchestra.run.smithi107.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:36:43.809 INFO:teuthology.orchestra.run.smithi107.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:36:43.809 INFO:teuthology.orchestra.run.smithi107.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:36:43.809 INFO:teuthology.orchestra.run.smithi107.stdout:hardware devices. 2024-08-17T02:36:43.809 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:36:43.809 INFO:teuthology.orchestra.run.smithi107.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:36:43.810 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:36:43.810 INFO:teuthology.task.kernel:Updating grub on smithi107 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:43.810 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:36:44.378 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-08-17T02:36:45.750 INFO:teuthology.orchestra.run.smithi107.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:36:45.775 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-08-17T02:36:45.778 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-08-17T02:36:45.795 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.9gtG5utobX 2024-08-17T02:36:45.796 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9gtG5utobX 2024-08-17T02:36:45.861 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.9gtG5utobX 2024-08-17T02:36:45.998 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.9gtG5utobX is 6KB 2024-08-17T02:36:46.046 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.9gtG5utobX 2024-08-17T02:36:46.061 DEBUG:teuthology.orchestra.run.smithi107:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:36:46.122 INFO:teuthology.orchestra.run.smithi107.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:36:46.122 INFO:teuthology.orchestra.run.smithi107.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:36:46.122 INFO:teuthology.orchestra.run.smithi107.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:36:46.122 INFO:teuthology.orchestra.run.smithi107.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:36:46.124 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:46.275 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2024-08-17T02:36:51.073 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi005.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:36:51.074 DEBUG:teuthology.orchestra.run.smithi005:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:36:51.146 INFO:teuthology.orchestra.run.smithi005.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:51.147 INFO:teuthology.orchestra.run.smithi005.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:51.147 INFO:teuthology.orchestra.run.smithi005.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:51.147 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:51.147 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:36:51.147 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:36:51.147 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:36:51.148 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:36:51.148 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:36:51.148 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:36:51.148 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:36:51.148 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:36:51.148 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:36:51.148 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:36:51.148 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:36:51.148 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:36:51.148 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:36:51.148 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:36:51.148 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:36:51.148 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:36:51.149 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:36:51.149 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:36:51.149 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:36:51.149 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:36:51.149 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:36:51.149 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:36:51.149 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:36:51.149 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:36:51.149 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:36:51.149 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:36:51.149 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:36:51.149 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:36:51.149 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:36:51.150 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:36:51.150 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:36:51.150 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:36:51.150 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:36:51.150 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:36:51.150 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:36:51.150 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:36:51.150 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:36:51.150 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:36:51.150 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:36:51.150 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:36:51.150 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:36:51.150 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:36:51.151 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:36:51.151 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:36:51.151 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:36:51.151 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:36:51.151 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:36:51.151 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:36:51.151 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:36:51.151 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:36:51.151 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:36:51.151 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:36:51.151 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:36:51.151 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:36:51.152 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:36:51.152 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:36:51.152 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:36:51.152 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:36:51.152 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:36:51.152 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:36:51.152 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:36:51.152 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:36:51.152 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:36:51.152 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:36:51.152 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:36:51.152 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:36:51.152 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:36:51.152 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:36:51.153 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:36:51.153 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:36:51.153 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:36:51.153 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:36:51.153 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:36:51.153 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:36:51.153 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:36:51.153 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:36:51.153 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:36:51.153 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:36:51.153 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:36:51.153 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:36:51.153 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:36:51.154 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:36:51.154 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:36:51.154 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:36:51.154 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:36:51.154 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:36:51.154 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:36:51.154 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:36:51.154 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:36:51.154 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:36:51.154 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:36:51.154 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:36:51.154 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:36:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:36:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:36:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:36:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:36:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:36:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:36:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:36:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:36:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:36:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:36:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:36:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:36:51.155 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:36:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:36:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:36:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:36:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:36:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:36:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:36:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:36:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:36:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:36:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:36:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:36:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:36:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:36:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:36:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:36:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:36:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:36:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:36:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:36:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:36:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:36:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:36:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:36:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:36:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:36:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:36:51.158 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:36:51.158 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:36:51.158 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:36:51.158 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:36:51.158 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:36:51.158 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:36:51.158 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:36:51.158 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:36:51.158 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:36:51.158 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:36:51.158 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:36:51.158 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:36:51.158 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:36:51.158 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:36:51.159 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:36:51.159 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:36:51.159 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:36:51.159 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:36:51.159 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:36:51.159 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:36:51.159 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:36:51.159 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:36:51.159 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:36:51.159 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:36:51.159 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:36:51.159 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:36:51.159 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:36:51.160 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:36:51.160 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:36:51.160 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:36:51.160 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:36:51.160 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:36:51.160 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:36:51.160 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:36:51.160 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:36:51.160 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:36:51.160 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:36:51.160 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:36:51.160 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:36:51.160 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:36:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:36:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:36:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:36:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:36:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:36:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:36:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:36:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:36:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:36:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:36:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:36:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:36:51.161 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:36:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:36:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:36:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:36:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:36:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:36:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:36:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:36:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:36:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:36:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:36:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:36:51.162 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:36:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:36:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:36:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:36:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:36:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:36:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:36:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:36:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:36:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:36:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:36:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:36:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:36:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:36:51.163 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:36:51.164 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:36:51.164 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:36:51.164 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:36:51.164 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:36:51.164 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:36:51.164 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:36:51.164 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:36:51.164 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:36:51.164 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:36:51.164 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:36:51.164 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:36:51.164 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:36:51.164 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:36:51.165 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:36:51.165 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:36:51.165 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:36:51.165 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:36:51.165 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:36:51.165 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:36:51.165 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:36:51.165 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:36:51.165 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:36:51.165 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:36:51.165 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:36:51.165 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:36:51.165 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:36:51.166 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:36:51.166 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:36:51.166 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:36:51.166 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:36:51.166 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:36:51.166 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:36:51.166 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:36:51.166 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:36:51.166 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:36:51.166 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:36:51.166 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:36:51.166 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:36:51.166 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:36:51.167 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:36:51.167 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:36:51.167 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:36:51.167 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:36:51.167 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:36:51.167 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:36:51.167 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:36:51.167 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:36:51.167 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:36:51.167 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:36:51.167 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:36:51.167 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:36:51.167 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:36:51.167 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:36:51.168 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:36:51.168 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:36:51.168 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:36:51.168 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:36:51.168 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:36:51.168 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:36:51.168 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:36:51.168 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:36:51.168 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:36:51.168 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:36:51.168 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:36:51.168 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:36:51.168 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:36:51.169 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:36:51.169 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:36:51.169 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:36:51.169 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:36:51.169 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:36:51.169 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:36:51.169 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:36:51.169 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:36:51.169 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:36:51.169 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:36:51.169 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:36:51.169 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:36:51.169 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:36:51.169 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:36:51.170 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:36:51.170 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:36:51.170 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:36:51.170 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:36:51.170 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:36:51.170 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:36:51.170 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:36:51.170 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:36:51.170 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:36:51.170 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:36:51.170 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:36:51.170 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:36:51.170 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:36:51.171 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:36:51.171 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:36:51.171 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:36:51.171 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:36:51.171 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:36:51.171 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:36:51.171 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:36:51.171 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:36:51.171 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:36:51.171 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:36:51.171 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:36:51.171 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:36:51.171 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:36:51.171 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:36:51.171 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:36:51.172 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:36:51.172 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:36:51.172 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:36:51.172 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:36:51.172 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:36:51.172 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:36:51.172 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:36:51.172 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:36:51.172 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:36:51.172 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:36:51.172 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:36:51.172 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:36:51.172 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:36:51.173 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:36:51.173 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:36:51.173 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:36:51.173 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:36:51.173 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:36:51.173 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:36:51.173 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:36:51.173 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:36:51.173 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:36:51.173 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:36:51.173 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:36:51.173 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:36:51.173 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:36:51.174 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:36:51.174 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:36:51.174 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:36:51.174 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:36:51.174 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:36:51.174 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:36:51.174 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:36:51.174 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:36:51.174 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:36:51.177 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:36:51.177 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:36:51.177 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:36:51.178 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:36:51.178 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:36:51.178 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:36:51.178 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:36:51.178 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:36:51.178 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:36:51.178 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:36:51.178 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:36:51.178 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:36:51.178 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:36:51.178 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:36:51.178 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:36:51.178 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:36:51.179 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:36:51.179 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:36:51.179 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:36:51.179 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:36:51.179 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:36:51.179 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:36:51.179 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:36:51.179 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:36:51.179 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:36:51.179 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:36:51.179 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:36:51.179 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:36:51.179 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:36:51.179 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:36:51.180 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:36:51.180 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:36:51.180 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:36:51.180 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:36:51.180 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:36:51.180 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:36:51.180 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:36:51.180 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:36:51.180 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:36:51.180 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:36:51.180 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:36:51.180 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:36:51.180 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:36:51.181 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:36:51.181 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:36:51.181 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:36:51.181 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:36:51.181 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:36:51.181 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:36:51.181 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:36:51.181 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:36:51.181 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:36:51.181 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:36:51.181 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:36:51.181 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:36:51.181 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:36:51.181 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:36:51.181 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:36:51.182 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:36:51.182 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:36:51.182 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:36:51.182 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:36:51.182 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:36:51.182 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:36:51.182 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:36:51.182 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:36:51.182 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:36:51.182 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:36:51.182 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:36:51.182 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:36:51.182 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:36:51.183 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:36:51.183 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:36:51.183 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:36:51.183 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:36:51.183 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:36:51.183 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:36:51.183 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:36:51.183 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:36:51.183 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:36:51.183 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:36:51.184 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:36:51.184 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:36:51.184 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:36:51.184 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:36:51.184 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:36:51.184 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:36:51.184 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:36:51.184 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:36:51.184 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:36:51.184 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:36:51.184 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:36:51.184 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:36:51.185 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:36:51.185 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:36:51.185 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:36:51.185 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:36:51.185 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:36:51.185 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:36:51.185 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:36:51.185 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:36:51.185 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:36:51.185 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:36:51.185 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:36:51.185 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:36:51.185 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:36:51.186 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:36:51.186 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:36:51.186 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:36:51.186 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:36:51.186 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:36:51.186 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:36:51.186 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:36:51.186 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:36:51.186 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:36:51.186 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:36:51.186 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:36:51.186 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:36:51.187 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:36:51.187 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:36:51.187 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:36:51.187 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:36:51.187 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:36:51.187 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:36:51.187 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:36:51.187 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:36:51.187 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:36:51.187 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:36:51.187 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:36:51.187 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:36:51.187 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:36:51.188 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:36:51.188 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:36:51.188 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:36:51.188 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:36:51.188 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:36:51.188 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:36:51.188 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:36:51.188 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:36:51.188 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:36:51.188 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:36:51.188 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:36:51.188 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:36:51.188 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:36:51.189 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:36:51.189 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:36:51.189 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:36:51.189 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:36:51.189 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:36:51.189 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:36:51.189 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:36:51.189 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:36:51.189 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:36:51.189 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:36:51.189 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:36:51.189 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:36:51.189 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:36:51.190 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:36:51.190 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:36:51.190 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:36:51.190 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:36:51.190 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:36:51.190 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:36:51.190 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:36:51.190 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:36:51.190 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:36:51.190 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:36:51.190 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:36:51.190 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:36:51.190 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:36:51.191 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:36:51.191 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:36:51.191 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:36:51.191 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:36:51.191 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:36:51.191 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:36:51.191 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:36:51.191 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:36:51.191 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:36:51.191 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:36:51.191 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:36:51.191 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:36:51.191 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:36:51.192 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:36:51.192 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:36:51.192 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:36:51.192 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:36:51.192 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:36:51.192 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:36:51.192 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:36:51.192 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:36:51.192 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:36:51.192 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:36:51.192 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:36:51.192 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:36:51.192 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:36:51.192 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:36:51.193 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:36:51.193 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:36:51.193 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:36:51.193 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:36:51.193 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:36:51.193 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:36:51.193 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:36:51.193 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:36:51.193 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:36:51.193 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:36:51.193 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:36:51.193 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:36:51.193 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:36:51.194 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:36:51.194 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:36:51.194 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:36:51.194 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:36:51.194 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:36:51.194 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:36:51.194 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:36:51.194 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:36:51.194 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:36:51.194 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:36:51.194 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:36:51.194 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:36:51.194 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:36:51.195 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:36:51.195 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:36:51.195 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:36:51.195 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:36:51.195 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:36:51.195 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:36:51.195 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:36:51.195 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:36:51.195 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:36:51.195 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:36:51.196 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:36:51.196 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:36:51.196 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:36:51.196 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:36:51.196 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:36:51.196 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:36:51.196 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:36:51.196 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:36:51.196 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:36:51.196 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:36:51.196 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:36:51.196 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:36:51.196 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:36:51.197 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:36:51.197 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:36:51.197 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:36:51.197 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:36:51.197 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:36:51.197 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:36:51.197 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:36:51.197 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:36:51.197 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:36:51.197 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:36:51.197 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:36:51.197 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:36:51.197 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:36:51.197 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:36:51.197 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:36:51.198 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:36:51.198 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:36:51.198 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:36:51.198 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:36:51.198 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:36:51.198 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:36:51.198 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:36:51.198 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:36:51.198 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:36:51.198 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:36:51.198 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:36:51.198 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:36:51.198 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:36:51.199 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:36:51.199 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:36:51.199 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:36:51.199 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:36:51.199 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:36:51.199 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:36:51.199 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:36:51.199 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:36:51.199 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:36:51.199 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:36:51.199 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:36:51.199 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:36:51.199 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:36:51.199 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:36:51.200 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:36:51.200 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:36:51.200 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:36:51.200 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:36:51.200 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:36:51.200 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:36:51.200 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:36:51.200 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:36:51.200 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:36:51.200 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:36:51.200 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:36:51.200 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:36:51.200 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:36:51.200 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:36:51.201 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:36:51.201 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:36:51.201 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:36:51.201 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:36:51.201 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:36:51.201 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:36:51.201 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:36:51.201 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:36:51.201 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:36:51.201 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:36:51.201 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:36:51.201 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:36:51.201 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:36:51.202 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:36:51.202 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:36:51.202 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:36:51.202 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:36:51.202 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:36:51.202 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:36:51.202 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:36:51.202 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:36:51.202 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:36:51.202 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:36:51.202 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:36:51.202 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:36:51.203 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:36:51.203 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:36:51.203 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:36:51.203 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:36:51.203 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:36:51.203 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:36:51.203 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:36:51.203 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:36:51.203 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:36:51.203 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:36:51.203 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:36:51.203 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:36:51.203 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:36:51.204 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:36:51.204 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:36:51.204 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:36:51.204 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:36:51.204 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:36:51.204 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:36:51.204 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:36:51.204 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:36:51.204 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:36:51.204 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:36:51.204 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:36:51.204 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:36:51.204 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:36:51.204 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:36:51.205 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:36:51.205 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:36:51.205 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:36:51.205 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:36:51.205 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:36:51.205 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:36:51.205 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:36:51.205 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:36:51.205 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:36:51.205 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:36:51.205 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:36:51.205 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:36:51.205 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:36:51.206 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:36:51.206 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:36:51.206 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:36:51.206 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:36:51.206 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:36:51.206 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:36:51.206 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:36:51.206 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:36:51.206 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:36:51.206 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:36:51.206 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:36:51.206 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:36:51.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:36:51.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:36:51.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:36:51.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:36:51.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:36:51.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:36:51.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:36:51.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:36:51.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:36:51.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:36:51.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:36:51.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:36:51.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:36:51.207 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:36:51.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:36:51.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:36:51.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:36:51.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:36:51.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:36:51.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:36:51.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:36:51.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:36:51.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:36:51.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:36:51.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:36:51.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:36:51.208 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:36:51.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:36:51.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:36:51.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:36:51.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:36:51.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:36:51.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:36:51.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:36:51.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:36:51.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:36:51.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:36:51.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:36:51.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:36:51.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:36:51.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:36:51.209 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:36:51.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:36:51.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:36:51.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:36:51.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:36:51.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:36:51.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:36:51.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:36:51.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:36:51.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:36:51.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:36:51.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:36:51.210 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:36:51.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:36:51.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:36:51.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:36:51.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:36:51.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:36:51.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:36:51.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:36:51.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:36:51.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:36:51.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:36:51.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:36:51.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:36:51.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:36:51.211 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:36:51.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:36:51.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:36:51.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:36:51.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:36:51.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:36:51.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:36:51.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:36:51.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:36:51.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:36:51.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:36:51.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:36:51.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:36:51.212 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:36:51.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:36:51.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:36:51.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:36:51.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:36:51.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:36:51.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:36:51.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:36:51.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:36:51.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:36:51.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:36:51.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:36:51.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:36:51.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:36:51.213 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:36:51.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:36:51.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:36:51.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:36:51.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:36:51.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:36:51.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:36:51.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:36:51.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:36:51.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:36:51.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:36:51.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:36:51.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:36:51.214 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:36:51.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:36:51.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:36:51.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:36:51.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:36:51.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:36:51.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:36:51.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:36:51.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:36:51.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:36:51.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:36:51.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:36:51.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:36:51.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:36:51.215 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:36:51.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:36:51.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:36:51.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:36:51.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:36:51.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:36:51.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:36:51.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:36:51.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:36:51.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:36:51.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:36:51.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:36:51.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:36:51.216 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:36:51.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:36:51.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:36:51.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:36:51.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:36:51.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:36:51.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:36:51.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:36:51.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:36:51.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:36:51.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:36:51.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:36:51.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:36:51.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:36:51.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:36:51.217 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:36:51.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:36:51.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:36:51.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:36:51.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:36:51.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:36:51.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:36:51.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:36:51.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:36:51.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:36:51.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:36:51.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:36:51.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:36:51.218 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:36:51.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:36:51.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:36:51.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:36:51.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:36:51.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:36:51.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:36:51.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:36:51.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:36:51.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:36:51.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:36:51.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:36:51.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:36:51.219 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:36:51.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:36:51.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:36:51.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:36:51.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:36:51.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:36:51.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:36:51.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:36:51.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:36:51.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:36:51.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:36:51.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:36:51.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:36:51.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:36:51.220 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:36:51.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:36:51.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:36:51.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:36:51.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:36:51.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:36:51.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:36:51.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:36:51.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:36:51.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:36:51.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:36:51.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:36:51.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:36:51.221 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:36:51.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:36:51.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:36:51.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:36:51.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:36:51.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:36:51.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:36:51.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:36:51.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:36:51.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:36:51.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:36:51.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:36:51.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:36:51.222 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:36:51.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:36:51.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:36:51.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:36:51.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:36:51.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:36:51.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:36:51.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:36:51.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:36:51.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:36:51.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:36:51.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:36:51.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:36:51.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:36:51.223 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:36:51.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:36:51.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:36:51.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:36:51.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:36:51.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:36:51.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:36:51.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:36:51.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:36:51.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:36:51.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:36:51.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:36:51.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:36:51.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:36:51.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:36:51.224 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:36:51.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:36:51.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:36:51.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:36:51.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:36:51.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:36:51.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:36:51.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:36:51.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:36:51.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:36:51.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:36:51.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:36:51.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:36:51.225 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:36:51.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:36:51.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:36:51.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:36:51.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:36:51.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:36:51.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:36:51.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:36:51.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:36:51.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:36:51.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:36:51.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:36:51.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:36:51.226 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:36:51.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:36:51.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:36:51.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:36:51.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:36:51.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:36:51.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:36:51.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:36:51.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:36:51.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:36:51.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:36:51.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:36:51.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:36:51.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:36:51.227 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:36:51.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:36:51.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:36:51.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:36:51.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:36:51.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:36:51.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:36:51.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:36:51.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:36:51.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:36:51.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:36:51.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:36:51.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:36:51.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:36:51.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:36:51.228 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:36:51.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:36:51.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:36:51.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:36:51.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:36:51.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:36:51.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:36:51.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:36:51.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:36:51.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:36:51.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:36:51.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:36:51.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:36:51.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:36:51.229 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:36:51.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:36:51.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:36:51.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:36:51.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:36:51.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:36:51.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:36:51.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:36:51.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:36:51.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:36:51.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:36:51.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:36:51.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:36:51.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:36:51.230 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:36:51.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:36:51.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:36:51.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:36:51.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:36:51.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:36:51.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:36:51.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:36:51.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:36:51.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:36:51.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:36:51.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:36:51.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:36:51.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:36:51.231 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:36:51.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:36:51.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:36:51.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:36:51.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:36:51.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:36:51.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:36:51.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:36:51.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:36:51.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:36:51.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:36:51.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:36:51.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:36:51.232 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:36:51.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:36:51.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:36:51.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:36:51.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:36:51.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:36:51.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:36:51.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:36:51.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:36:51.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:36:51.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:36:51.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:36:51.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:36:51.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:36:51.233 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:36:51.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:36:51.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:36:51.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:36:51.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:36:51.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:36:51.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:36:51.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:36:51.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:36:51.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:36:51.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:36:51.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:36:51.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:36:51.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:36:51.234 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:36:51.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:36:51.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:36:51.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:36:51.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:36:51.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:36:51.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:36:51.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:36:51.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:36:51.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:36:51.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:36:51.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:36:51.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:36:51.235 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:36:51.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:36:51.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:36:51.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:36:51.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:36:51.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:36:51.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:36:51.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:36:51.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:36:51.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:36:51.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:36:51.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:36:51.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:36:51.236 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:36:51.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:36:51.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:36:51.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:36:51.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:36:51.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:36:51.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:36:51.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:36:51.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:36:51.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:36:51.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:36:51.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:36:51.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:36:51.237 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:36:51.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:36:51.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:36:51.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:36:51.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:36:51.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:36:51.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:36:51.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:36:51.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:36:51.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:36:51.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:36:51.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:36:51.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:36:51.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:36:51.238 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:36:51.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:36:51.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:36:51.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:36:51.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:36:51.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:36:51.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:36:51.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:36:51.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:36:51.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:36:51.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:36:51.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:36:51.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:36:51.239 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:36:51.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:36:51.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:36:51.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:36:51.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:36:51.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:36:51.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:36:51.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:36:51.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:36:51.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:36:51.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:36:51.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:36:51.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:36:51.240 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:36:51.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:36:51.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:36:51.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:36:51.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:36:51.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:36:51.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:36:51.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:36:51.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:36:51.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:36:51.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:36:51.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:36:51.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:36:51.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:36:51.241 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:36:51.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:36:51.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:36:51.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:36:51.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:36:51.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:36:51.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:36:51.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:36:51.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:36:51.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:36:51.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:36:51.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:36:51.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:36:51.242 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:36:51.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:36:51.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:36:51.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:36:51.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:36:51.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:36:51.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:36:51.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:36:51.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:36:51.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:36:51.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:36:51.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:36:51.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:36:51.243 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:36:51.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:36:51.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:36:51.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:36:51.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:36:51.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:36:51.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:36:51.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:36:51.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:36:51.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:36:51.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:36:51.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:36:51.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:36:51.244 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:36:51.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:36:51.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:36:51.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:36:51.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:36:51.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:36:51.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:36:51.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:36:51.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:36:51.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:36:51.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:36:51.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:36:51.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:36:51.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:36:51.245 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:36:51.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:36:51.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:36:51.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:36:51.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:36:51.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:36:51.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:36:51.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:36:51.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:36:51.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:36:51.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:36:51.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:36:51.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:36:51.246 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:36:51.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:36:51.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:36:51.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:36:51.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:36:51.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:36:51.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:36:51.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:36:51.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:36:51.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:36:51.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:36:51.247 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:36:51.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:36:51.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:36:51.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:36:51.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:36:51.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:36:51.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:36:51.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:36:51.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:36:51.248 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:36:51.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:36:51.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:36:51.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:36:51.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:36:51.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:36:51.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:36:51.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:36:51.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:36:51.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:36:51.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:36:51.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:36:51.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:36:51.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:36:51.249 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:36:51.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:36:51.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:36:51.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:36:51.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:36:51.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:36:51.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:36:51.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:36:51.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:36:51.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:36:51.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:36:51.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:36:51.250 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:36:51.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:36:51.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:36:51.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:36:51.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:36:51.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:36:51.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:36:51.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:36:51.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:36:51.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:36:51.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:36:51.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:36:51.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:36:51.251 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:36:51.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:36:51.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:36:51.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:36:51.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:36:51.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:36:51.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:36:51.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:36:51.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:36:51.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:36:51.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:36:51.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:36:51.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:36:51.252 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:36:51.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:36:51.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:36:51.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:36:51.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:36:51.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:36:51.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:36:51.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:36:51.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:36:51.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:36:51.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:36:51.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:36:51.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:36:51.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:36:51.253 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:36:51.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:36:51.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:36:51.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:36:51.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:36:51.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:36:51.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:36:51.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:36:51.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:36:51.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:36:51.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:36:51.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:36:51.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:36:51.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:36:51.254 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:36:51.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:36:51.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:36:51.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:36:51.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:36:51.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:36:51.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:36:51.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:36:51.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:36:51.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:36:51.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:36:51.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:36:51.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:36:51.255 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:36:51.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:36:51.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:36:51.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:36:51.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:36:51.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:36:51.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:36:51.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:36:51.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:36:51.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:36:51.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:36:51.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:36:51.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:36:51.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:36:51.256 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:36:51.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:36:51.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:36:51.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:36:51.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:36:51.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:36:51.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:36:51.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:36:51.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:36:51.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:36:51.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:36:51.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:36:51.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:36:51.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:36:51.257 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:36:51.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:36:51.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:36:51.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:36:51.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:36:51.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:36:51.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:36:51.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:36:51.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:36:51.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:36:51.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:36:51.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:36:51.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:36:51.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:36:51.258 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:36:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:36:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:36:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:36:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:36:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:36:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:36:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:36:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:36:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:36:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:36:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:36:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:36:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:36:51.259 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:36:51.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:36:51.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:36:51.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:36:51.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:36:51.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:36:51.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:36:51.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:36:51.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:36:51.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:36:51.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:36:51.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:36:51.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:36:51.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:36:51.260 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:36:51.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:36:51.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:36:51.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:36:51.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:36:51.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:36:51.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:36:51.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:36:51.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:36:51.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:36:51.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:36:51.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:36:51.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:36:51.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:36:51.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:36:51.261 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:36:51.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:36:51.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:36:51.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:36:51.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:36:51.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:36:51.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:36:51.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:36:51.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:36:51.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:36:51.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:36:51.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:36:51.262 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:36:51.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:36:51.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:36:51.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:36:51.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:36:51.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:36:51.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:36:51.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:36:51.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:36:51.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:36:51.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:36:51.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:36:51.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:36:51.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:36:51.263 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:36:51.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:36:51.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:36:51.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:36:51.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:36:51.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:36:51.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:36:51.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:36:51.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:36:51.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:36:51.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:36:51.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:36:51.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:36:51.264 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:36:51.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:36:51.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:36:51.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:36:51.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:36:51.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:36:51.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:36:51.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:36:51.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:36:51.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:36:51.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:36:51.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:36:51.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:36:51.265 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:36:51.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:36:51.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:36:51.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:36:51.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:36:51.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:36:51.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:36:51.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:36:51.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:36:51.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:36:51.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:36:51.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:36:51.266 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:36:51.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:36:51.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:36:51.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:36:51.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:36:51.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:36:51.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:36:51.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:36:51.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:36:51.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:36:51.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:36:51.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:36:51.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:36:51.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:36:51.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:36:51.267 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:36:51.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:36:51.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:36:51.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:36:51.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:36:51.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:36:51.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:36:51.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:36:51.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:36:51.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:36:51.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:36:51.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:36:51.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:36:51.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:36:51.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:36:51.268 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:36:51.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:36:51.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:36:51.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:36:51.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:36:51.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:36:51.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:36:51.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:36:51.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:36:51.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:36:51.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:36:51.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:36:51.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:36:51.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:36:51.269 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:36:51.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:36:51.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:36:51.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:36:51.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:36:51.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:36:51.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:36:51.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:36:51.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:36:51.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:36:51.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:36:51.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:36:51.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:36:51.270 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:36:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:36:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:36:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:36:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:36:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:36:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:36:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:36:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:36:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:36:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:36:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:36:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:36:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:36:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:36:51.271 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:36:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:36:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:36:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:36:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:36:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:36:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:36:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:36:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:36:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:36:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:36:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:36:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:36:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:36:51.272 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:36:51.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:36:51.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:36:51.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:36:51.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:36:51.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:36:51.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:36:51.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:36:51.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:36:51.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:36:51.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:36:51.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:36:51.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:36:51.273 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:36:51.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:36:51.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:36:51.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:36:51.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:36:51.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:36:51.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:36:51.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:36:51.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:36:51.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:36:51.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:36:51.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:36:51.274 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:36:51.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:36:51.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:36:51.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:36:51.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:36:51.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:36:51.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:36:51.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:36:51.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:36:51.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:36:51.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:36:51.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:36:51.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:36:51.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:36:51.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:36:51.275 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:36:51.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:36:51.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:36:51.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:36:51.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:36:51.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:36:51.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:36:51.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:36:51.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:36:51.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:36:51.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:36:51.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:36:51.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:36:51.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:36:51.276 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:36:51.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:36:51.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:36:51.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:36:51.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:36:51.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:36:51.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:36:51.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:36:51.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:36:51.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:36:51.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:36:51.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:36:51.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:36:51.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:36:51.277 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:36:51.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:36:51.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:36:51.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:36:51.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:36:51.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:36:51.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:36:51.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:36:51.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:36:51.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:36:51.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:36:51.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:36:51.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:36:51.278 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:36:51.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:36:51.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:36:51.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:36:51.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:36:51.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:36:51.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:36:51.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:36:51.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:36:51.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:36:51.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:36:51.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:36:51.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:36:51.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:36:51.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:36:51.279 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:36:51.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:36:51.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:36:51.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:36:51.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:36:51.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:36:51.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:36:51.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:36:51.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:36:51.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:36:51.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:36:51.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:36:51.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:36:51.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:36:51.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:36:51.280 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:36:51.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:36:51.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:36:51.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:36:51.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:36:51.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:36:51.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:36:51.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:36:51.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:36:51.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:36:51.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:36:51.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:36:51.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:36:51.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:36:51.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:36:51.281 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:36:51.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:36:51.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:36:51.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:36:51.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:36:51.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:36:51.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:36:51.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:36:51.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:36:51.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:36:51.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:36:51.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:36:51.282 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:36:51.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:36:51.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:36:51.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:36:51.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:36:51.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:36:51.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:36:51.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:36:51.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:36:51.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:36:51.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:36:51.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:36:51.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:36:51.283 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:36:51.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:36:51.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:36:51.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:36:51.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:36:51.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:36:51.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:36:51.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:36:51.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:36:51.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:36:51.284 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:36:51.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:36:51.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:36:51.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:36:51.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:36:51.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:36:51.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:36:51.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:36:51.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:36:51.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:36:51.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:36:51.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:36:51.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:36:51.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:36:51.285 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:36:51.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:36:51.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:36:51.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:36:51.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:36:51.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:36:51.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:36:51.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:36:51.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:36:51.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:36:51.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:36:51.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:36:51.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:36:51.286 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:36:51.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:36:51.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:36:51.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:36:51.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:36:51.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:36:51.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:36:51.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:36:51.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:36:51.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:36:51.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:36:51.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:36:51.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:36:51.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:36:51.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:36:51.287 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:36:51.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:36:51.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:36:51.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:36:51.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:36:51.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:36:51.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:36:51.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:36:51.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:36:51.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:36:51.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:36:51.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:36:51.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:36:51.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:36:51.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:36:51.288 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:36:51.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:36:51.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:36:51.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:36:51.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:36:51.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:36:51.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:36:51.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:36:51.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:36:51.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:36:51.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:36:51.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:36:51.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:36:51.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:36:51.289 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:36:51.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:36:51.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:36:51.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:36:51.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:36:51.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:36:51.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:36:51.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:36:51.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:36:51.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:36:51.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:36:51.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:36:51.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:36:51.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:36:51.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:36:51.290 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:36:51.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:36:51.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:36:51.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:36:51.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:36:51.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:36:51.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:36:51.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:36:51.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:36:51.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:36:51.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:36:51.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:36:51.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:36:51.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:36:51.291 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:36:51.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:36:51.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:36:51.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:36:51.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:36:51.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:36:51.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:36:51.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:36:51.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:36:51.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:36:51.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:36:51.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:36:51.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:36:51.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:36:51.292 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:36:51.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:36:51.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:36:51.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:36:51.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:36:51.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:36:51.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:36:51.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:36:51.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:36:51.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:36:51.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:36:51.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:36:51.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:36:51.293 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:36:51.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:36:51.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:36:51.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:36:51.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:36:51.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:36:51.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:36:51.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:36:51.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:36:51.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:36:51.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:36:51.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:36:51.294 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:36:51.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:36:51.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:36:51.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:36:51.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:36:51.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:36:51.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:36:51.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:36:51.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:36:51.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:36:51.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:36:51.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:36:51.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:36:51.295 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:36:51.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:36:51.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:36:51.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:36:51.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:36:51.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:36:51.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:36:51.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:36:51.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:36:51.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:36:51.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:36:51.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:36:51.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:36:51.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:36:51.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:36:51.296 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:36:51.300 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:51.300 DEBUG:teuthology.orchestra.run.smithi005:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:36:51.324 INFO:teuthology.orchestra.run.smithi005.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:36:51.324 INFO:teuthology.orchestra.run.smithi005.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:36:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:36:51.324 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2024-08-17T02:36:51.324 INFO:teuthology.orchestra.run.smithi005.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:36:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:36:51.324 INFO:teuthology.orchestra.run.smithi005.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:36:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: fi 2024-08-17T02:36:51.325 INFO:teuthology.orchestra.run.smithi005.stdout:done 2024-08-17T02:36:51.325 INFO:teuthology.orchestra.run.smithi005.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:36:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:36:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:36:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:36:51.325 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2024-08-17T02:36:51.325 INFO:teuthology.orchestra.run.smithi005.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:36:51.325 INFO:teuthology.orchestra.run.smithi005.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:51.325 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2024-08-17T02:36:51.325 INFO:teuthology.orchestra.run.smithi005.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:36:51.325 INFO:teuthology.orchestra.run.smithi005.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:36:51.325 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:51.325 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2024-08-17T02:36:51.326 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -qi grub2-tools 2024-08-17T02:36:51.404 INFO:teuthology.orchestra.run.smithi005.stdout:Name : grub2-tools 2024-08-17T02:36:51.404 INFO:teuthology.orchestra.run.smithi005.stdout:Epoch : 1 2024-08-17T02:36:51.404 INFO:teuthology.orchestra.run.smithi005.stdout:Version : 2.06 2024-08-17T02:36:51.404 INFO:teuthology.orchestra.run.smithi005.stdout:Release : 68.el9 2024-08-17T02:36:51.404 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: x86_64 2024-08-17T02:36:51.404 INFO:teuthology.orchestra.run.smithi005.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:36:51.404 INFO:teuthology.orchestra.run.smithi005.stdout:Group : Unspecified 2024-08-17T02:36:51.405 INFO:teuthology.orchestra.run.smithi005.stdout:Size : 8264254 2024-08-17T02:36:51.405 INFO:teuthology.orchestra.run.smithi005.stdout:License : GPLv3+ 2024-08-17T02:36:51.405 INFO:teuthology.orchestra.run.smithi005.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:36:51.405 INFO:teuthology.orchestra.run.smithi005.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:36:51.405 INFO:teuthology.orchestra.run.smithi005.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:36:51.405 INFO:teuthology.orchestra.run.smithi005.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:36:51.405 INFO:teuthology.orchestra.run.smithi005.stdout:Packager : builder@centos.org 2024-08-17T02:36:51.405 INFO:teuthology.orchestra.run.smithi005.stdout:Vendor : CentOS 2024-08-17T02:36:51.405 INFO:teuthology.orchestra.run.smithi005.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:36:51.405 INFO:teuthology.orchestra.run.smithi005.stdout:Summary : Support tools for GRUB. 2024-08-17T02:36:51.405 INFO:teuthology.orchestra.run.smithi005.stdout:Description : 2024-08-17T02:36:51.405 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:36:51.405 INFO:teuthology.orchestra.run.smithi005.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:36:51.405 INFO:teuthology.orchestra.run.smithi005.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:36:51.406 INFO:teuthology.orchestra.run.smithi005.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:36:51.406 INFO:teuthology.orchestra.run.smithi005.stdout:hardware devices. 2024-08-17T02:36:51.406 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:36:51.406 INFO:teuthology.orchestra.run.smithi005.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:36:51.407 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:36:51.407 INFO:teuthology.task.kernel:Updating grub on smithi005 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:51.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:36:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2024-08-17T02:36:53.565 INFO:teuthology.orchestra.run.smithi005.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:36:53.606 INFO:teuthology.orchestra.run.smithi005.stderr:done 2024-08-17T02:36:53.609 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-08-17T02:36:53.630 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.22H6dNMreS 2024-08-17T02:36:53.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.22H6dNMreS 2024-08-17T02:36:53.695 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.22H6dNMreS 2024-08-17T02:36:53.833 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.22H6dNMreS is 6KB 2024-08-17T02:36:53.882 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.22H6dNMreS 2024-08-17T02:36:53.897 DEBUG:teuthology.orchestra.run.smithi005:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:36:53.959 INFO:teuthology.orchestra.run.smithi005.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:36:53.959 INFO:teuthology.orchestra.run.smithi005.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:36:53.959 INFO:teuthology.orchestra.run.smithi005.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:36:53.959 INFO:teuthology.orchestra.run.smithi005.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:36:53.960 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:54.103 DEBUG:teuthology.orchestra.run.smithi005:> sudo shutdown -r now 2024-08-17T02:37:16.286 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-08-17T02:37:16.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-08-17T02:37:16.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:37:24.110 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-17T02:37:24.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-17T02:37:24.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:37:34.819 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-08-17T02:37:43.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-08-17T02:37:43.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:37:46.878 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-08-17T02:37:58.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-08-17T02:37:58.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:38:17.315 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-08-17T02:38:24.120 DEBUG:teuthology.orchestra.remote:timed out 2024-08-17T02:38:32.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-08-17T02:38:32.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:38:32.664 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-08-17T02:38:33.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-17T02:38:33.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:38:33.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-08-17T02:38:33.267 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:38:33.268 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-08-17T02:38:33.305 INFO:teuthology.orchestra.run.smithi107.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:38:33.305 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:38:33.305 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:38:33.306 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:38:33.544 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-08-17T02:38:34.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-17T02:38:34.018 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:38:34.018 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-08-17T02:38:34.052 INFO:teuthology.orchestra.run.smithi005.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:38:34.052 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:38:34.052 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:38:34.052 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:38:34.309 DEBUG:teuthology.parallel:result is None 2024-08-17T02:38:35.055 DEBUG:teuthology.parallel:result is None 2024-08-17T02:38:35.056 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:38:35.062 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:38:35.063 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:38:35.067 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:38:35.103 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:38:35.111 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:38:35.130 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:38:35.131 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:38:35.147 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:38:35.200 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:38:35.208 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:38:35.209 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:38:35.235 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:38:35.338 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:38:35.367 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:38:35.394 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:38:35.414 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:38:35.418 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:38:35.425 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:38:35.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:38:35.429 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:38:35.485 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:38:35.495 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:38:35.496 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:38:35.499 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:38:35.534 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:38:35.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:38:35.729 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:38:35.794 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:38:35.869 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:38:35.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:38:35.947 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:38:36.011 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:38:36.093 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:38:36.157 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:38:36.232 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:38:36.232 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:38:36.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-08-17T02:38:36.320 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-08-17T02:38:36.400 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:38:36.405 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:38:36.949 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:38:36.956 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:38:36.957 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:38:36.972 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:38:36.988 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2024-08-17T02:38:37.116 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2024-08-17T02:38:37.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2024-08-17T02:38:37.215 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2024-08-17T02:38:37.218 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:38:37.218 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2024-08-17T02:38:37.258 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2024-08-17T02:38:37.258 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2024-08-17T02:38:37.301 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2024-08-17T02:38:37.301 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi107.front.sepia.ceph.com': 'permissive'} 2024-08-17T02:38:37.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:38:37.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:38:37.362 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:38:37.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:38:37.420 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:38:37.421 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:38:37.546 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:38:37.750 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:38:37.760 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:38:37.773 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:38:37.774 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi107.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:44:14.020 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi107.front.sepia.ceph.com')] 2024-08-17T02:44:14.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-17T02:44:14.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:44:14.117 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-08-17T02:44:14.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-17T02:44:14.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-08-17T02:44:14.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:44:14.309 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-08-17T02:44:14.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-08-17T02:44:14.417 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:44:14.427 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:44:14.428 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:44:14.428 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:44:14.432 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:44:14.432 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:44:14.490 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:44:14.516 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:44:14.520 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:44:14.545 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:44:14.572 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2024-08-17T02:44:14.596 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2024-08-17T02:44:14.596 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2024-08-17T02:44:14.620 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2024-08-17T02:44:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:44:14.649 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:44:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:44:14.678 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:44:14.747 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:44:14.753 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:44:14.754 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-08-17T02:44:14.754 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:44:14.754 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:44:14.754 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:44:14.754 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:44:14.770 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:44:14.776 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:44:14.776 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-08-17T02:44:14.777 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:44:14.777 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:44:14.777 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:44:14.777 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:44:14.778 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:44:14.786 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:44:14.786 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:44:14.786 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:44:14.787 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:44:14.794 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:44:14.794 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:44:14.795 DEBUG:teuthology.orchestra.run.smithi005:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:44:14.795 DEBUG:teuthology.orchestra.run.smithi107:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:44:15.490 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:21 ago on Sat 17 Aug 2024 02:42:54 AM UTC. 2024-08-17T02:44:15.518 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:15 ago on Sat 17 Aug 2024 02:43:00 AM UTC. 2024-08-17T02:44:15.577 INFO:teuthology.orchestra.run.smithi107.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:44:15.606 INFO:teuthology.orchestra.run.smithi005.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:44:15.620 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-08-17T02:44:15.621 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-08-17T02:44:15.621 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-08-17T02:44:15.650 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-08-17T02:44:15.652 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-08-17T02:44:15.652 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-08-17T02:44:15.708 DEBUG:teuthology.orchestra.run.smithi107:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:44:15.722 DEBUG:teuthology.orchestra.run.smithi005:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:44:15.955 INFO:teuthology.orchestra.run.smithi107.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:44:15.955 INFO:teuthology.orchestra.run.smithi107.stderr:of the main distribution, and quality may vary. 2024-08-17T02:44:15.955 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-08-17T02:44:15.955 INFO:teuthology.orchestra.run.smithi107.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:44:15.955 INFO:teuthology.orchestra.run.smithi107.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:44:15.955 INFO:teuthology.orchestra.run.smithi107.stderr:, 2024-08-17T02:44:15.955 INFO:teuthology.orchestra.run.smithi107.stderr:and packages are not held to any quality or security level. 2024-08-17T02:44:15.956 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-08-17T02:44:15.956 INFO:teuthology.orchestra.run.smithi107.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:44:15.956 INFO:teuthology.orchestra.run.smithi107.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:44:15.982 INFO:teuthology.orchestra.run.smithi005.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:44:15.983 INFO:teuthology.orchestra.run.smithi005.stderr:of the main distribution, and quality may vary. 2024-08-17T02:44:15.983 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-17T02:44:15.983 INFO:teuthology.orchestra.run.smithi005.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:44:15.983 INFO:teuthology.orchestra.run.smithi005.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:44:15.983 INFO:teuthology.orchestra.run.smithi005.stderr:, 2024-08-17T02:44:15.983 INFO:teuthology.orchestra.run.smithi005.stderr:and packages are not held to any quality or security level. 2024-08-17T02:44:15.983 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-17T02:44:15.983 INFO:teuthology.orchestra.run.smithi005.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:44:15.983 INFO:teuthology.orchestra.run.smithi005.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:44:16.045 INFO:teuthology.orchestra.run.smithi107.stdout:Repository successfully enabled. 2024-08-17T02:44:16.069 INFO:teuthology.orchestra.run.smithi005.stdout:Repository successfully enabled. 2024-08-17T02:44:16.091 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:44:16.092 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:44:16.118 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:44:16.118 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:44:16.241 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:44:16.241 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:44:16.264 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:44:16.264 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:44:16.427 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:44:16.427 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:44:16.427 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:44:16.447 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:44:16.447 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:44:16.447 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:44:16.483 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:44:16.484 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:44:16.503 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:44:16.504 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:44:16.580 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:44:16.603 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:44:16.659 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:44:16.690 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:44:16.714 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2024-08-17T02:44:16.718 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2024-08-17T02:44:16.751 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2024-08-17T02:44:16.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2024-08-17T02:44:16.984 INFO:teuthology.orchestra.run.smithi107.stdout:45 files removed 2024-08-17T02:44:17.016 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:44:17.038 INFO:teuthology.orchestra.run.smithi005.stdout:45 files removed 2024-08-17T02:44:17.073 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:44:17.895 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 149 kB/s | 77 kB 00:00 2024-08-17T02:44:17.945 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 158 kB/s | 77 kB 00:00 2024-08-17T02:44:18.596 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 16 kB/s | 11 kB 00:00 2024-08-17T02:44:18.637 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 17 kB/s | 11 kB 00:00 2024-08-17T02:44:18.913 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 6.4 kB/s | 1.8 kB 00:00 2024-08-17T02:44:18.979 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 5.9 kB/s | 1.8 kB 00:00 2024-08-17T02:44:19.139 INFO:teuthology.orchestra.run.smithi107.stdout:Copr repo for el9 owned by ceph 40 kB/s | 7.6 kB 00:00 2024-08-17T02:44:19.221 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for el9 owned by ceph 37 kB/s | 7.6 kB 00:00 2024-08-17T02:44:19.647 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-08-17T02:44:19.963 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-17T02:44:22.190 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-08-17T02:44:23.748 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 6.8 MB/s | 20 MB 00:02 2024-08-17T02:44:27.724 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.6 MB 00:01 2024-08-17T02:44:28.273 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.6 MB 00:00 2024-08-17T02:44:29.566 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 18 kB 00:00 2024-08-17T02:44:29.866 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 18 kB 00:00 2024-08-17T02:44:30.845 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 20 MB/s | 22 MB 00:01 2024-08-17T02:44:30.928 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-17T02:44:37.192 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-08-17T02:44:37.393 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-08-17T02:44:39.738 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:44:39.738 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:44:39.749 INFO:teuthology.orchestra.run.smithi107.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:44:39.750 INFO:teuthology.orchestra.run.smithi107.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:44:39.751 INFO:teuthology.orchestra.run.smithi107.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:44:39.751 INFO:teuthology.orchestra.run.smithi107.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:44:39.753 INFO:teuthology.orchestra.run.smithi107.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:44:39.756 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:44:39.756 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:44:39.817 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-08-17T02:44:39.833 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-08-17T02:44:39.833 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-08-17T02:44:39.833 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-08-17T02:44:39.833 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-08-17T02:44:39.833 INFO:teuthology.orchestra.run.smithi107.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:44:39.833 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:44:39.833 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:44:39.833 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:44:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:44:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:44:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:44:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:44:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:44:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:44:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:44:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:44:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:44:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:44:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:44:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:44:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:44:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:44:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:44:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:44:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:44:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:44:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:44:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:44:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:44:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:44:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:44:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:44:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:44:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:44:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:44:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:44:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:44:39.836 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-08-17T02:44:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:44:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:44:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:44:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:44:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:44:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:44:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:44:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:44:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:44:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:44:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:44:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:44:39.837 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-08-17T02:44:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:44:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:44:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:44:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:44:39.838 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:44:39.838 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:44:39.838 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:44:39.838 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:44:39.838 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:44:39.838 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:44:39.838 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:44:39.838 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:44:39.839 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:44:39.839 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:44:39.839 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:44:39.839 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:44:39.839 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:44:39.839 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:44:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:44:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:44:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:44:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:44:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:44:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:44:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:44:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:44:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:44:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:44:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:44:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:44:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:44:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:44:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:44:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:44:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:44:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:44:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:44:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:44:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:44:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:44:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:44:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:44:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:44:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:44:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:44:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:44:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:44:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:44:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:44:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:44:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:44:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:44:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:44:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:44:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:44:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:44:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:44:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:44:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:44:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:44:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:44:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:44:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:44:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:44:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:44:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:44:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:44:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:44:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:44:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:44:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:44:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:44:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:44:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:44:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:44:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:44:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:44:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:44:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:44:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:44:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:44:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:44:39.846 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:44:39.846 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:44:39.846 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:44:39.846 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:44:39.846 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:44:39.846 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2024-08-17T02:44:39.846 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:44:39.846 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:44:39.846 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-08-17T02:44:39.846 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-08-17T02:44:39.846 INFO:teuthology.orchestra.run.smithi107.stdout:Install 121 Packages 2024-08-17T02:44:39.847 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 12 Packages 2024-08-17T02:44:39.847 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:44:39.847 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 206 M 2024-08-17T02:44:39.847 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-08-17T02:44:39.998 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:44:39.999 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:44:40.011 INFO:teuthology.orchestra.run.smithi005.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:44:40.011 INFO:teuthology.orchestra.run.smithi005.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:44:40.013 INFO:teuthology.orchestra.run.smithi005.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:44:40.014 INFO:teuthology.orchestra.run.smithi005.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:44:40.015 INFO:teuthology.orchestra.run.smithi005.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:44:40.018 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:44:40.019 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:44:40.085 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-08-17T02:44:40.113 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-08-17T02:44:40.113 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-08-17T02:44:40.113 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-08-17T02:44:40.114 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-08-17T02:44:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:44:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:44:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:44:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:44:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:44:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:44:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:44:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:44:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:44:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:44:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:44:40.114 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:44:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:44:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:44:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:44:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:44:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:44:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:44:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:44:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:44:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:44:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:44:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:44:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:44:40.115 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:44:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:44:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:44:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:44:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:44:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:44:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:44:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:44:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:44:40.116 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-08-17T02:44:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:44:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:44:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:44:40.116 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:44:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:44:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:44:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:44:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:44:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:44:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:44:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:44:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:44:40.117 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-08-17T02:44:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:44:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:44:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:44:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:44:40.117 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:44:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:44:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:44:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:44:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:44:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:44:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:44:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:44:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:44:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:44:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:44:40.118 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:44:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:44:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:44:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:44:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:44:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:44:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:44:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:44:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:44:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:44:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:44:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:44:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:44:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:44:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:44:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:44:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:44:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:44:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:44:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:44:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:44:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:44:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:44:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:44:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:44:40.120 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:44:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:44:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:44:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:44:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:44:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:44:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:44:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:44:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:44:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:44:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:44:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:44:40.121 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:44:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:44:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:44:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:44:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:44:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:44:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:44:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:44:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:44:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:44:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:44:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:44:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:44:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:44:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:44:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:44:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:44:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:44:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:44:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:44:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:44:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:44:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:44:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:44:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:44:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:44:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:44:40.123 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:44:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:44:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:44:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:44:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:44:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:44:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:44:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:44:40.124 INFO:teuthology.orchestra.run.smithi005.stdout:Installing weak dependencies: 2024-08-17T02:44:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:44:40.124 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:44:40.124 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-08-17T02:44:40.124 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-08-17T02:44:40.124 INFO:teuthology.orchestra.run.smithi005.stdout:Install 121 Packages 2024-08-17T02:44:40.124 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 12 Packages 2024-08-17T02:44:40.125 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:44:40.125 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 206 M 2024-08-17T02:44:40.125 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-08-17T02:44:40.318 INFO:teuthology.orchestra.run.smithi107.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 29 kB/s | 6.5 kB 00:00 2024-08-17T02:44:40.527 INFO:teuthology.orchestra.run.smithi107.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 3.8 MB/s | 813 kB 00:00 2024-08-17T02:44:40.610 INFO:teuthology.orchestra.run.smithi107.stdout:(3/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 9.7 MB/s | 5.0 MB 00:00 2024-08-17T02:44:40.635 INFO:teuthology.orchestra.run.smithi107.stdout:(4/133): ceph-immutable-object-cache-17.2.7-137 1.2 MB/s | 137 kB 00:00 2024-08-17T02:44:40.719 INFO:teuthology.orchestra.run.smithi107.stdout:(5/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 19 MB/s | 2.1 MB 00:00 2024-08-17T02:44:40.761 INFO:teuthology.orchestra.run.smithi005.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 28 kB/s | 6.5 kB 00:00 2024-08-17T02:44:40.911 INFO:teuthology.orchestra.run.smithi107.stdout:(6/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 5.1 MB/s | 1.4 MB 00:00 2024-08-17T02:44:40.979 INFO:teuthology.orchestra.run.smithi107.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 15 MB/s | 3.9 MB 00:00 2024-08-17T02:44:41.461 INFO:teuthology.orchestra.run.smithi005.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 1.1 MB/s | 813 kB 00:00 2024-08-17T02:44:41.611 INFO:teuthology.orchestra.run.smithi005.stdout:(3/133): ceph-immutable-object-cache-17.2.7-137 919 kB/s | 137 kB 00:00 2024-08-17T02:44:41.895 INFO:teuthology.orchestra.run.smithi107.stdout:(8/133): ceph-radosgw-17.2.7-1375.g2577e813.el9 15 MB/s | 14 MB 00:00 2024-08-17T02:44:41.970 INFO:teuthology.orchestra.run.smithi107.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 337 kB/s | 25 kB 00:00 2024-08-17T02:44:42.129 INFO:teuthology.orchestra.run.smithi005.stdout:(4/133): ceph-common-17.2.7-1375.g2577e813.el9. 14 MB/s | 22 MB 00:01 2024-08-17T02:44:42.271 INFO:teuthology.orchestra.run.smithi005.stdout:(5/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 10 MB/s | 1.4 MB 00:00 2024-08-17T02:44:42.529 INFO:teuthology.orchestra.run.smithi005.stdout:(6/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 15 MB/s | 3.9 MB 00:00 2024-08-17T02:44:42.904 INFO:teuthology.orchestra.run.smithi107.stdout:(10/133): ceph-common-17.2.7-1375.g2577e813.el9 8.0 MB/s | 22 MB 00:02 2024-08-17T02:44:42.979 INFO:teuthology.orchestra.run.smithi107.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 2.8 MB/s | 215 kB 00:00 2024-08-17T02:44:43.063 INFO:teuthology.orchestra.run.smithi005.stdout:(7/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 1.4 MB/s | 2.1 MB 00:01 2024-08-17T02:44:43.096 INFO:teuthology.orchestra.run.smithi107.stdout:(12/133): libcephfs-devel-17.2.7-1375.g2577e813 214 kB/s | 25 kB 00:00 2024-08-17T02:44:43.213 INFO:teuthology.orchestra.run.smithi107.stdout:(13/133): libcephfs2-17.2.7-1375.g2577e813.el9. 5.3 MB/s | 636 kB 00:00 2024-08-17T02:44:43.279 INFO:teuthology.orchestra.run.smithi005.stdout:(8/133): ceph-osd-17.2.7-1375.g2577e813.el9.x86 20 MB/s | 15 MB 00:00 2024-08-17T02:44:43.280 INFO:teuthology.orchestra.run.smithi107.stdout:(14/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.4 MB/s | 163 kB 00:00 2024-08-17T02:44:43.313 INFO:teuthology.orchestra.run.smithi005.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 762 kB/s | 25 kB 00:00 2024-08-17T02:44:43.480 INFO:teuthology.orchestra.run.smithi107.stdout:(15/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 6.0 MB/s | 15 MB 00:02 2024-08-17T02:44:43.505 INFO:teuthology.orchestra.run.smithi107.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 561 kB/s | 126 kB 00:00 2024-08-17T02:44:43.614 INFO:teuthology.orchestra.run.smithi107.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 3.4 MB/s | 458 kB 00:00 2024-08-17T02:44:43.714 INFO:teuthology.orchestra.run.smithi107.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 452 kB/s | 45 kB 00:00 2024-08-17T02:44:43.806 INFO:teuthology.orchestra.run.smithi107.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 1.3 MB/s | 120 kB 00:00 2024-08-17T02:44:43.890 INFO:teuthology.orchestra.run.smithi107.stdout:(20/133): python3-cephfs-17.2.7-1375.g2577e813. 2.1 MB/s | 182 kB 00:00 2024-08-17T02:44:43.991 INFO:teuthology.orchestra.run.smithi107.stdout:(21/133): python3-rados-17.2.7-1375.g2577e813.e 3.6 MB/s | 369 kB 00:00 2024-08-17T02:44:44.082 INFO:teuthology.orchestra.run.smithi107.stdout:(22/133): python3-rbd-17.2.7-1375.g2577e813.el9 3.7 MB/s | 344 kB 00:00 2024-08-17T02:44:44.174 INFO:teuthology.orchestra.run.smithi107.stdout:(23/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.2 MB/s | 116 kB 00:00 2024-08-17T02:44:44.250 INFO:teuthology.orchestra.run.smithi107.stdout:(24/133): librgw2-17.2.7-1375.g2577e813.el9.x86 6.6 MB/s | 4.9 MB 00:00 2024-08-17T02:44:44.275 INFO:teuthology.orchestra.run.smithi107.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 819 kB/s | 82 kB 00:00 2024-08-17T02:44:44.818 INFO:teuthology.orchestra.run.smithi107.stdout:(26/133): ceph-test-17.2.7-1375.g2577e813.el9.x 17 MB/s | 48 MB 00:02 2024-08-17T02:44:44.850 INFO:teuthology.orchestra.run.smithi107.stdout:(27/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 287 kB/s | 165 kB 00:00 2024-08-17T02:44:44.892 INFO:teuthology.orchestra.run.smithi107.stdout:(28/133): ceph-grafana-dashboards-17.2.7-1375.g 333 kB/s | 24 kB 00:00 2024-08-17T02:44:44.918 INFO:teuthology.orchestra.run.smithi107.stdout:(29/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 1.8 MB/s | 124 kB 00:00 2024-08-17T02:44:44.993 INFO:teuthology.orchestra.run.smithi107.stdout:(30/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 4.0 MB/s | 2.9 MB 00:00 2024-08-17T02:44:45.052 INFO:teuthology.orchestra.run.smithi107.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 4.0 MB/s | 240 kB 00:00 2024-08-17T02:44:45.119 INFO:teuthology.orchestra.run.smithi107.stdout:(32/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 15 MB/s | 3.4 MB 00:00 2024-08-17T02:44:45.160 INFO:teuthology.orchestra.run.smithi107.stdout:(33/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 438 kB/s | 47 kB 00:00 2024-08-17T02:44:45.211 INFO:teuthology.orchestra.run.smithi107.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 158 kB/s | 15 kB 00:00 2024-08-17T02:44:45.236 INFO:teuthology.orchestra.run.smithi107.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 3.5 MB/s | 269 kB 00:00 2024-08-17T02:44:45.262 INFO:teuthology.orchestra.run.smithi107.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.6 MB/s | 83 kB 00:00 2024-08-17T02:44:45.297 INFO:teuthology.orchestra.run.smithi005.stdout:(10/133): ceph-test-17.2.7-1375.g2577e813.el9.x 24 MB/s | 48 MB 00:01 2024-08-17T02:44:45.312 INFO:teuthology.orchestra.run.smithi107.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 242 kB/s | 18 kB 00:00 2024-08-17T02:44:45.380 INFO:teuthology.orchestra.run.smithi005.stdout:(11/133): ceph-base-17.2.7-1375.g2577e813.el9.x 1.0 MB/s | 5.0 MB 00:04 2024-08-17T02:44:45.404 INFO:teuthology.orchestra.run.smithi107.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-08-17T02:44:45.405 INFO:teuthology.orchestra.run.smithi005.stdout:(12/133): cephfs-mirror-17.2.7-1375.g2577e813.e 1.9 MB/s | 215 kB 00:00 2024-08-17T02:44:45.431 INFO:teuthology.orchestra.run.smithi005.stdout:(13/133): libcephfs-devel-17.2.7-1375.g2577e813 500 kB/s | 25 kB 00:00 2024-08-17T02:44:45.438 INFO:teuthology.orchestra.run.smithi107.stdout:(39/133): libgfortran-11.4.1-3.el9.x86_64.rpm 6.3 MB/s | 803 kB 00:00 2024-08-17T02:44:45.480 INFO:teuthology.orchestra.run.smithi107.stdout:(40/133): libquadmath-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-08-17T02:44:45.489 INFO:teuthology.orchestra.run.smithi005.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 7.5 MB/s | 636 kB 00:00 2024-08-17T02:44:45.505 INFO:teuthology.orchestra.run.smithi107.stdout:(41/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-08-17T02:44:45.539 INFO:teuthology.orchestra.run.smithi005.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 1.5 MB/s | 163 kB 00:00 2024-08-17T02:44:45.555 INFO:teuthology.orchestra.run.smithi107.stdout:(42/133): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-08-17T02:44:45.564 INFO:teuthology.orchestra.run.smithi005.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 1.6 MB/s | 126 kB 00:00 2024-08-17T02:44:45.589 INFO:teuthology.orchestra.run.smithi107.stdout:(43/133): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-08-17T02:44:45.614 INFO:teuthology.orchestra.run.smithi107.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-08-17T02:44:45.723 INFO:teuthology.orchestra.run.smithi107.stdout:(45/133): ceph-mgr-diskprediction-local-17.2.7- 9.2 MB/s | 7.4 MB 00:00 2024-08-17T02:44:45.748 INFO:teuthology.orchestra.run.smithi107.stdout:(46/133): python3-requests-2.25.1-8.el9.noarch. 785 kB/s | 125 kB 00:00 2024-08-17T02:44:45.765 INFO:teuthology.orchestra.run.smithi005.stdout:(17/133): librgw2-17.2.7-1375.g2577e813.el9.x86 25 MB/s | 4.9 MB 00:00 2024-08-17T02:44:45.773 INFO:teuthology.orchestra.run.smithi107.stdout:(47/133): python3-urllib3-1.26.5-6.el9.noarch.r 1.3 MB/s | 215 kB 00:00 2024-08-17T02:44:45.790 INFO:teuthology.orchestra.run.smithi005.stdout:(18/133): libradosstriper1-17.2.7-1375.g2577e81 1.8 MB/s | 458 kB 00:00 2024-08-17T02:44:45.816 INFO:teuthology.orchestra.run.smithi005.stdout:(19/133): python3-ceph-argparse-17.2.7-1375.g25 902 kB/s | 45 kB 00:00 2024-08-17T02:44:45.841 INFO:teuthology.orchestra.run.smithi005.stdout:(20/133): python3-ceph-common-17.2.7-1375.g2577 2.3 MB/s | 120 kB 00:00 2024-08-17T02:44:45.849 INFO:teuthology.orchestra.run.smithi107.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 290 kB/s | 22 kB 00:00 2024-08-17T02:44:45.883 INFO:teuthology.orchestra.run.smithi005.stdout:(21/133): python3-cephfs-17.2.7-1375.g2577e813. 2.7 MB/s | 182 kB 00:00 2024-08-17T02:44:45.899 INFO:teuthology.orchestra.run.smithi107.stdout:(49/133): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-08-17T02:44:45.908 INFO:teuthology.orchestra.run.smithi005.stdout:(22/133): python3-rados-17.2.7-1375.g2577e813.e 5.4 MB/s | 369 kB 00:00 2024-08-17T02:44:45.941 INFO:teuthology.orchestra.run.smithi107.stdout:(50/133): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-08-17T02:44:45.959 INFO:teuthology.orchestra.run.smithi005.stdout:(23/133): python3-rgw-17.2.7-1375.g2577e813.el9 2.3 MB/s | 116 kB 00:00 2024-08-17T02:44:45.966 INFO:teuthology.orchestra.run.smithi107.stdout:(51/133): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-08-17T02:44:46.000 INFO:teuthology.orchestra.run.smithi107.stdout:(52/133): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-08-17T02:44:46.009 INFO:teuthology.orchestra.run.smithi005.stdout:(24/133): python3-rbd-17.2.7-1375.g2577e813.el9 2.7 MB/s | 344 kB 00:00 2024-08-17T02:44:46.017 INFO:teuthology.orchestra.run.smithi107.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-08-17T02:44:46.034 INFO:teuthology.orchestra.run.smithi107.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 335 kB/s | 11 kB 00:00 2024-08-17T02:44:46.034 INFO:teuthology.orchestra.run.smithi005.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.1 MB/s | 82 kB 00:00 2024-08-17T02:44:46.059 INFO:teuthology.orchestra.run.smithi107.stdout:(55/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-08-17T02:44:46.084 INFO:teuthology.orchestra.run.smithi107.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-08-17T02:44:46.085 INFO:teuthology.orchestra.run.smithi005.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 3.2 MB/s | 165 kB 00:00 2024-08-17T02:44:46.118 INFO:teuthology.orchestra.run.smithi107.stdout:(57/133): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-08-17T02:44:46.135 INFO:teuthology.orchestra.run.smithi005.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 491 kB/s | 24 kB 00:00 2024-08-17T02:44:46.185 INFO:teuthology.orchestra.run.smithi005.stdout:(28/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 2.4 MB/s | 124 kB 00:00 2024-08-17T02:44:46.185 INFO:teuthology.orchestra.run.smithi107.stdout:(58/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-08-17T02:44:46.202 INFO:teuthology.orchestra.run.smithi107.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 305 kB/s | 25 kB 00:00 2024-08-17T02:44:46.219 INFO:teuthology.orchestra.run.smithi107.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-08-17T02:44:46.253 INFO:teuthology.orchestra.run.smithi107.stdout:(61/133): libtool-2.4.6-46.el9.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2024-08-17T02:44:46.270 INFO:teuthology.orchestra.run.smithi107.stdout:(62/133): openblas-0.3.21-2.el9.x86_64.rpm 699 kB/s | 35 kB 00:00 2024-08-17T02:44:46.303 INFO:teuthology.orchestra.run.smithi107.stdout:(63/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-08-17T02:44:46.343 INFO:teuthology.orchestra.run.smithi005.stdout:(29/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 21 MB/s | 3.4 MB 00:00 2024-08-17T02:44:46.437 INFO:teuthology.orchestra.run.smithi107.stdout:(64/133): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-08-17T02:44:46.537 INFO:teuthology.orchestra.run.smithi107.stdout:(65/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-08-17T02:44:46.562 INFO:teuthology.orchestra.run.smithi107.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 1.9 MB/s | 244 kB 00:00 2024-08-17T02:44:46.588 INFO:teuthology.orchestra.run.smithi107.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-08-17T02:44:46.610 INFO:teuthology.orchestra.run.smithi005.stdout:(30/133): ceph-mgr-diskprediction-local-17.2.7- 28 MB/s | 7.4 MB 00:00 2024-08-17T02:44:46.613 INFO:teuthology.orchestra.run.smithi107.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-08-17T02:44:46.638 INFO:teuthology.orchestra.run.smithi107.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-08-17T02:44:46.661 INFO:teuthology.orchestra.run.smithi005.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 4.7 MB/s | 240 kB 00:00 2024-08-17T02:44:46.663 INFO:teuthology.orchestra.run.smithi107.stdout:(70/133): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-08-17T02:44:46.689 INFO:teuthology.orchestra.run.smithi107.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 688 kB/s | 35 kB 00:00 2024-08-17T02:44:46.711 INFO:teuthology.orchestra.run.smithi005.stdout:(32/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 956 kB/s | 47 kB 00:00 2024-08-17T02:44:46.753 INFO:teuthology.orchestra.run.smithi005.stdout:(33/133): ceph-prometheus-alerts-17.2.7-1375.g2 350 kB/s | 15 kB 00:00 2024-08-17T02:44:46.797 INFO:teuthology.orchestra.run.smithi107.stdout:(72/133): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-08-17T02:44:46.803 INFO:teuthology.orchestra.run.smithi005.stdout:(34/133): ceph-volume-17.2.7-1375.g2577e813.el9 5.3 MB/s | 269 kB 00:00 2024-08-17T02:44:46.823 INFO:teuthology.orchestra.run.smithi107.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-08-17T02:44:46.848 INFO:teuthology.orchestra.run.smithi107.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-08-17T02:44:46.854 INFO:teuthology.orchestra.run.smithi005.stdout:(35/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.6 MB/s | 83 kB 00:00 2024-08-17T02:44:46.873 INFO:teuthology.orchestra.run.smithi107.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-17T02:44:46.896 INFO:teuthology.orchestra.run.smithi005.stdout:(36/133): cephfs-top-17.2.7-1375.g2577e813.el9. 438 kB/s | 18 kB 00:00 2024-08-17T02:44:46.899 INFO:teuthology.orchestra.run.smithi107.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-08-17T02:44:46.924 INFO:teuthology.orchestra.run.smithi107.stdout:(77/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-08-17T02:44:46.949 INFO:teuthology.orchestra.run.smithi107.stdout:(78/133): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-08-17T02:44:46.963 INFO:teuthology.orchestra.run.smithi005.stdout:(37/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 3.1 MB/s | 2.9 MB 00:00 2024-08-17T02:44:46.975 INFO:teuthology.orchestra.run.smithi107.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-17T02:44:47.000 INFO:teuthology.orchestra.run.smithi107.stdout:(80/133): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-17T02:44:47.055 INFO:teuthology.orchestra.run.smithi005.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 504 kB/s | 80 kB 00:00 2024-08-17T02:44:47.100 INFO:teuthology.orchestra.run.smithi107.stdout:(81/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-08-17T02:44:47.113 INFO:teuthology.orchestra.run.smithi005.stdout:(39/133): libgfortran-11.4.1-3.el9.x86_64.rpm 5.2 MB/s | 803 kB 00:00 2024-08-17T02:44:47.126 INFO:teuthology.orchestra.run.smithi107.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 333 kB/s | 42 kB 00:00 2024-08-17T02:44:47.138 INFO:teuthology.orchestra.run.smithi005.stdout:(40/133): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-08-17T02:44:47.151 INFO:teuthology.orchestra.run.smithi107.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-08-17T02:44:47.164 INFO:teuthology.orchestra.run.smithi005.stdout:(41/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-08-17T02:44:47.176 INFO:teuthology.orchestra.run.smithi107.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-08-17T02:44:47.202 INFO:teuthology.orchestra.run.smithi107.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-17T02:44:47.227 INFO:teuthology.orchestra.run.smithi107.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-08-17T02:44:47.239 INFO:teuthology.orchestra.run.smithi005.stdout:(42/133): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-08-17T02:44:47.281 INFO:teuthology.orchestra.run.smithi005.stdout:(43/133): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.2 MB 00:00 2024-08-17T02:44:47.306 INFO:teuthology.orchestra.run.smithi005.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-08-17T02:44:47.319 INFO:teuthology.orchestra.run.smithi107.stdout:(87/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.6 MB/s | 309 kB 00:00 2024-08-17T02:44:47.332 INFO:teuthology.orchestra.run.smithi005.stdout:(45/133): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-08-17T02:44:47.344 INFO:teuthology.orchestra.run.smithi107.stdout:(88/133): liboath-2.6.7-2.el9.x86_64.rpm 414 kB/s | 49 kB 00:00 2024-08-17T02:44:47.361 INFO:teuthology.orchestra.run.smithi107.stdout:(89/133): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-08-17T02:44:47.387 INFO:teuthology.orchestra.run.smithi107.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:44:47.412 INFO:teuthology.orchestra.run.smithi107.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:44:47.437 INFO:teuthology.orchestra.run.smithi107.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 572 kB/s | 14 kB 00:00 2024-08-17T02:44:47.462 INFO:teuthology.orchestra.run.smithi107.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 6.8 MB/s | 172 kB 00:00 2024-08-17T02:44:47.482 INFO:teuthology.orchestra.run.smithi005.stdout:(46/133): ceph-radosgw-17.2.7-1375.g2577e813.el 3.2 MB/s | 14 MB 00:04 2024-08-17T02:44:47.489 INFO:teuthology.orchestra.run.smithi107.stdout:(94/133): python3-asyncssh-2.13.2-5.el9.noarch. 3.7 MB/s | 548 kB 00:00 2024-08-17T02:44:47.508 INFO:teuthology.orchestra.run.smithi005.stdout:(47/133): python3-urllib3-1.26.5-6.el9.noarch.r 1.0 MB/s | 215 kB 00:00 2024-08-17T02:44:47.521 INFO:teuthology.orchestra.run.smithi107.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.4 MB/s | 220 kB 00:00 2024-08-17T02:44:47.541 INFO:teuthology.orchestra.run.smithi005.stdout:(48/133): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-08-17T02:44:47.546 INFO:teuthology.orchestra.run.smithi107.stdout:(96/133): python3-cherrypy-18.6.1-2.el9.noarch. 4.2 MB/s | 358 kB 00:00 2024-08-17T02:44:47.564 INFO:teuthology.orchestra.run.smithi107.stdout:(97/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 256 kB/s | 11 kB 00:00 2024-08-17T02:44:47.568 INFO:teuthology.orchestra.run.smithi005.stdout:(49/133): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-08-17T02:44:47.580 INFO:teuthology.orchestra.run.smithi107.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 527 kB/s | 18 kB 00:00 2024-08-17T02:44:47.592 INFO:teuthology.orchestra.run.smithi005.stdout:(50/133): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-08-17T02:44:47.597 INFO:teuthology.orchestra.run.smithi107.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 686 kB/s | 23 kB 00:00 2024-08-17T02:44:47.617 INFO:teuthology.orchestra.run.smithi005.stdout:(51/133): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-08-17T02:44:47.623 INFO:teuthology.orchestra.run.smithi107.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 461 kB/s | 19 kB 00:00 2024-08-17T02:44:47.650 INFO:teuthology.orchestra.run.smithi107.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-08-17T02:44:47.667 INFO:teuthology.orchestra.run.smithi005.stdout:(52/133): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-08-17T02:44:47.674 INFO:teuthology.orchestra.run.smithi107.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 180 kB/s | 9.0 kB 00:00 2024-08-17T02:44:47.699 INFO:teuthology.orchestra.run.smithi107.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 819 kB/s | 41 kB 00:00 2024-08-17T02:44:47.701 INFO:teuthology.orchestra.run.smithi005.stdout:(53/133): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-08-17T02:44:47.724 INFO:teuthology.orchestra.run.smithi107.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:44:47.770 INFO:teuthology.orchestra.run.smithi107.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:44:47.770 INFO:teuthology.orchestra.run.smithi005.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-08-17T02:44:47.770 INFO:teuthology.orchestra.run.smithi005.stdout:(55/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-17T02:44:47.774 INFO:teuthology.orchestra.run.smithi107.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:44:47.776 INFO:teuthology.orchestra.run.smithi005.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-08-17T02:44:47.809 INFO:teuthology.orchestra.run.smithi107.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-17T02:44:47.811 INFO:teuthology.orchestra.run.smithi005.stdout:(57/133): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-08-17T02:44:47.842 INFO:teuthology.orchestra.run.smithi107.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 497 kB/s | 16 kB 00:00 2024-08-17T02:44:47.859 INFO:teuthology.orchestra.run.smithi107.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 5.2 MB/s | 90 kB 00:00 2024-08-17T02:44:47.877 INFO:teuthology.orchestra.run.smithi005.stdout:(58/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-08-17T02:44:47.884 INFO:teuthology.orchestra.run.smithi107.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-08-17T02:44:47.903 INFO:teuthology.orchestra.run.smithi005.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 277 kB/s | 25 kB 00:00 2024-08-17T02:44:47.918 INFO:teuthology.orchestra.run.smithi107.stdout:(111/133): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-08-17T02:44:47.928 INFO:teuthology.orchestra.run.smithi005.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-08-17T02:44:47.943 INFO:teuthology.orchestra.run.smithi107.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-17T02:44:47.962 INFO:teuthology.orchestra.run.smithi005.stdout:(61/133): libtool-2.4.6-46.el9.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2024-08-17T02:44:47.968 INFO:teuthology.orchestra.run.smithi107.stdout:(113/133): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-17T02:44:47.988 INFO:teuthology.orchestra.run.smithi005.stdout:(62/133): openblas-0.3.21-2.el9.x86_64.rpm 605 kB/s | 35 kB 00:00 2024-08-17T02:44:47.994 INFO:teuthology.orchestra.run.smithi107.stdout:(114/133): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-08-17T02:44:48.012 INFO:teuthology.orchestra.run.smithi005.stdout:(63/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-08-17T02:44:48.019 INFO:teuthology.orchestra.run.smithi107.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-17T02:44:48.045 INFO:teuthology.orchestra.run.smithi107.stdout:(116/133): python3-webob-1.8.7-6.el9.noarch.rpm 4.4 MB/s | 230 kB 00:00 2024-08-17T02:44:48.078 INFO:teuthology.orchestra.run.smithi107.stdout:(117/133): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-08-17T02:44:48.104 INFO:teuthology.orchestra.run.smithi107.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-08-17T02:44:48.146 INFO:teuthology.orchestra.run.smithi005.stdout:(64/133): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-08-17T02:44:48.157 INFO:teuthology.orchestra.run.smithi107.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 3.7 MB/s | 427 kB 00:00 2024-08-17T02:44:48.221 INFO:teuthology.orchestra.run.smithi005.stdout:(65/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-08-17T02:44:48.229 INFO:teuthology.orchestra.run.smithi107.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-08-17T02:44:48.246 INFO:teuthology.orchestra.run.smithi005.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-08-17T02:44:48.272 INFO:teuthology.orchestra.run.smithi005.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-08-17T02:44:48.289 INFO:teuthology.orchestra.run.smithi005.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 613 kB/s | 26 kB 00:00 2024-08-17T02:44:48.305 INFO:teuthology.orchestra.run.smithi005.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 574 kB/s | 19 kB 00:00 2024-08-17T02:44:48.331 INFO:teuthology.orchestra.run.smithi005.stdout:(70/133): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-08-17T02:44:48.356 INFO:teuthology.orchestra.run.smithi005.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 689 kB/s | 35 kB 00:00 2024-08-17T02:44:48.438 INFO:teuthology.orchestra.run.smithi107.stdout:(121/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-17T02:44:48.457 INFO:teuthology.orchestra.run.smithi005.stdout:(72/133): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-08-17T02:44:48.482 INFO:teuthology.orchestra.run.smithi005.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-08-17T02:44:48.507 INFO:teuthology.orchestra.run.smithi005.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-08-17T02:44:48.530 INFO:teuthology.orchestra.run.smithi107.stdout:(122/133): NetworkManager-1.48.2-2.el9.x86_64.r 25 MB/s | 2.3 MB 00:00 2024-08-17T02:44:48.532 INFO:teuthology.orchestra.run.smithi005.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-17T02:44:48.558 INFO:teuthology.orchestra.run.smithi005.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-08-17T02:44:48.583 INFO:teuthology.orchestra.run.smithi005.stdout:(77/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-08-17T02:44:48.608 INFO:teuthology.orchestra.run.smithi005.stdout:(78/133): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-08-17T02:44:48.613 INFO:teuthology.orchestra.run.smithi107.stdout:(123/133): librbd1-17.2.7-1375.g2577e813.el9.x8 7.7 MB/s | 2.9 MB 00:00 2024-08-17T02:44:48.634 INFO:teuthology.orchestra.run.smithi005.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-17T02:44:48.659 INFO:teuthology.orchestra.run.smithi005.stdout:(80/133): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-17T02:44:48.680 INFO:teuthology.orchestra.run.smithi107.stdout:(124/133): librados2-17.2.7-1375.g2577e813.el9. 5.9 MB/s | 3.1 MB 00:00 2024-08-17T02:44:48.706 INFO:teuthology.orchestra.run.smithi107.stdout:(125/133): NetworkManager-team-1.48.2-2.el9.x86 444 kB/s | 41 kB 00:00 2024-08-17T02:44:48.743 INFO:teuthology.orchestra.run.smithi005.stdout:(81/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-08-17T02:44:48.748 INFO:teuthology.orchestra.run.smithi107.stdout:(126/133): NetworkManager-libnm-1.48.2-2.el9.x8 8.3 MB/s | 1.8 MB 00:00 2024-08-17T02:44:48.768 INFO:teuthology.orchestra.run.smithi005.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-08-17T02:44:48.773 INFO:teuthology.orchestra.run.smithi107.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 546 kB/s | 37 kB 00:00 2024-08-17T02:44:48.793 INFO:teuthology.orchestra.run.smithi005.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-08-17T02:44:48.806 INFO:teuthology.orchestra.run.smithi107.stdout:(128/133): elfutils-libelf-0.191-4.el9.x86_64.r 3.5 MB/s | 207 kB 00:00 2024-08-17T02:44:48.818 INFO:teuthology.orchestra.run.smithi005.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-08-17T02:44:48.832 INFO:teuthology.orchestra.run.smithi107.stdout:(129/133): NetworkManager-tui-1.48.2-2.el9.x86_ 1.6 MB/s | 247 kB 00:00 2024-08-17T02:44:48.844 INFO:teuthology.orchestra.run.smithi005.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-17T02:44:48.857 INFO:teuthology.orchestra.run.smithi107.stdout:(130/133): elfutils-libs-0.191-4.el9.x86_64.rpm 3.0 MB/s | 260 kB 00:00 2024-08-17T02:44:48.893 INFO:teuthology.orchestra.run.smithi005.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 606 kB/s | 45 kB 00:00 2024-08-17T02:44:48.899 INFO:teuthology.orchestra.run.smithi107.stdout:(131/133): openssl-3.2.2-2.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-08-17T02:44:48.941 INFO:teuthology.orchestra.run.smithi107.stdout:(132/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-08-17T02:44:48.986 INFO:teuthology.orchestra.run.smithi005.stdout:(87/133): liboath-2.6.7-2.el9.x86_64.rpm 524 kB/s | 49 kB 00:00 2024-08-17T02:44:48.999 INFO:teuthology.orchestra.run.smithi107.stdout:(133/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-08-17T02:44:49.004 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:44:49.004 INFO:teuthology.orchestra.run.smithi107.stdout:Total 23 MB/s | 206 MB 00:09 2024-08-17T02:44:49.011 INFO:teuthology.orchestra.run.smithi005.stdout:(88/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.8 MB/s | 309 kB 00:00 2024-08-17T02:44:49.037 INFO:teuthology.orchestra.run.smithi005.stdout:(89/133): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-08-17T02:44:49.062 INFO:teuthology.orchestra.run.smithi005.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:44:49.087 INFO:teuthology.orchestra.run.smithi005.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:44:49.112 INFO:teuthology.orchestra.run.smithi005.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 562 kB/s | 14 kB 00:00 2024-08-17T02:44:49.146 INFO:teuthology.orchestra.run.smithi005.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 5.0 MB/s | 172 kB 00:00 2024-08-17T02:44:49.181 INFO:teuthology.orchestra.run.smithi005.stdout:(94/133): python3-asyncssh-2.13.2-5.el9.noarch. 3.2 MB/s | 548 kB 00:00 2024-08-17T02:44:49.213 INFO:teuthology.orchestra.run.smithi005.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.5 MB/s | 220 kB 00:00 2024-08-17T02:44:49.239 INFO:teuthology.orchestra.run.smithi005.stdout:(96/133): python3-cherrypy-18.6.1-2.el9.noarch. 3.8 MB/s | 358 kB 00:00 2024-08-17T02:44:49.264 INFO:teuthology.orchestra.run.smithi005.stdout:(97/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 213 kB/s | 11 kB 00:00 2024-08-17T02:44:49.289 INFO:teuthology.orchestra.run.smithi005.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 353 kB/s | 18 kB 00:00 2024-08-17T02:44:49.315 INFO:teuthology.orchestra.run.smithi005.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 459 kB/s | 23 kB 00:00 2024-08-17T02:44:49.340 INFO:teuthology.orchestra.run.smithi005.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-08-17T02:44:49.365 INFO:teuthology.orchestra.run.smithi005.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-08-17T02:44:49.390 INFO:teuthology.orchestra.run.smithi005.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 180 kB/s | 9.0 kB 00:00 2024-08-17T02:44:49.416 INFO:teuthology.orchestra.run.smithi005.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 816 kB/s | 41 kB 00:00 2024-08-17T02:44:49.441 INFO:teuthology.orchestra.run.smithi005.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:44:49.466 INFO:teuthology.orchestra.run.smithi005.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:44:49.492 INFO:teuthology.orchestra.run.smithi005.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-08-17T02:44:49.534 INFO:teuthology.orchestra.run.smithi005.stdout:(107/133): python3-kubernetes-26.1.0-2.el9.noar 7.1 MB/s | 1.0 MB 00:00 2024-08-17T02:44:49.551 INFO:teuthology.orchestra.run.smithi005.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 982 kB/s | 16 kB 00:00 2024-08-17T02:44:49.576 INFO:teuthology.orchestra.run.smithi005.stdout:(109/133): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-08-17T02:44:49.593 INFO:teuthology.orchestra.run.smithi005.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 1.8 MB/s | 31 kB 00:00 2024-08-17T02:44:49.618 INFO:teuthology.orchestra.run.smithi005.stdout:(111/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-08-17T02:44:49.644 INFO:teuthology.orchestra.run.smithi005.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-17T02:44:49.669 INFO:teuthology.orchestra.run.smithi005.stdout:(113/133): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-08-17T02:44:49.694 INFO:teuthology.orchestra.run.smithi005.stdout:(114/133): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-08-17T02:44:49.728 INFO:teuthology.orchestra.run.smithi005.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-08-17T02:44:49.778 INFO:teuthology.orchestra.run.smithi005.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-08-17T02:44:49.804 INFO:teuthology.orchestra.run.smithi005.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-08-17T02:44:49.829 INFO:teuthology.orchestra.run.smithi005.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 809 kB/s | 20 kB 00:00 2024-08-17T02:44:49.862 INFO:teuthology.orchestra.run.smithi005.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-08-17T02:44:49.921 INFO:teuthology.orchestra.run.smithi005.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-08-17T02:44:50.105 INFO:teuthology.orchestra.run.smithi005.stdout:(121/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-17T02:44:50.188 INFO:teuthology.orchestra.run.smithi005.stdout:(122/133): NetworkManager-1.48.2-2.el9.x86_64.r 28 MB/s | 2.3 MB 00:00 2024-08-17T02:44:50.255 INFO:teuthology.orchestra.run.smithi005.stdout:(123/133): NetworkManager-libnm-1.48.2-2.el9.x8 27 MB/s | 1.8 MB 00:00 2024-08-17T02:44:50.297 INFO:teuthology.orchestra.run.smithi005.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 985 kB/s | 41 kB 00:00 2024-08-17T02:44:50.339 INFO:teuthology.orchestra.run.smithi005.stdout:(125/133): NetworkManager-tui-1.48.2-2.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-08-17T02:44:50.381 INFO:teuthology.orchestra.run.smithi005.stdout:(126/133): elfutils-debuginfod-client-0.191-4.e 882 kB/s | 37 kB 00:00 2024-08-17T02:44:50.423 INFO:teuthology.orchestra.run.smithi005.stdout:(127/133): elfutils-libelf-0.191-4.el9.x86_64.r 4.9 MB/s | 207 kB 00:00 2024-08-17T02:44:50.465 INFO:teuthology.orchestra.run.smithi005.stdout:(128/133): elfutils-libs-0.191-4.el9.x86_64.rpm 6.1 MB/s | 260 kB 00:00 2024-08-17T02:44:50.532 INFO:teuthology.orchestra.run.smithi005.stdout:(129/133): openssl-3.2.2-2.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-08-17T02:44:50.632 INFO:teuthology.orchestra.run.smithi005.stdout:(130/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-08-17T02:44:50.679 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-08-17T02:44:50.682 INFO:teuthology.orchestra.run.smithi005.stdout:(131/133): librados2-17.2.7-1375.g2577e813.el9. 3.8 MB/s | 3.1 MB 00:00 2024-08-17T02:44:50.725 INFO:teuthology.orchestra.run.smithi005.stdout:(132/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-08-17T02:44:50.886 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-08-17T02:44:50.886 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-08-17T02:44:50.950 INFO:teuthology.orchestra.run.smithi005.stdout:(133/133): librbd1-17.2.7-1375.g2577e813.el9.x8 2.9 MB/s | 2.9 MB 00:01 2024-08-17T02:44:50.954 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:44:50.954 INFO:teuthology.orchestra.run.smithi005.stdout:Total 19 MB/s | 206 MB 00:10 2024-08-17T02:44:52.660 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-08-17T02:44:52.890 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-08-17T02:44:52.890 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-08-17T02:44:52.967 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-08-17T02:44:52.967 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-08-17T02:44:55.077 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-08-17T02:44:55.078 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-08-17T02:44:58.569 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-08-17T02:44:58.654 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:44:58.730 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:44:58.804 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:44:58.848 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:44:58.880 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:44:58.932 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:44:59.274 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:44:59.380 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:44:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:44:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:44:59.724 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:45:00.191 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:45:00.216 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:45:00.344 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:45:00.417 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:45:00.452 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:45:00.599 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:45:00.628 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:45:00.816 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:45:01.087 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:45:01.120 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-08-17T02:45:01.264 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:45:01.275 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:45:01.315 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:45:01.345 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:45:01.389 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:45:01.433 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:45:01.457 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:45:01.464 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:45:01.527 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:45:01.604 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:45:01.893 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:45:01.944 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:45:01.985 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:45:02.006 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:45:02.029 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:45:02.112 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:45:02.144 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:45:02.153 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:45:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:45:02.187 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:45:02.276 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:45:02.286 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:45:02.363 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:45:02.401 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:45:02.449 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:45:02.536 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:45:02.572 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:45:02.618 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:45:02.710 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:45:02.781 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:45:02.809 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:45:02.872 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:45:02.902 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:45:02.930 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:45:02.968 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:45:02.994 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:45:03.109 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:45:03.137 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:45:03.305 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:45:03.570 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:45:03.578 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:45:03.670 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:45:03.712 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:45:03.758 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:45:03.767 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:45:03.802 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:45:03.837 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:45:03.841 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:45:03.893 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:45:03.932 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:45:03.953 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:45:03.983 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:45:04.054 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:45:04.068 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:45:04.108 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:45:04.144 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:45:04.202 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:45:04.255 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:45:04.396 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:45:04.443 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:45:04.489 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:45:04.548 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:45:04.573 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:45:04.624 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:45:04.657 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:45:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:45:04.748 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:45:04.771 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:45:04.810 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:45:04.839 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:45:04.844 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:45:04.891 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:45:04.956 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:45:04.997 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:45:05.005 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:45:05.040 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:45:05.040 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:45:05.070 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:45:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:45:05.107 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:45:05.145 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:45:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:45:05.182 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:45:05.217 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:45:05.250 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:45:05.293 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:45:05.326 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:45:05.352 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:45:05.361 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:45:05.412 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:45:05.416 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:45:05.535 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:45:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:45:06.100 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:45:06.202 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:45:06.251 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:45:06.302 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:45:06.346 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:45:06.385 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:45:06.438 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:45:06.472 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:45:06.476 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:45:06.526 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:45:06.539 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:45:06.560 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:45:06.623 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:45:06.677 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:45:06.689 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:45:06.718 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:45:06.730 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:45:06.799 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:45:06.950 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:45:06.993 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:45:07.050 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:45:07.228 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:45:07.274 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:45:07.299 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:45:07.318 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:45:07.399 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:45:07.458 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:45:07.509 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:45:07.564 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:45:07.624 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:45:07.660 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:45:07.699 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:45:07.736 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:45:07.771 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:45:07.803 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:45:07.848 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:45:07.879 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:45:07.915 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:45:07.966 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:45:08.101 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:45:08.163 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:45:08.220 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:45:08.353 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:45:09.099 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:45:09.156 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:45:09.189 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:45:09.334 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:45:09.381 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:45:09.619 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:45:09.653 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:45:09.752 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:45:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:45:10.010 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:45:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:45:10.080 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:45:10.391 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:45:10.433 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:45:10.548 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:45:10.576 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:45:10.592 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:45:10.754 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:45:12.405 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:45:12.508 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:45:12.565 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:45:12.602 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:45:12.936 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:45:12.980 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:45:13.098 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:45:13.124 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:45:13.157 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:45:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:45:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:45:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:45:13.986 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:45:13.986 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:45:13.986 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:45:13.986 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:14.020 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:45:15.891 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:45:15.958 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:45:16.575 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:45:16.624 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:45:16.762 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:45:16.762 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:45:16.763 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:45:16.763 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:45:26.000 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:45:26.001 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2024-08-17T02:45:26.001 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2024-08-17T02:45:26.001 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2024-08-17T02:45:26.001 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2024-08-17T02:45:26.001 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2024-08-17T02:45:26.001 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2024-08-17T02:45:26.001 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2024-08-17T02:45:26.001 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:45:26.235 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:45:26.235 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:26.235 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:45:26.235 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:27.660 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:45:27.716 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:45:27.717 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:27.717 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:45:27.717 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:45:27.717 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:45:27.718 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:27.935 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:45:27.984 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:45:27.984 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:27.984 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:45:27.985 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:45:27.985 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:45:27.985 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:28.394 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:45:28.444 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:45:28.444 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:28.444 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:45:28.444 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:45:28.444 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:45:28.444 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:28.578 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:45:28.637 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:45:28.712 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:45:28.934 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:45:29.007 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:45:29.063 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:45:29.064 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2024-08-17T02:45:29.064 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2024-08-17T02:45:29.064 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2024-08-17T02:45:29.064 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2024-08-17T02:45:29.064 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2024-08-17T02:45:29.064 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /root 2024-08-17T02:45:29.064 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2024-08-17T02:45:29.065 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:29.092 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:45:29.200 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:45:29.298 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:45:29.333 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:45:29.333 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:29.334 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:45:29.334 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:29.357 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:45:29.403 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:45:29.438 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:45:29.473 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:45:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:45:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:45:30.059 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:45:30.089 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:45:30.119 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:45:30.179 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:45:30.212 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:45:30.843 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:45:30.902 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:45:30.902 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:30.902 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:45:30.902 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:45:30.902 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:45:30.902 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:31.143 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:45:31.194 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:45:31.194 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:31.194 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:45:31.194 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:45:31.194 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:45:31.194 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:31.343 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:45:31.388 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:45:31.619 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:45:31.670 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:45:31.670 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:31.670 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:45:31.670 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:45:31.670 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:45:31.670 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:31.811 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:45:31.872 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:45:31.972 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:45:32.208 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:45:32.265 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:45:32.356 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:45:32.465 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:45:32.466 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:45:32.497 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:45:32.632 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:45:32.641 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:45:32.695 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:45:32.737 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:45:32.774 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:45:32.791 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:45:32.822 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:45:32.824 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:45:32.856 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:45:32.874 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:45:32.875 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:32.875 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:45:32.875 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:45:32.875 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:45:32.875 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:32.925 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:45:32.951 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:45:33.059 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:45:33.118 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:45:33.377 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:45:33.422 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:45:33.452 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:45:33.515 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:45:33.578 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:45:34.437 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:45:34.486 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:45:34.583 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:45:34.583 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:34.583 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:45:34.583 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:45:34.583 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:45:34.584 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:45:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:45:34.686 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:34.686 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:45:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:34.754 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:45:34.801 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:45:34.805 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:45:34.805 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:34.805 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:45:34.805 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:45:34.805 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:45:34.805 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:34.847 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:45:35.122 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:45:35.172 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:45:35.173 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:35.173 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:45:35.173 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:45:35.173 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:45:35.173 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:35.994 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:45:36.022 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:45:36.163 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:45:36.333 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:45:36.366 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:45:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:45:36.416 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:36.416 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:45:36.416 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:45:36.417 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:45:36.417 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:36.474 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:45:36.501 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:45:36.604 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:45:36.669 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:45:38.074 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:45:38.103 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:45:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:45:38.216 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:38.216 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:45:38.216 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:45:38.216 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:45:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:38.270 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:45:38.320 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:45:38.320 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:38.320 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:45:38.320 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:38.379 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:45:38.430 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:45:38.430 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:38.430 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:45:38.430 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:45:38.431 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:45:38.431 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:38.763 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:45:38.815 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:45:38.815 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:45:38.815 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:45:38.815 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:45:38.815 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:45:38.815 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:45:39.884 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:45:39.928 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:45:39.957 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:45:39.991 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:45:40.026 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:45:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:45:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:45:40.210 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:45:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:45:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:45:42.033 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:45:42.080 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:45:42.210 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:45:42.245 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:45:42.270 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:45:42.295 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:45:42.324 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:45:42.324 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:45:42.407 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:45:42.447 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:45:42.448 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:45:42.541 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:45:42.565 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:45:42.587 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:45:42.587 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:45:42.826 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:45:42.826 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:45:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:45:42.968 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:45:43.001 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:45:43.084 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:45:43.286 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:45:43.286 INFO:teuthology.orchestra.run.smithi107.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:45:43.287 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:43.801 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:45:43.843 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:45:43.887 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:45:43.924 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:45:43.958 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:45:43.992 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:45:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:45:44.064 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:45:44.103 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:45:45.470 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:45:45.731 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:45:45.799 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:45:45.848 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:45:45.958 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:45:45.994 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:45:46.028 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:45:46.053 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:45:46.082 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:45:46.082 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:45:46.198 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:45:46.231 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:45:46.231 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:45:46.324 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:45:46.349 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:45:46.371 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:45:46.371 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:45:46.626 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:45:46.626 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:45:46.736 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:45:46.768 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:45:46.804 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:45:46.879 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:45:47.077 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:45:47.077 INFO:teuthology.orchestra.run.smithi005.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:45:47.077 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:48.500 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:45:48.500 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:45:48.500 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:45:48.500 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:45:48.500 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:45:48.501 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:45:48.501 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:45:48.501 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:45:48.501 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:45:48.501 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:45:48.501 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:45:48.501 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:45:48.501 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:45:48.501 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:45:48.501 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:45:48.501 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:45:48.501 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:45:48.501 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:45:48.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:45:48.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:45:48.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:45:48.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:45:48.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:45:48.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:45:48.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:45:48.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:45:48.502 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:45:48.513 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:45:48.513 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:45:48.513 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:45:48.513 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:45:48.513 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:45:48.513 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:45:48.513 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:45:48.513 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:45:48.514 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:45:48.514 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:45:48.514 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:45:48.514 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:45:48.514 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:45:48.514 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:45:48.514 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:45:48.514 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:45:48.514 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:45:48.514 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:45:48.514 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:45:48.514 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:45:48.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:45:48.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:45:48.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:45:48.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:45:48.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:45:48.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:45:48.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:45:48.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:45:48.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:45:48.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:45:48.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:45:48.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:45:48.515 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:45:48.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:45:48.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:45:48.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:45:48.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:45:48.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:45:48.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:45:48.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:45:48.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:45:48.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:45:48.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:45:48.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:45:48.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:45:48.516 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:45:48.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:45:48.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:45:48.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:45:48.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:45:48.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:45:48.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:45:48.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:45:48.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:45:48.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:45:48.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:45:48.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:45:48.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:45:48.517 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:45:48.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:45:48.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:45:48.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:45:48.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:45:48.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:45:48.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:45:48.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:45:48.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:45:48.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:45:48.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:45:48.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:45:48.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:45:48.518 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:45:48.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:45:48.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:45:48.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:45:48.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:45:48.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:45:48.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:45:48.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:45:48.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:45:48.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:45:48.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:45:48.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:45:48.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:45:48.519 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:45:48.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:45:48.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:45:48.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:45:48.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:45:48.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:45:48.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:45:48.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:45:48.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:45:48.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:45:48.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:45:48.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:45:48.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:45:48.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:45:48.520 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:45:48.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:45:48.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:45:48.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:45:48.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:45:48.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:45:48.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:45:48.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:45:48.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:45:48.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:45:48.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:45:48.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:45:48.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:45:48.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:45:48.521 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:45:48.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:45:48.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:45:48.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:45:48.522 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:45:50.443 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:45:50.443 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:50.443 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-08-17T02:45:50.443 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:50.443 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:50.443 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:50.444 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:50.444 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:45:50.444 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:45:50.444 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:45:50.444 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.444 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.444 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:45:50.444 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:45:50.444 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:45:50.444 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-08-17T02:45:50.444 INFO:teuthology.orchestra.run.smithi107.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:45:50.444 INFO:teuthology.orchestra.run.smithi107.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:45:50.445 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.445 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.445 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.445 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.445 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:50.445 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.445 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.445 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.445 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:50.445 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:50.445 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:50.445 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:50.445 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:50.445 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.446 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.446 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:50.446 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.446 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.446 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.446 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:50.446 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:50.446 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.446 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:50.446 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:45:50.446 INFO:teuthology.orchestra.run.smithi107.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:45:50.446 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:45:50.447 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:45:50.447 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:45:50.447 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:45:50.447 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:45:50.447 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:45:50.447 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.447 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.447 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.447 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:45:50.447 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:45:50.447 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:45:50.447 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:45:50.447 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:45:50.447 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.448 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.448 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:45:50.448 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.448 INFO:teuthology.orchestra.run.smithi107.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:45:50.448 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:45:50.448 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:45:50.448 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:45:50.448 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:45:50.448 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:45:50.448 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:45:50.448 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:45:50.448 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:45:50.448 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:45:50.449 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:45:50.449 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:45:50.449 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.449 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.449 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.449 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:45:50.449 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:45:50.449 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:45:50.449 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:45:50.449 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:45:50.449 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:45:50.449 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:45:50.450 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:45:50.450 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:45:50.450 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:45:50.450 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:45:50.450 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:45:50.450 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:45:50.450 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:45:50.450 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:45:50.450 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:45:50.450 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:45:50.450 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:45:50.450 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:45:50.451 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:45:50.451 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:45:50.451 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:45:50.451 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:45:50.451 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:45:50.451 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:45:50.451 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:45:50.451 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:45:50.451 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:45:50.451 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:45:50.451 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:45:50.451 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:45:50.451 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:45:50.452 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:45:50.452 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:45:50.452 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:45:50.452 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:45:50.452 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.452 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.452 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:45:50.452 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:45:50.452 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:45:50.452 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.452 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:45:50.452 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:45:50.452 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:45:50.452 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:45:50.453 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:45:50.453 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:45:50.453 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:45:50.453 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:45:50.453 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:45:50.453 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:45:50.453 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:45:50.453 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.453 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.453 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:50.453 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:45:50.453 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:45:50.453 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:45:50.453 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:45:50.454 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:45:50.454 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:50.454 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-08-17T02:45:51.052 DEBUG:teuthology.parallel:result is None 2024-08-17T02:45:52.317 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:45:52.317 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:45:52.317 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:45:52.317 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:45:52.317 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:45:52.317 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:45:52.318 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:45:52.318 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:45:52.318 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:45:52.318 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:45:52.318 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:45:52.318 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:45:52.318 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:45:52.318 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:45:52.318 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:45:52.318 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:45:52.318 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:45:52.318 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:45:52.319 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:45:52.319 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:45:52.319 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:45:52.319 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:45:52.319 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:45:52.319 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:45:52.319 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:45:52.319 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:45:52.319 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:45:52.319 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:45:52.319 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:45:52.319 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:45:52.320 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:45:52.320 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:45:52.320 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:45:52.320 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:45:52.320 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:45:52.320 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:45:52.320 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:45:52.320 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:45:52.320 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:45:52.320 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:45:52.320 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:45:52.320 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:45:52.321 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:45:52.321 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:45:52.321 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:45:52.321 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:45:52.321 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:45:52.321 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:45:52.321 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:45:52.321 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:45:52.321 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:45:52.321 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:45:52.321 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:45:52.321 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:45:52.321 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:45:52.321 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:45:52.321 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:45:52.322 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:45:52.322 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:45:52.322 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:45:52.322 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:45:52.322 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:45:52.322 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:45:52.322 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:45:52.322 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:45:52.322 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:45:52.322 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:45:52.322 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:45:52.322 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:45:52.322 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:45:52.323 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:45:52.323 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:45:52.323 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:45:52.323 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:45:52.323 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:45:52.323 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:45:52.323 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:45:52.323 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:45:52.323 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:45:52.323 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:45:52.323 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:45:52.323 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:45:52.323 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:45:52.323 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:45:52.324 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:45:52.324 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:45:52.324 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:45:52.324 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:45:52.324 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:45:52.324 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:45:52.324 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:45:52.324 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:45:52.324 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:45:52.324 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:45:52.324 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:45:52.325 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:45:52.325 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:45:52.325 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:45:52.325 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:45:52.325 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:45:52.325 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:45:52.325 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:45:52.325 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:45:52.325 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:45:52.325 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:45:52.325 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:45:52.325 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:45:52.325 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:45:52.325 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:45:52.325 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:45:52.326 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:45:52.326 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:45:52.326 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:45:52.326 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:45:52.326 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:45:52.326 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:45:52.326 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:45:52.326 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:45:52.326 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:45:52.326 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:45:52.326 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:45:52.326 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:45:52.326 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:45:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:45:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:45:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:45:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:45:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:45:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:45:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:45:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:45:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:45:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:45:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:45:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:45:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:45:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:45:52.328 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:45:52.328 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:45:52.328 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:45:52.328 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:45:52.328 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:45:52.328 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:45:52.328 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:45:54.281 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:45:54.281 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:54.282 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-08-17T02:45:54.282 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:54.282 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:54.282 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:54.282 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:54.282 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:45:54.282 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:45:54.282 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:45:54.282 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.282 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:45:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:45:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:45:54.283 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-08-17T02:45:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:45:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:45:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.283 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:54.284 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:45:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:45:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:45:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:45:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:45:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:45:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:45:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:45:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.285 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:45:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:45:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:45:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:45:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:45:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:45:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:45:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:45:54.286 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:45:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:45:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:45:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:45:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:45:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:45:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:45:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:45:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:45:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:45:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.287 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.288 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:45:54.288 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:45:54.288 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:45:54.288 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:45:54.288 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:45:54.288 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:45:54.288 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:45:54.288 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:45:54.288 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:45:54.288 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:45:54.288 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:45:54.288 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:45:54.288 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:45:54.288 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:45:54.289 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:45:54.289 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:45:54.289 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:45:54.289 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:45:54.289 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:45:54.289 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:45:54.289 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:45:54.289 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:45:54.289 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:45:54.289 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:45:54.289 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:45:54.289 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:45:54.289 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:45:54.290 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:45:54.290 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:45:54.290 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:45:54.290 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:45:54.290 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:45:54.290 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:45:54.290 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:45:54.290 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:45:54.290 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:45:54.290 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.290 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.290 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:45:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:45:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:45:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:45:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:45:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:45:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:45:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:45:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:45:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:45:54.292 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:45:54.292 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:45:54.292 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:45:54.292 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:45:54.292 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.292 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.292 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:54.293 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:45:54.293 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:45:54.293 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:45:54.293 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:45:54.294 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:45:54.294 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:54.294 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-08-17T02:45:54.933 DEBUG:teuthology.parallel:result is None 2024-08-17T02:45:54.934 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:45:55.079 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:45:55.126 INFO:teuthology.orchestra.run.smithi005.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:45:55.127 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:45:55.127 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:45:55.129 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:45:55.273 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:45:55.323 INFO:teuthology.orchestra.run.smithi107.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:45:55.323 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:45:55.324 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:45:55.325 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:45:55.326 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:45:55.326 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:45:55.384 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:45:55.384 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:45:55.446 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:45:55.446 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:45:55.446 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:45:55.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:45:55.602 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:45:55.603 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:45:55.660 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:45:55.757 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:45:55.757 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:45:55.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:45:55.814 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:45:55.913 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:45:55.913 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:45:55.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:45:56.064 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:45:56.065 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:45:56.065 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:45:56.123 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:45:56.226 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:45:56.227 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:45:56.282 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:45:56.378 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:45:56.461 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:45:56.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2024-08-17T02:45:56.466 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2024-08-17T02:45:56.520 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:45:56.521 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:45:56.525 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:45:56.580 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:45:56.581 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:45:56.584 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:45:56.648 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:45:56.648 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:45:56.648 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:45:56.648 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:45:56.648 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:45:56.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:56.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:56.915 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:45:56.915 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:45:56.951 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:57.118 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:57.179 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:45:57.179 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:45:57.181 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858299', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858299', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi005.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMrIN7lqmyXd7EwDdHVrRj/m48AbYq7fIPdVLsL/9dtbxdjq+Ds4FCdFdKy0P9jT29KKO3VoQUsr1H0BjOyVCdQ=', 'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBiXHv6yw/bVytj/NwPsDvus8deAS8MWPgKPlE+RWYyqSAu+Ds+88T65Jh2R9fvWs8oS3o6ZInOyC7TYynDDBJc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:10:27', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:45:57.181 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:45:57.186 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:45:57.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:45:57.262 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:45:57.321 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:45:57.322 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:45:57.358 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:45:57.358 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-08-17T02:45:57.434 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:45:57.434 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:57.434 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-17 02:45:47.434021405 +0000 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-17 02:43:28.692959619 +0000 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-17 02:43:28.692959619 +0000 2024-08-17T02:45:57.435 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-17 02:43:28.692959619 +0000 2024-08-17T02:45:57.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:45:57.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-17T02:45:57.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-17T02:45:57.528 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000216174 s, 2.4 MB/s 2024-08-17T02:45:57.530 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:45:57.568 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-08-17T02:45:57.644 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:45:57.644 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:57.644 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-08-17T02:45:57.644 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:57.644 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:57.644 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-17 02:45:47.435021385 +0000 2024-08-17T02:45:57.644 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-17 02:43:29.149950325 +0000 2024-08-17T02:45:57.644 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-17 02:43:29.149950325 +0000 2024-08-17T02:45:57.645 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-17 02:43:29.149950325 +0000 2024-08-17T02:45:57.645 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:45:57.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-17T02:45:57.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-17T02:45:57.737 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000175022 s, 2.9 MB/s 2024-08-17T02:45:57.739 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:45:57.776 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-08-17T02:45:57.854 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:45:57.854 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:57.854 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-08-17T02:45:57.854 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:57.855 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:57.855 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-17 02:45:47.435021385 +0000 2024-08-17T02:45:57.855 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-17 02:43:29.618940786 +0000 2024-08-17T02:45:57.855 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-17 02:43:29.618940786 +0000 2024-08-17T02:45:57.855 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-17 02:43:29.618940786 +0000 2024-08-17T02:45:57.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:45:57.947 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-17T02:45:57.947 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-17T02:45:57.947 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000171208 s, 3.0 MB/s 2024-08-17T02:45:57.950 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:45:57.986 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-08-17T02:45:58.061 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:45:58.061 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:58.061 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-08-17T02:45:58.061 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:58.061 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:58.061 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-17 02:45:47.436021365 +0000 2024-08-17T02:45:58.061 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-17 02:43:30.083931329 +0000 2024-08-17T02:45:58.062 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-17 02:43:30.083931329 +0000 2024-08-17T02:45:58.062 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-17 02:43:30.083931329 +0000 2024-08-17T02:45:58.062 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:45:58.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-17T02:45:58.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-17T02:45:58.156 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000176514 s, 2.9 MB/s 2024-08-17T02:45:58.158 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:45:58.195 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:58.195 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:45:58.196 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:45:58.237 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:45:58.237 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-08-17T02:45:58.315 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:45:58.316 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:58.316 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-08-17T02:45:58.316 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:58.316 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:58.316 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-08-17 02:45:43.663328759 +0000 2024-08-17T02:45:58.316 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-08-17 02:43:25.521944973 +0000 2024-08-17T02:45:58.316 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-08-17 02:43:25.521944973 +0000 2024-08-17T02:45:58.316 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-08-17 02:43:25.521944973 +0000 2024-08-17T02:45:58.316 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:45:58.411 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-08-17T02:45:58.411 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-08-17T02:45:58.411 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000330005 s, 1.6 MB/s 2024-08-17T02:45:58.413 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:45:58.450 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-08-17T02:45:58.526 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:45:58.527 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:58.527 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-08-17T02:45:58.527 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:58.527 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:58.527 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-08-17 02:45:43.664328743 +0000 2024-08-17T02:45:58.527 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-08-17 02:43:26.023936963 +0000 2024-08-17T02:45:58.527 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-08-17 02:43:26.023936963 +0000 2024-08-17T02:45:58.527 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-08-17 02:43:26.023936963 +0000 2024-08-17T02:45:58.528 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:45:58.619 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-08-17T02:45:58.619 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-08-17T02:45:58.620 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000265764 s, 1.9 MB/s 2024-08-17T02:45:58.622 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:45:58.659 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-08-17T02:45:58.733 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:45:58.734 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:58.734 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-08-17T02:45:58.734 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:58.734 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:58.734 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-08-17 02:45:43.665328727 +0000 2024-08-17T02:45:58.734 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-08-17 02:43:26.531928858 +0000 2024-08-17T02:45:58.734 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-08-17 02:43:26.532928842 +0000 2024-08-17T02:45:58.734 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-08-17 02:43:26.531928858 +0000 2024-08-17T02:45:58.734 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:45:58.827 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-08-17T02:45:58.827 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-08-17T02:45:58.827 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000452048 s, 1.1 MB/s 2024-08-17T02:45:58.829 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:45:58.866 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-08-17T02:45:58.941 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:45:58.941 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:58.941 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-08-17T02:45:58.942 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:58.942 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:58.942 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-08-17 02:45:43.667328694 +0000 2024-08-17T02:45:58.942 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-08-17 02:43:27.033920848 +0000 2024-08-17T02:45:58.942 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-08-17 02:43:27.033920848 +0000 2024-08-17T02:45:58.942 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-08-17 02:43:27.033920848 +0000 2024-08-17T02:45:58.942 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:45:59.034 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-08-17T02:45:59.034 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-08-17T02:45:59.034 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000269959 s, 1.9 MB/s 2024-08-17T02:45:59.037 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:45:59.074 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:59.074 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:45:59.074 INFO:tasks.ceph:Generating config... 2024-08-17T02:45:59.077 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:45:59.077 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:45:59.077 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:45:59.077 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:45:59.077 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:45:59.077 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:45:59.077 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-17T02:45:59.077 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:45:59.078 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:45:59.078 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:45:59.078 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:45:59.078 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:45:59.078 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:45:59.078 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:45:59.078 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:45:59.078 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:45:59.078 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:45:59.078 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:45:59.078 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:45:59.079 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:45:59.079 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:45:59.079 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:45:59.079 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:45:59.079 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:45:59.079 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:45:59.080 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:45:59.080 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:45:59.080 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:45:59.080 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:45:59.080 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:45:59.080 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:45:59.081 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:45:59.081 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:45:59.081 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:45:59.081 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:45:59.081 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:45:59.081 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:45:59.082 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:45:59.082 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:45:59.082 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:45:59.082 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:45:59.082 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:45:59.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:45:59.170 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:45:59.175 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:45:59.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:45:59.311 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.b', '172.21.15.107'), ('mon.c', '[v2:172.21.15.107:3301,v1:172.21.15.107:6790]')] 2024-08-17T02:45:59.311 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:45:59.312 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:45:59.312 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:45:59.347 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --add b 172.21.15.107 --addv c '[v2:172.21.15.107:3301,v1:172.21.15.107:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:59.459 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:59.460 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3 2024-08-17T02:45:59.460 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = octopus 2024-08-17T02:45:59.460 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2024-08-17T02:45:59.460 INFO:teuthology.orchestra.run.smithi005.stdout:fsid c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3 2024-08-17T02:45:59.460 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2024-08-17T02:45:59.459268+0000 2024-08-17T02:45:59.460 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-08-17T02:45:59.459268+0000 2024-08-17T02:45:59.461 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 15 (octopus) 2024-08-17T02:45:59.461 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2024-08-17T02:45:59.461 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-17T02:45:59.461 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.b 2024-08-17T02:45:59.461 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-08-17T02:45:59.461 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:45:59.462 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:45:59.497 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3... 2024-08-17T02:45:59.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:45:59.541 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:45:59.635 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-08-17T02:45:59.635 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-08-17T02:45:59.635 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:45:59.635 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-08-17T02:45:59.635 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.635 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-08-17T02:45:59.635 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-08-17T02:45:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-08-17T02:45:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-08-17T02:45:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-08-17T02:45:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-08-17T02:45:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:45:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-08-17T02:45:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:45:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:45:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-08-17T02:45:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-08-17T02:45:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-08-17T02:45:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:45:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:45:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-08-17T02:45:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:45:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-08-17T02:45:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:45:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:45:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-08-17T02:45:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:45:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-08-17T02:45:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-08-17T02:45:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-08-17T02:45:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-08-17T02:45:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-08-17T02:45:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]" 2024-08-17T02:45:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on skipped message = False 2024-08-17T02:45:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3 2024-08-17T02:45:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.639 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-08-17T02:45:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-08-17T02:45:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-08-17T02:45:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-08-17T02:45:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:45:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-08-17T02:45:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-08-17T02:45:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-08-17T02:45:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-08-17T02:45:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-08-17T02:45:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-08-17T02:45:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-08-17T02:45:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:45:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-08-17T02:45:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-08-17T02:45:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:45:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-08-17T02:45:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-08-17T02:45:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-08-17T02:45:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: bdev async discard = True 2024-08-17T02:45:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: bdev enable discard = True 2024-08-17T02:45:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore allocator = bitmap 2024-08-17T02:45:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-08-17T02:45:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-08-17T02:45:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 1/20 2024-08-17T02:45:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 1/20 2024-08-17T02:45:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-17T02:45:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-08-17T02:45:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 4/10 2024-08-17T02:45:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:45:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-08-17T02:45:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:45:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:45:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-08-17T02:45:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-08-17T02:45:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.642 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-08-17T02:45:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-17T02:45:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-08-17T02:45:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-08-17T02:45:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-08-17T02:45:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:45:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:45:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-08-17T02:45:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-08-17T02:45:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: debug finisher = 20 2024-08-17T02:45:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.643 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-08-17T02:45:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-17T02:45:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-08-17T02:45:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-08-17T02:45:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-08-17T02:45:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-08-17T02:45:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-08-17T02:45:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:45:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-08-17T02:45:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-08-17T02:45:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:45:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:45:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:45:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:45:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:45:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:45:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:45:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-08-17T02:45:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:45:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:45:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2024-08-17T02:45:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:45:59.645 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-08-17T02:45:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-08-17T02:45:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-08-17T02:45:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-08-17T02:45:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:45:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:45:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2024-08-17T02:45:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-08-17T02:45:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-17T02:45:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2024-08-17T02:45:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-08-17T02:45:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-08-17T02:45:59.645 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-08-17T02:45:59.645 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-08-17T02:45:59.646 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-08-17T02:45:59.646 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-08-17T02:45:59.646 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-08-17T02:45:59.646 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-08-17T02:45:59.646 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-08-17T02:45:59.646 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2024-08-17T02:45:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2024-08-17T02:45:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2024-08-17T02:45:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-17T02:45:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2024-08-17T02:45:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2024-08-17T02:45:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2024-08-17T02:45:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2024-08-17T02:45:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-08-17T02:45:59.647 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-08-17T02:45:59.647 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-08-17T02:45:59.647 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-08-17T02:45:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2024-08-17T02:45:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:45:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2024-08-17T02:45:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2024-08-17T02:45:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2024-08-17T02:45:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2024-08-17T02:45:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2024-08-17T02:45:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2024-08-17T02:45:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2024-08-17T02:45:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:45:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2024-08-17T02:45:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:45:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:45:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2024-08-17T02:45:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2024-08-17T02:45:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2024-08-17T02:45:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:45:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:45:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2024-08-17T02:45:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:45:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2024-08-17T02:45:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:45:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:45:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2024-08-17T02:45:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:45:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2024-08-17T02:45:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2024-08-17T02:45:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2024-08-17T02:45:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2024-08-17T02:45:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2024-08-17T02:45:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = "172.21.15.5,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]" 2024-08-17T02:45:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on skipped message = False 2024-08-17T02:45:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3 2024-08-17T02:45:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.651 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2024-08-17T02:45:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2024-08-17T02:45:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2024-08-17T02:45:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2024-08-17T02:45:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:45:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2024-08-17T02:45:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2024-08-17T02:45:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2024-08-17T02:45:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2024-08-17T02:45:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2024-08-17T02:45:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2024-08-17T02:45:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2024-08-17T02:45:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:45:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2024-08-17T02:45:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2024-08-17T02:45:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:45:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2024-08-17T02:45:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2024-08-17T02:45:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2024-08-17T02:45:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: bdev async discard = True 2024-08-17T02:45:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: bdev enable discard = True 2024-08-17T02:45:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore allocator = bitmap 2024-08-17T02:45:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2024-08-17T02:45:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2024-08-17T02:45:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 1/20 2024-08-17T02:45:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 1/20 2024-08-17T02:45:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-08-17T02:45:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2024-08-17T02:45:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 4/10 2024-08-17T02:45:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:45:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2024-08-17T02:45:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:45:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:45:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2024-08-17T02:45:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-08-17T02:45:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.655 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2024-08-17T02:45:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-08-17T02:45:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2024-08-17T02:45:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-08-17T02:45:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-08-17T02:45:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:45:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:45:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2024-08-17T02:45:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2024-08-17T02:45:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: debug finisher = 20 2024-08-17T02:45:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.656 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2024-08-17T02:45:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-08-17T02:45:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-08-17T02:45:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2024-08-17T02:45:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-08-17T02:45:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2024-08-17T02:45:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2024-08-17T02:45:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:45:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2024-08-17T02:45:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2024-08-17T02:45:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:45:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:45:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:45:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:45:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:45:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:45:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:45:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2024-08-17T02:45:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:45:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:45:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: mon op complaint time = 120 2024-08-17T02:45:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-08-17T02:45:59.658 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2024-08-17T02:45:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2024-08-17T02:45:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2024-08-17T02:45:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2024-08-17T02:45:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:45:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:45:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: client mount timeout = 600 2024-08-17T02:45:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2024-08-17T02:45:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-08-17T02:45:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = "" 2024-08-17T02:45:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-08-17T02:45:59.659 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-08-17T02:45:59.659 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2024-08-17T02:45:59.659 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.b] 2024-08-17T02:45:59.659 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.c] 2024-08-17T02:45:59.659 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-08-17T02:45:59.659 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-08-17T02:45:59.659 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-08-17T02:45:59.659 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-08-17T02:45:59.659 INFO:teuthology.orchestra.run.smithi107.stdout:[mds] 2024-08-17T02:45:59.659 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds = 20 2024-08-17T02:45:59.659 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds balancer = 20 2024-08-17T02:45:59.659 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-08-17T02:45:59.660 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug frag = True 2024-08-17T02:45:59.661 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug scatterstat = True 2024-08-17T02:45:59.661 INFO:teuthology.orchestra.run.smithi107.stdout: mds op complaint time = 180 2024-08-17T02:45:59.662 INFO:teuthology.orchestra.run.smithi107.stdout: mds verify scatter = True 2024-08-17T02:45:59.662 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-08-17T02:45:59.662 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-08-17T02:45:59.662 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-08-17T02:45:59.666 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:45:59.666 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:45:59.756 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:45:59.757 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:45:59.757 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:45:59.792 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:45:59.793 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:45:59.867 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:45:59.867 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:45:59.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:45:59.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:45:59.985 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:45:59.985 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:00.060 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:46:00.061 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:46:00.061 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:46:00.061 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:46:00.138 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:46:00.139 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:00.213 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:46:00.213 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:46:00.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:46:00.312 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:46:00.317 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:46:00.424 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:46:00.430 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:46:00.430 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:46:00.528 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:46:00.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:46:00.588 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:46:00.686 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:46:00.691 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:46:00.746 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:46:00.845 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:46:00.849 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:46:00.904 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:46:01.002 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:46:01.007 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:46:01.062 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:46:01.062 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:46:01.139 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:46:01.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:46:01.242 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:46:01.269 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:46:01.344 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:46:01.371 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:46:01.444 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:46:01.471 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:46:01.471 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:46:01.471 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:46:01.528 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:46:01.528 INFO:tasks.ceph:role: osd.0 2024-08-17T02:46:01.528 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:46:01.528 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:46:01.583 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:46:01.583 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:46:01.583 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:46:01.584 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:46:01.584 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:46:01.584 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:46:01.584 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:46:01.584 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:46:01.584 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:46:01.584 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:46:01.620 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-08-17T02:46:01.624 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-08-17T02:46:01.624 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:46:01.705 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:46:01.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:46:01.823 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:46:01.823 INFO:tasks.ceph:role: osd.1 2024-08-17T02:46:01.823 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:46:01.824 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:46:01.879 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:46:01.879 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:46:01.879 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:46:01.880 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:46:01.880 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:46:01.880 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:46:01.880 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:46:01.880 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:46:01.880 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:46:01.880 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:46:01.915 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-08-17T02:46:01.921 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-08-17T02:46:01.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:46:02.004 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:46:02.066 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:46:02.123 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:46:02.123 INFO:tasks.ceph:role: osd.2 2024-08-17T02:46:02.123 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:46:02.123 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:46:02.179 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:46:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:46:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:46:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:46:02.179 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:46:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:46:02.179 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:46:02.179 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:46:02.179 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:46:02.180 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:46:02.216 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-08-17T02:46:02.220 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-08-17T02:46:02.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:46:02.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:46:02.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:46:02.426 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:46:02.426 INFO:tasks.ceph:role: osd.3 2024-08-17T02:46:02.426 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:46:02.427 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:46:02.482 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:46:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:46:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:46:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:46:02.482 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:46:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:46:02.482 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:46:02.482 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:46:02.483 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:46:02.483 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:46:02.518 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-08-17T02:46:02.522 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-08-17T02:46:02.522 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:46:02.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:46:02.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:02.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:02.772+0000 7fd9866112c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:46:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:02.772+0000 7fd9866112c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:46:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:02.772+0000 7fd9866112c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:46:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:02.772+0000 7fd9866112c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:46:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:02.772+0000 7fd9866112c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:46:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:02.775+0000 7fd9866112c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:46:03.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:03.317+0000 7fd9866112c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:04.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:04.090+0000 7fd9866112c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:04.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:04.861+0000 7fd9866112c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:05.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:46:05.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:05.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:05.841+0000 7f6d741662c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:46:05.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:05.841+0000 7f6d741662c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:46:05.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:05.841+0000 7f6d741662c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:46:05.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:05.841+0000 7f6d741662c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:46:05.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:05.841+0000 7f6d741662c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:46:05.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:05.843+0000 7f6d741662c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:46:06.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:06.392+0000 7f6d741662c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:07.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:07.161+0000 7f6d741662c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:07.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:07.932+0000 7f6d741662c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:08.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:46:08.840 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:08.926+0000 7f065b6162c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:46:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:08.926+0000 7f065b6162c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:46:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:08.926+0000 7f065b6162c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:46:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:08.926+0000 7f065b6162c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:46:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:08.926+0000 7f065b6162c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:46:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:08.928+0000 7f065b6162c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:46:09.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:09.482+0000 7f065b6162c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:10.250+0000 7f065b6162c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:11.021+0000 7f065b6162c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:11.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:46:11.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:12.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:11.999+0000 7eff6e83a2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:46:12.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:11.999+0000 7eff6e83a2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:46:12.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:11.999+0000 7eff6e83a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:46:12.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:11.999+0000 7eff6e83a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:46:12.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:11.999+0000 7eff6e83a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:46:12.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:12.001+0000 7eff6e83a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:46:12.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:12.543+0000 7eff6e83a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:13.313+0000 7eff6e83a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:14.087+0000 7eff6e83a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:14.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:46:14.986 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:46:15.049 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:46:15.049 INFO:tasks.ceph:role: osd.4 2024-08-17T02:46:15.049 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:46:15.049 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:46:15.114 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:46:15.115 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:46:15.115 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:46:15.115 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:46:15.115 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:46:15.115 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:46:15.116 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:46:15.116 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:46:15.116 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:46:15.116 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:46:15.512 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-08-17T02:46:15.516 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-08-17T02:46:15.516 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:46:15.637 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:46:15.706 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:46:15.762 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:46:15.762 INFO:tasks.ceph:role: osd.5 2024-08-17T02:46:15.762 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:46:15.763 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:46:15.826 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:46:15.826 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:46:15.826 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:46:15.826 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:46:15.826 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:46:15.826 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:46:15.826 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:46:15.826 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:46:15.827 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:46:15.827 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:46:16.183 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-08-17T02:46:16.188 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-08-17T02:46:16.188 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:46:16.272 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:46:16.334 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:46:16.388 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:46:16.388 INFO:tasks.ceph:role: osd.6 2024-08-17T02:46:16.388 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:46:16.389 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:46:16.450 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:46:16.450 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:46:16.450 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:46:16.451 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:46:16.451 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:46:16.451 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:46:16.451 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:46:16.451 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:46:16.451 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:46:16.451 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:46:16.841 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-08-17T02:46:16.846 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-08-17T02:46:16.846 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:46:16.944 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:46:17.008 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:46:17.063 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:46:17.063 INFO:tasks.ceph:role: osd.7 2024-08-17T02:46:17.063 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:46:17.063 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:46:17.126 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:46:17.127 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:46:17.127 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:46:17.127 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:46:17.127 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:46:17.127 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:46:17.127 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:46:17.127 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:46:17.127 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:46:17.127 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:46:17.516 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-08-17T02:46:17.520 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-08-17T02:46:17.520 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:46:17.643 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:46:17.706 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:17.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:17.805+0000 7f4bb0a352c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:46:17.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:17.808+0000 7f4bb0a352c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:46:17.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:17.808+0000 7f4bb0a352c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:46:17.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:17.808+0000 7f4bb0a352c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:46:17.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:17.808+0000 7f4bb0a352c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:46:17.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:17.816+0000 7f4bb0a352c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:46:18.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:18.355+0000 7f4bb0a352c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:19.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:19.151+0000 7f4bb0a352c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:19.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:19.921+0000 7f4bb0a352c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:20.746 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:46:20.802 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:20.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:20.885+0000 7fed854892c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:46:20.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:20.885+0000 7fed854892c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:46:20.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:20.885+0000 7fed854892c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:46:20.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:20.885+0000 7fed854892c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:46:20.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:20.885+0000 7fed854892c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:46:20.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:20.887+0000 7fed854892c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:46:21.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:21.430+0000 7fed854892c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:22.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:22.191+0000 7fed854892c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:22.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:22.964+0000 7fed854892c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:23.796 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:46:23.854 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:23.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:23.937+0000 7f2dcb61e2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:46:23.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:23.937+0000 7f2dcb61e2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:46:23.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:23.937+0000 7f2dcb61e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:46:23.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:23.937+0000 7f2dcb61e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:46:23.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:23.937+0000 7f2dcb61e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:46:23.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:23.939+0000 7f2dcb61e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:46:24.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:24.490+0000 7f2dcb61e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:25.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:25.262+0000 7f2dcb61e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:26.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:26.041+0000 7f2dcb61e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:26.882 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:46:26.940 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:27.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:27.023+0000 7ff7a44172c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:46:27.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:27.024+0000 7ff7a44172c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:46:27.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:27.024+0000 7ff7a44172c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:46:27.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:27.024+0000 7ff7a44172c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:46:27.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:27.024+0000 7ff7a44172c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:46:27.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:27.026+0000 7ff7a44172c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:46:27.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:46:27.187 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:46:27.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:27.562+0000 7ff7a44172c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:28.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:28.332+0000 7ff7a44172c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:29.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:29.106+0000 7ff7a44172c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:46:29.937 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:46:29.993 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:46:29.994 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:46:29.994 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:46:30.056 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:46:30.056 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:46:30.156 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:46:30.156 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:46:30.253 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:46:30.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:46:30.350 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:46:30.350 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:46:30.446 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:46:30.446 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:46:30.542 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:46:30.542 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:46:30.638 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:46:30.638 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:46:30.696 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:46:30.696 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:46:30.791 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:46:30.791 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:46:30.888 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:46:30.888 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:46:30.982 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:46:30.982 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:46:31.077 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:46:31.077 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:46:31.172 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:46:31.172 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:46:31.267 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:46:31.268 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:46:31.304 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:46:31.305 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:46:31.381 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:46:31.381 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:46:31.416 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:46:31.416 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:46:31.491 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:46:31.491 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:46:31.495 DEBUG:teuthology.orchestra.run.smithi107:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:46:31.545 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.y] 2024-08-17T02:46:31.545 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDoDsBmkpqcEhAAyi/+MJcp2YOdxUGfi6ppVg== 2024-08-17T02:46:31.545 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-08-17T02:46:31.545 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDoDsBmfSN+HxAAcg8pNsTrQ9hTmQZ3Kpq0pw== 2024-08-17T02:46:31.546 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-08-17T02:46:31.546 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDoDsBmwGX3KBAAWdvrBWyhuQlP/MyVv17aNg== 2024-08-17T02:46:31.546 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2024-08-17T02:46:31.546 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDqDsBmn2YfLhAAzU27MiKK/+Hu2p711I0yKw== 2024-08-17T02:46:31.546 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2024-08-17T02:46:31.547 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDtDsBm84w6MhAAlBqRC1in+hEa7IrUoBRP4g== 2024-08-17T02:46:31.547 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2024-08-17T02:46:31.547 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDwDsBmR1lJNxAAuZdEc43Ev1SzoeBRnQ6BfA== 2024-08-17T02:46:31.547 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2024-08-17T02:46:31.547 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQD0DsBmGaYLABAA266OowT94+9ZaQjTzqfBUQ== 2024-08-17T02:46:31.547 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2024-08-17T02:46:31.548 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDoDsBmTKZKGRAAOP+ZNelLloZgh6poXU6OgA== 2024-08-17T02:46:31.548 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-08-17T02:46:31.548 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDoDsBmKHhpMhAAHRUjUfRAR6e2ak6o9GAfjg== 2024-08-17T02:46:31.548 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-08-17T02:46:31.548 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDpDsBmeGYmABAAGUaPonb//3Bnhm7jocZEYA== 2024-08-17T02:46:31.548 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.4] 2024-08-17T02:46:31.549 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQD5DsBm2iIXMBAANXMuZXG3tLrHJGLQpF9alg== 2024-08-17T02:46:31.549 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.5] 2024-08-17T02:46:31.549 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQD8DsBmyAXPNBAAAA3qPKom4IiekWc6DeSszQ== 2024-08-17T02:46:31.549 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.6] 2024-08-17T02:46:31.549 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQD/DsBmzArnNxAAAgjR7AbZm9xZv/Bo2LyE7A== 2024-08-17T02:46:31.549 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.7] 2024-08-17T02:46:31.550 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQADD8BmyHV5ARAAFGTag8bk5AVEhYvCYibAuA== 2024-08-17T02:46:31.550 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-17T02:46:31.550 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDpDsBmfPVUCBAA1etQZ/UgvjIx94Qv6o5pGw== 2024-08-17T02:46:31.550 INFO:teuthology.orchestra.run.smithi005.stdout:[client.2] 2024-08-17T02:46:31.550 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDpDsBm0mV5DhAASbvgOTbHpLOa6/inSyncrg== 2024-08-17T02:46:31.550 INFO:teuthology.orchestra.run.smithi005.stdout:[client.1] 2024-08-17T02:46:31.551 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDpDsBmluOLFBAAwTMJHOeSsJOcokE+DVzCqQ== 2024-08-17T02:46:31.551 INFO:teuthology.orchestra.run.smithi005.stdout:[client.3] 2024-08-17T02:46:31.551 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDpDsBmbXyIGhAAK6PbUQ9L880Q7lrxJW9AKg== 2024-08-17T02:46:31.584 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.y] 2024-08-17T02:46:31.585 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDoDsBmkpqcEhAAyi/+MJcp2YOdxUGfi6ppVg== 2024-08-17T02:46:31.585 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-08-17T02:46:31.585 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDoDsBmfSN+HxAAcg8pNsTrQ9hTmQZ3Kpq0pw== 2024-08-17T02:46:31.585 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-08-17T02:46:31.585 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDoDsBmwGX3KBAAWdvrBWyhuQlP/MyVv17aNg== 2024-08-17T02:46:31.585 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.0] 2024-08-17T02:46:31.585 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDqDsBmn2YfLhAAzU27MiKK/+Hu2p711I0yKw== 2024-08-17T02:46:31.585 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.1] 2024-08-17T02:46:31.585 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDtDsBm84w6MhAAlBqRC1in+hEa7IrUoBRP4g== 2024-08-17T02:46:31.585 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.2] 2024-08-17T02:46:31.585 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDwDsBmR1lJNxAAuZdEc43Ev1SzoeBRnQ6BfA== 2024-08-17T02:46:31.586 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.3] 2024-08-17T02:46:31.586 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQD0DsBmGaYLABAA266OowT94+9ZaQjTzqfBUQ== 2024-08-17T02:46:31.586 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.x] 2024-08-17T02:46:31.586 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDoDsBmTKZKGRAAOP+ZNelLloZgh6poXU6OgA== 2024-08-17T02:46:31.586 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-08-17T02:46:31.586 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDoDsBmKHhpMhAAHRUjUfRAR6e2ak6o9GAfjg== 2024-08-17T02:46:31.586 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-08-17T02:46:31.586 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDpDsBmeGYmABAAGUaPonb//3Bnhm7jocZEYA== 2024-08-17T02:46:31.586 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.4] 2024-08-17T02:46:31.586 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQD5DsBm2iIXMBAANXMuZXG3tLrHJGLQpF9alg== 2024-08-17T02:46:31.586 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.5] 2024-08-17T02:46:31.586 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQD8DsBmyAXPNBAAAA3qPKom4IiekWc6DeSszQ== 2024-08-17T02:46:31.586 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.6] 2024-08-17T02:46:31.587 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQD/DsBmzArnNxAAAgjR7AbZm9xZv/Bo2LyE7A== 2024-08-17T02:46:31.587 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.7] 2024-08-17T02:46:31.587 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQADD8BmyHV5ARAAFGTag8bk5AVEhYvCYibAuA== 2024-08-17T02:46:31.587 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2024-08-17T02:46:31.587 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDpDsBmfPVUCBAA1etQZ/UgvjIx94Qv6o5pGw== 2024-08-17T02:46:31.587 INFO:teuthology.orchestra.run.smithi107.stdout:[client.2] 2024-08-17T02:46:31.587 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDpDsBm0mV5DhAASbvgOTbHpLOa6/inSyncrg== 2024-08-17T02:46:31.587 INFO:teuthology.orchestra.run.smithi107.stdout:[client.1] 2024-08-17T02:46:31.587 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDpDsBmluOLFBAAwTMJHOeSsJOcokE+DVzCqQ== 2024-08-17T02:46:31.587 INFO:teuthology.orchestra.run.smithi107.stdout:[client.3] 2024-08-17T02:46:31.587 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDpDsBmbXyIGhAAK6PbUQ9L880Q7lrxJW9AKg== 2024-08-17T02:46:31.588 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:46:31.597 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:46:31.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:46:31.719 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:46:31.808 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:46:31.812 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:46:31.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:31.905 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:31.992 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:31.996 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:32.082 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:32.089 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:32.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:32.179 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:32.266 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:46:32.270 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:46:32.357 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:46:32.361 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:46:32.449 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:46:32.454 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:46:32.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:32.547 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:32.633 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:32.637 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:32.724 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:32.729 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:32.816 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:32.821 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:46:32.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:46:32.912 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:46:33.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:46:33.005 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:46:33.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:46:33.098 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:46:33.187 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:46:33.191 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:46:33.281 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:46:33.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:46:33.337 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:46:33.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:46:33.493 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:46:33.550 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:46:33.649 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:46:33.705 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:46:33.761 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:46:33.858 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:46:33.914 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:33.918 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:46:33.952 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:46:33.953 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:46:33.953 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:46:33.994 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:46:33.994 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:46:33.994 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:46:33.998 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:46:33.998 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:46:33.998 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:46:34.002 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:46:34.002 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:46:34.002 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:46:34.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:46:34.005 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:46:34.006 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:46:34.006 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:46:34.010 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:46:34.011 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:46:34.011 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:46:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.160+0000 7f00bb800640 1 Processor -- start 2024-08-17T02:46:34.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.160+0000 7f00bb800640 1 -- start start 2024-08-17T02:46:34.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.161+0000 7f00bb800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f00b40ad960 0x7f00b415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.161+0000 7f00bb800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f00b40add30 0x7f00b4156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.161+0000 7f00bb800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b415b5e0 con 0x7f00b40ca050 2024-08-17T02:46:34.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.161+0000 7f00bb800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b40cb160 con 0x7f00b40ad960 2024-08-17T02:46:34.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.161+0000 7f00bb800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b40b0d10 con 0x7f00b40add30 2024-08-17T02:46:34.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.161+0000 7f00b8e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f00b40ad960 0x7f00b415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.161+0000 7f00b8e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f00b40ad960 0x7f00b415b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37202/0 (socket says 172.21.15.5:37202) 2024-08-17T02:46:34.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.161+0000 7f00b8e00640 1 -- 172.21.15.5:0/3297840566 learned_addr learned my addr 172.21.15.5:0/3297840566 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:34.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.161+0000 7f00b8e00640 1 -- 172.21.15.5:0/3297840566 >> v2:172.21.15.5:3300/0 conn(0x7f00b40ad960 msgr2=0x7f00b415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:46:34.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.161+0000 7f00b8e00640 1 -- 172.21.15.5:0/3297840566 >> v2:172.21.15.5:3300/0 conn(0x7f00b40ad960 msgr2=0x7f00b415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:46:34.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.161+0000 7f00b8e00640 1 --2- 172.21.15.5:0/3297840566 >> v2:172.21.15.5:3300/0 conn(0x7f00b40ad960 0x7f00b415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:46:34.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.161+0000 7f00b9800640 1 --2- 172.21.15.5:0/3297840566 >> v2:172.21.15.107:3300/0 conn(0x7f00b40add30 0x7f00b4156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.161+0000 7f00b8e00640 1 --2- 172.21.15.5:0/3297840566 >> v2:172.21.15.5:3300/0 conn(0x7f00b40ad960 0x7f00b415b0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:46:34.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.162+0000 7f00b9800640 1 -- 172.21.15.5:0/3297840566 >> v2:172.21.15.107:3300/0 conn(0x7f00b40add30 msgr2=0x7f00b4156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:46:34.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.162+0000 7f00b9800640 1 -- 172.21.15.5:0/3297840566 >> v2:172.21.15.107:3300/0 conn(0x7f00b40add30 msgr2=0x7f00b4156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:46:34.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.162+0000 7f00b9800640 1 --2- 172.21.15.5:0/3297840566 >> v2:172.21.15.107:3300/0 conn(0x7f00b40add30 0x7f00b4156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:46:34.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.162+0000 7f00b9800640 1 --2- 172.21.15.5:0/3297840566 >> v2:172.21.15.107:3300/0 conn(0x7f00b40add30 0x7f00b4156b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:46:34.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.362+0000 7f00b8e00640 1 --2- 172.21.15.5:0/3297840566 >> v2:172.21.15.5:3300/0 conn(0x7f00b40ad960 0x7f00b415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.362+0000 7f00b8e00640 1 -- 172.21.15.5:0/3297840566 >> v2:172.21.15.5:3300/0 conn(0x7f00b40ad960 msgr2=0x7f00b415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:46:34.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.362+0000 7f00b8e00640 1 -- 172.21.15.5:0/3297840566 >> v2:172.21.15.5:3300/0 conn(0x7f00b40ad960 msgr2=0x7f00b415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:46:34.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.362+0000 7f00b8e00640 1 --2- 172.21.15.5:0/3297840566 >> v2:172.21.15.5:3300/0 conn(0x7f00b40ad960 0x7f00b415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:46:34.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.362+0000 7f00b8e00640 1 --2- 172.21.15.5:0/3297840566 >> v2:172.21.15.5:3300/0 conn(0x7f00b40ad960 0x7f00b415b0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:46:34.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.363+0000 7f00b9800640 1 --2- 172.21.15.5:0/3297840566 >> v2:172.21.15.107:3300/0 conn(0x7f00b40add30 0x7f00b4156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.363+0000 7f00b9800640 1 -- 172.21.15.5:0/3297840566 >> v2:172.21.15.107:3300/0 conn(0x7f00b40add30 msgr2=0x7f00b4156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:46:34.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.363+0000 7f00b9800640 1 -- 172.21.15.5:0/3297840566 >> v2:172.21.15.107:3300/0 conn(0x7f00b40add30 msgr2=0x7f00b4156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:46:34.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.363+0000 7f00b9800640 1 --2- 172.21.15.5:0/3297840566 >> v2:172.21.15.107:3300/0 conn(0x7f00b40add30 0x7f00b4156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:46:34.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.363+0000 7f00b9800640 1 --2- 172.21.15.5:0/3297840566 >> v2:172.21.15.107:3300/0 conn(0x7f00b40add30 0x7f00b4156b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:46:34.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.372+0000 7f00b3400640 1 -- 172.21.15.5:0/3297840566 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258269100 0 0) 0x7f00a0001110 con 0x7f00b40ca050 2024-08-17T02:46:34.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.372+0000 7f00b3400640 1 -- 172.21.15.5:0/3297840566 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f009c0034e0 con 0x7f00b40ca050 2024-08-17T02:46:34.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.378+0000 7f00b3400640 1 -- 172.21.15.5:0/3297840566 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3184141503 0 0) 0x7f009c0034e0 con 0x7f00b40ca050 2024-08-17T02:46:34.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.378+0000 7f00b3400640 1 -- 172.21.15.5:0/3297840566 >> v2:172.21.15.107:3300/0 conn(0x7f00b40add30 msgr2=0x7f00b4156b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:46:34.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.378+0000 7f00b3400640 1 --2- 172.21.15.5:0/3297840566 >> v2:172.21.15.107:3300/0 conn(0x7f00b40add30 0x7f00b4156b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.378+0000 7f00b3400640 1 -- 172.21.15.5:0/3297840566 >> v2:172.21.15.5:3300/0 conn(0x7f00b40ad960 msgr2=0x7f00b415b0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:46:34.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.378+0000 7f00b3400640 1 --2- 172.21.15.5:0/3297840566 >> v2:172.21.15.5:3300/0 conn(0x7f00b40ad960 0x7f00b415b0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.378+0000 7f00b3400640 1 -- 172.21.15.5:0/3297840566 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b40ca550 con 0x7f00b40ca050 2024-08-17T02:46:34.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.378+0000 7f00b3400640 1 -- 172.21.15.5:0/3297840566 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7f00a0001600 con 0x7f00b40ca050 2024-08-17T02:46:34.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.378+0000 7f00b3400640 1 -- 172.21.15.5:0/3297840566 >> v1:172.21.15.107:6789/0 conn(0x7f00b40ca050 legacy=0x7f00b4156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.378+0000 7f00b3400640 1 --2- 172.21.15.5:0/3297840566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f009c003aa0 0x7f009c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.378+0000 7f00b3400640 1 --2- 172.21.15.5:0/3297840566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f009c004780 0x7f009c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.379+0000 7f00b3400640 1 --2- 172.21.15.5:0/3297840566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f009c005250 0x7f009c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.379+0000 7f00b3400640 1 -- 172.21.15.5:0/3297840566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40cb160 con 0x7f009c005250 2024-08-17T02:46:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.379+0000 7f00b3400640 1 -- 172.21.15.5:0/3297840566 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40b0d10 con 0x7f009c004780 2024-08-17T02:46:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.379+0000 7f00b3400640 1 -- 172.21.15.5:0/3297840566 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009c00c150 con 0x7f009c003aa0 2024-08-17T02:46:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.379+0000 7f00b8e00640 1 --2- 172.21.15.5:0/3297840566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f009c003aa0 0x7f009c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.379+0000 7f00b9800640 1 --2- 172.21.15.5:0/3297840566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f009c005250 0x7f009c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.379+0000 7f00b3e00640 1 --2- 172.21.15.5:0/3297840566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f009c004780 0x7f009c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.379+0000 7f00b8e00640 1 -- 172.21.15.5:0/3297840566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f009c004780 msgr2=0x7f009c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.379+0000 7f00b8e00640 1 --2- 172.21.15.5:0/3297840566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f009c004780 0x7f009c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.379+0000 7f00b8e00640 1 -- 172.21.15.5:0/3297840566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f009c005250 msgr2=0x7f009c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.379+0000 7f00b8e00640 1 --2- 172.21.15.5:0/3297840566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f009c005250 0x7f009c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.379+0000 7f00b8e00640 1 -- 172.21.15.5:0/3297840566 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009c0034e0 con 0x7f009c003aa0 2024-08-17T02:46:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.379+0000 7f00b9800640 1 --2- 172.21.15.5:0/3297840566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f009c005250 0x7f009c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.379+0000 7f00b9800640 1 -- 172.21.15.5:0/3297840566 reap_dead start 2024-08-17T02:46:34.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.381+0000 7f00b8e00640 1 --2- 172.21.15.5:0/3297840566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f009c003aa0 0x7f009c003eb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f00a8006f60 tx=0x7f00a8008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60529d5d1e69beee server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:34.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.381+0000 7f00b3400640 1 -- 172.21.15.5:0/3297840566 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8033410 con 0x7f009c003aa0 2024-08-17T02:46:34.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.381+0000 7f00b3400640 1 -- 172.21.15.5:0/3297840566 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a802d030 con 0x7f009c003aa0 2024-08-17T02:46:34.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.381+0000 7f00b3400640 1 -- 172.21.15.5:0/3297840566 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a80337c0 con 0x7f009c003aa0 2024-08-17T02:46:34.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.381+0000 7f00bb800640 1 -- 172.21.15.5:0/3297840566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f009c003aa0 msgr2=0x7f009c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.381+0000 7f00bb800640 1 --2- 172.21.15.5:0/3297840566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f009c003aa0 0x7f009c003eb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f00a8006f60 tx=0x7f00a8008040 comp rx=0 tx=0).stop 2024-08-17T02:46:34.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.382+0000 7f00bb800640 1 -- 172.21.15.5:0/3297840566 shutdown_connections 2024-08-17T02:46:34.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.382+0000 7f00bb800640 1 --2- 172.21.15.5:0/3297840566 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f009c003aa0 0x7f009c003eb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.382+0000 7f00bb800640 1 -- 172.21.15.5:0/3297840566 >> 172.21.15.5:0/3297840566 conn(0x7f00b4066e60 msgr2=0x7f00b4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:34.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.382+0000 7f00bb800640 1 -- 172.21.15.5:0/3297840566 shutdown_connections 2024-08-17T02:46:34.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.382+0000 7f00bb800640 1 -- 172.21.15.5:0/3297840566 wait complete. 2024-08-17T02:46:34.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.383+0000 7f00bb800640 1 Processor -- start 2024-08-17T02:46:34.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.383+0000 7f00bb800640 1 -- start start 2024-08-17T02:46:34.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.384+0000 7f00bb800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f009c003aa0 0x7f00b415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.384+0000 7f00bb800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b416a270 0x7f00b40a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.384+0000 7f00bb800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00b4151330 0x7f00b40a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.384+0000 7f00bb800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b415e4b0 con 0x7f00b416a270 2024-08-17T02:46:34.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.384+0000 7f00bb800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40a8810 con 0x7f00b4151330 2024-08-17T02:46:34.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.384+0000 7f00bb800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40a8af0 con 0x7f009c003aa0 2024-08-17T02:46:34.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.385+0000 7f00b8e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f009c003aa0 0x7f00b415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.385+0000 7f00b3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b416a270 0x7f00b40a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.385+0000 7f00b9800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00b4151330 0x7f00b40a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.385+0000 7f00b3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b416a270 0x7f00b40a92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37244/0 (socket says 172.21.15.5:37244) 2024-08-17T02:46:34.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.385+0000 7f00b8e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f009c003aa0 0x7f00b415ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:47992/0 (socket says 172.21.15.5:47992) 2024-08-17T02:46:34.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.385+0000 7f00b3e00640 1 -- 172.21.15.5:0/376459909 learned_addr learned my addr 172.21.15.5:0/376459909 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:34.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.385+0000 7f00b8e00640 1 -- 172.21.15.5:0/376459909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00b4151330 msgr2=0x7f00b40a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.385+0000 7f00b8e00640 1 --2- 172.21.15.5:0/376459909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00b4151330 0x7f00b40a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.385+0000 7f00b8e00640 1 -- 172.21.15.5:0/376459909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b416a270 msgr2=0x7f00b40a92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.385+0000 7f00b8e00640 1 --2- 172.21.15.5:0/376459909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b416a270 0x7f00b40a92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.385+0000 7f00b8e00640 1 -- 172.21.15.5:0/376459909 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b40a8dd0 con 0x7f009c003aa0 2024-08-17T02:46:34.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.385+0000 7f00b3e00640 1 --2- 172.21.15.5:0/376459909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b416a270 0x7f00b40a92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:34.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.386+0000 7f00b8e00640 1 --2- 172.21.15.5:0/376459909 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f009c003aa0 0x7f00b415ded0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f00a8032000 tx=0x7f00a8038000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:34.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.386+0000 7f00a7e00640 1 -- 172.21.15.5:0/376459909 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a803d750 con 0x7f009c003aa0 2024-08-17T02:46:34.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.386+0000 7f00a7e00640 1 -- 172.21.15.5:0/376459909 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a803d8d0 con 0x7f009c003aa0 2024-08-17T02:46:34.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.386+0000 7f00a7e00640 1 -- 172.21.15.5:0/376459909 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a803dc90 con 0x7f009c003aa0 2024-08-17T02:46:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.386+0000 7f00bb800640 1 -- 172.21.15.5:0/376459909 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b40a9830 con 0x7f009c003aa0 2024-08-17T02:46:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.386+0000 7f00bb800640 1 -- 172.21.15.5:0/376459909 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b416a6e0 con 0x7f009c003aa0 2024-08-17T02:46:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.386+0000 7f00a7e00640 1 -- 172.21.15.5:0/376459909 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f00a8045070 con 0x7f009c003aa0 2024-08-17T02:46:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.386+0000 7f00a7e00640 1 -- 172.21.15.5:0/376459909 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f00a8043070 con 0x7f009c003aa0 2024-08-17T02:46:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.388+0000 7f00bb800640 1 -- 172.21.15.5:0/376459909 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b40a8950 con 0x7f009c003aa0 2024-08-17T02:46:34.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.391+0000 7f00a7e00640 1 -- 172.21.15.5:0/376459909 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f00b40a8950 con 0x7f009c003aa0 2024-08-17T02:46:34.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.460+0000 7f00bb800640 1 -- 172.21.15.5:0/376459909 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f00b40a8660 con 0x7f009c003aa0 2024-08-17T02:46:34.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.464+0000 7f00a7e00640 1 -- 172.21.15.5:0/376459909 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f00a8038070 con 0x7f009c003aa0 2024-08-17T02:46:34.465 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-08-17T02:46:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.465+0000 7f00bb800640 1 -- 172.21.15.5:0/376459909 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f009c003aa0 msgr2=0x7f00b415ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.465+0000 7f00bb800640 1 --2- 172.21.15.5:0/376459909 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f009c003aa0 0x7f00b415ded0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f00a8032000 tx=0x7f00a8038000 comp rx=0 tx=0).stop 2024-08-17T02:46:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.465+0000 7f00bb800640 1 -- 172.21.15.5:0/376459909 shutdown_connections 2024-08-17T02:46:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.465+0000 7f00bb800640 1 --2- 172.21.15.5:0/376459909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00b4151330 0x7f00b40a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.466+0000 7f00bb800640 1 --2- 172.21.15.5:0/376459909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b416a270 0x7f00b40a92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.466+0000 7f00bb800640 1 --2- 172.21.15.5:0/376459909 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f009c003aa0 0x7f00b415ded0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.466+0000 7f00bb800640 1 -- 172.21.15.5:0/376459909 >> 172.21.15.5:0/376459909 conn(0x7f00b4066e60 msgr2=0x7f00b4154d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.466+0000 7f00bb800640 1 -- 172.21.15.5:0/376459909 shutdown_connections 2024-08-17T02:46:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:34.466+0000 7f00bb800640 1 -- 172.21.15.5:0/376459909 wait complete. 2024-08-17T02:46:34.480 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:46:34.481 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:46:34.481 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:46:34.510 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:34.510+0000 7f6782c1aec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:46:34.538 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:46:34.538 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:46:34.634 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:46:34.634 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:46:34.667 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:34.666+0000 7f6782c1aec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:46:34.722 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-17T02:46:34.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:46:34.729 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:34.729+0000 7f6782c1aec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:46:34.785 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:46:34.785 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:46:34.843 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:46:34.843 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:46:34.866 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:34.866+0000 7fc3fac3aec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:46:34.922 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:46:34.922 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:46:35.017 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-08-17T02:46:35.017 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:46:35.017 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:35.016+0000 7fc3fac3aec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:46:35.072 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 7208b1d9-8c22-4f5f-8bff-f15936a8cd4f 0 2024-08-17T02:46:35.079 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:35.079+0000 7fc3fac3aec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:46:35.148 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:35.148+0000 7f6782c1aec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:46:35.201 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:35.201+0000 7f6782c1aec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:46:35.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.222+0000 7f7793200640 1 Processor -- start 2024-08-17T02:46:35.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.222+0000 7f7793200640 1 -- start start 2024-08-17T02:46:35.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.224+0000 7f7793200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7794156900 0x7f77940b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.224+0000 7f7793200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f77940ae7d0 0x7f77940ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.224+0000 7f7793200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77940b0b10 con 0x7f7794156cd0 2024-08-17T02:46:35.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.224+0000 7f7793200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77940b0df0 con 0x7f77940ae7d0 2024-08-17T02:46:35.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.224+0000 7f7793200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77940b10d0 con 0x7f7794156900 2024-08-17T02:46:35.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.224+0000 7f7791e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7794156900 0x7f77940b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.224+0000 7f7791400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f77940ae7d0 0x7f77940ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.224+0000 7f7791400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f77940ae7d0 0x7f77940ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35388/0 (socket says 172.21.15.107:35388) 2024-08-17T02:46:35.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.224+0000 7f7791400640 1 -- 172.21.15.107:0/2574208021 learned_addr learned my addr 172.21.15.107:0/2574208021 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:46:35.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.224+0000 7f7791e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7794156900 0x7f77940b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:54778/0 (socket says 172.21.15.107:54778) 2024-08-17T02:46:35.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.224+0000 7f7791400640 1 -- 172.21.15.107:0/2574208021 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7794156900 msgr2=0x7f77940b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:35.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.224+0000 7f7791400640 1 --2- 172.21.15.107:0/2574208021 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7794156900 0x7f77940b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.224+0000 7f7791400640 1 -- 172.21.15.107:0/2574208021 >> v1:172.21.15.5:6789/0 conn(0x7f7794156cd0 legacy=0x7f779415a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.224+0000 7f7791400640 1 -- 172.21.15.107:0/2574208021 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77940b13b0 con 0x7f77940ae7d0 2024-08-17T02:46:35.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.225+0000 7f7791400640 1 --2- 172.21.15.107:0/2574208021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77940ae7d0 0x7f77940ada70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7780009910 tx=0x7f77800091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=797889f0cb6ff782 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:35.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.226+0000 7f7790a00640 1 -- 172.21.15.107:0/2574208021 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778002adb0 con 0x7f77940ae7d0 2024-08-17T02:46:35.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.226+0000 7f7790a00640 1 -- 172.21.15.107:0/2574208021 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7780032440 con 0x7f77940ae7d0 2024-08-17T02:46:35.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.226+0000 7f7790a00640 1 -- 172.21.15.107:0/2574208021 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780032820 con 0x7f77940ae7d0 2024-08-17T02:46:35.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.226+0000 7f7793200640 1 -- 172.21.15.107:0/2574208021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77940ae7d0 msgr2=0x7f77940ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.226+0000 7f7793200640 1 --2- 172.21.15.107:0/2574208021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77940ae7d0 0x7f77940ada70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7780009910 tx=0x7f77800091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.226+0000 7f7793200640 1 -- 172.21.15.107:0/2574208021 shutdown_connections 2024-08-17T02:46:35.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.226+0000 7f7793200640 1 --2- 172.21.15.107:0/2574208021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77940ae7d0 0x7f77940ada70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.226+0000 7f7793200640 1 --2- 172.21.15.107:0/2574208021 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7794156900 0x7f77940b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.226+0000 7f7793200640 1 -- 172.21.15.107:0/2574208021 >> 172.21.15.107:0/2574208021 conn(0x7f7794067930 msgr2=0x7f77940cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:35.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.226+0000 7f7793200640 1 -- 172.21.15.107:0/2574208021 shutdown_connections 2024-08-17T02:46:35.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.227+0000 7f7793200640 1 -- 172.21.15.107:0/2574208021 wait complete. 2024-08-17T02:46:35.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.228+0000 7f7793200640 1 Processor -- start 2024-08-17T02:46:35.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.228+0000 7f7793200640 1 -- start start 2024-08-17T02:46:35.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.229+0000 7f7793200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77940ae7d0 0x7f7794168df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.229+0000 7f7793200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7794156900 0x7f779414cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.229+0000 7f7793200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7794156cd0 0x7f779414f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.229+0000 7f7793200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779414ad90 con 0x7f7794156cd0 2024-08-17T02:46:35.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.229+0000 7f7793200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7794158050 con 0x7f7794156900 2024-08-17T02:46:35.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.229+0000 7f7793200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7794158330 con 0x7f77940ae7d0 2024-08-17T02:46:35.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.229+0000 7f7791e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77940ae7d0 0x7f7794168df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.229+0000 7f7791400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7794156900 0x7f779414cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.229+0000 7f7791e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77940ae7d0 0x7f7794168df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:54782/0 (socket says 172.21.15.107:54782) 2024-08-17T02:46:35.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.229+0000 7f7791e00640 1 -- 172.21.15.107:0/3946920102 learned_addr learned my addr 172.21.15.107:0/3946920102 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:46:35.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.229+0000 7f7792800640 1 --2- 172.21.15.107:0/3946920102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7794156cd0 0x7f779414f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.230+0000 7f7791400640 1 -- 172.21.15.107:0/3946920102 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77940ae7d0 msgr2=0x7f7794168df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.230+0000 7f7791400640 1 --2- 172.21.15.107:0/3946920102 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77940ae7d0 0x7f7794168df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.230+0000 7f7791400640 1 -- 172.21.15.107:0/3946920102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7794156cd0 msgr2=0x7f779414f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.230+0000 7f7791400640 1 --2- 172.21.15.107:0/3946920102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7794156cd0 0x7f779414f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.230+0000 7f7791400640 1 -- 172.21.15.107:0/3946920102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7780009450 con 0x7f7794156900 2024-08-17T02:46:35.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.230+0000 7f7792800640 1 --2- 172.21.15.107:0/3946920102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7794156cd0 0x7f779414f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:35.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.230+0000 7f7791400640 1 --2- 172.21.15.107:0/3946920102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7794156900 0x7f779414cec0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7780031000 tx=0x7f7780032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:35.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.230+0000 7f7789600640 1 -- 172.21.15.107:0/3946920102 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780031bb0 con 0x7f7794156900 2024-08-17T02:46:35.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.230+0000 7f7789600640 1 -- 172.21.15.107:0/3946920102 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7780031d30 con 0x7f7794156900 2024-08-17T02:46:35.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.230+0000 7f7793200640 1 -- 172.21.15.107:0/3946920102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7794169330 con 0x7f7794156900 2024-08-17T02:46:35.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.230+0000 7f7789600640 1 -- 172.21.15.107:0/3946920102 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780031ea0 con 0x7f7794156900 2024-08-17T02:46:35.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.230+0000 7f7793200640 1 -- 172.21.15.107:0/3946920102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779414da00 con 0x7f7794156900 2024-08-17T02:46:35.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.230+0000 7f7789600640 1 -- 172.21.15.107:0/3946920102 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f7780039040 con 0x7f7794156900 2024-08-17T02:46:35.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.231+0000 7f7789600640 1 -- 172.21.15.107:0/3946920102 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f778003b880 con 0x7f7794156900 2024-08-17T02:46:35.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.231+0000 7f7793200640 1 -- 172.21.15.107:0/3946920102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7794070720 con 0x7f7794156900 2024-08-17T02:46:35.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.234+0000 7f7789600640 1 -- 172.21.15.107:0/3946920102 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f7780037070 con 0x7f7794156900 2024-08-17T02:46:35.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.308+0000 7f7793200640 1 -- 172.21.15.107:0/3946920102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7208b1d9-8c22-4f5f-8bff-f15936a8cd4f", "id": 0} v 0) v1 -- 0x7f7794158470 con 0x7f7794156900 2024-08-17T02:46:35.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.311+0000 7f7789600640 1 -- 172.21.15.107:0/3946920102 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7208b1d9-8c22-4f5f-8bff-f15936a8cd4f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f778003bb00 con 0x7f7794156900 2024-08-17T02:46:35.312 INFO:teuthology.orchestra.run.smithi107.stdout:0 2024-08-17T02:46:35.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.312+0000 7f7793200640 1 -- 172.21.15.107:0/3946920102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7794156900 msgr2=0x7f779414cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.312+0000 7f7793200640 1 --2- 172.21.15.107:0/3946920102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7794156900 0x7f779414cec0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7780031000 tx=0x7f7780032000 comp rx=0 tx=0).stop 2024-08-17T02:46:35.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.312+0000 7f7793200640 1 -- 172.21.15.107:0/3946920102 shutdown_connections 2024-08-17T02:46:35.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.312+0000 7f7793200640 1 --2- 172.21.15.107:0/3946920102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7794156cd0 0x7f779414f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.312+0000 7f7793200640 1 --2- 172.21.15.107:0/3946920102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7794156900 0x7f779414cec0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.312+0000 7f7793200640 1 --2- 172.21.15.107:0/3946920102 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77940ae7d0 0x7f7794168df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.312+0000 7f7793200640 1 -- 172.21.15.107:0/3946920102 >> 172.21.15.107:0/3946920102 conn(0x7f7794067930 msgr2=0x7f77940acb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:35.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.313+0000 7f7793200640 1 -- 172.21.15.107:0/3946920102 shutdown_connections 2024-08-17T02:46:35.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.313+0000 7f7793200640 1 -- 172.21.15.107:0/3946920102 wait complete. 2024-08-17T02:46:35.329 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 1766b5a8-d8a2-418f-b792-ec1a51b7c0a5 1 2024-08-17T02:46:35.373 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:35.372+0000 7fc3fac3aec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:46:35.426 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:35.425+0000 7fc3fac3aec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:46:35.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.473+0000 7f84a7e00640 1 Processor -- start 2024-08-17T02:46:35.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.473+0000 7f84a7e00640 1 -- start start 2024-08-17T02:46:35.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.474+0000 7f84a7e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f84a8158a00 0x7f84a8158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.474+0000 7f84a7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84a80cb190 0x7f84a80cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.474+0000 7f84a7e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a80cbc50 con 0x7f84a806e590 2024-08-17T02:46:35.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.474+0000 7f84a7e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a80cbf30 con 0x7f84a8158a00 2024-08-17T02:46:35.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.474+0000 7f84a7e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80cc210 con 0x7f84a80cb190 2024-08-17T02:46:35.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.474+0000 7f84a6a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f84a8158a00 0x7f84a8158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.474+0000 7f84a6a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f84a8158a00 0x7f84a8158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35414/0 (socket says 172.21.15.107:35414) 2024-08-17T02:46:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.474+0000 7f84a6a00640 1 -- 172.21.15.107:0/3549651552 learned_addr learned my addr 172.21.15.107:0/3549651552 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:46:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.474+0000 7f849fe00640 1 --2- 172.21.15.107:0/3549651552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84a80cb190 0x7f84a80cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.475+0000 7f84a6a00640 1 -- 172.21.15.107:0/3549651552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84a80cb190 msgr2=0x7f84a80cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.475+0000 7f84a6a00640 1 --2- 172.21.15.107:0/3549651552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84a80cb190 0x7f84a80cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.475+0000 7f84a6a00640 1 -- 172.21.15.107:0/3549651552 >> v1:172.21.15.107:6789/0 conn(0x7f84a806e590 legacy=0x7f84a80683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.475+0000 7f84a6a00640 1 -- 172.21.15.107:0/3549651552 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a80b2930 con 0x7f84a8158a00 2024-08-17T02:46:35.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.476+0000 7f84a6a00640 1 --2- 172.21.15.107:0/3549651552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84a8158a00 0x7f84a8158dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8498009910 tx=0x7f84980091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f844ae3ae926f04 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:35.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.476+0000 7f84a6000640 1 -- 172.21.15.107:0/3549651552 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849802ae60 con 0x7f84a8158a00 2024-08-17T02:46:35.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.476+0000 7f84a6000640 1 -- 172.21.15.107:0/3549651552 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8498032440 con 0x7f84a8158a00 2024-08-17T02:46:35.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.476+0000 7f84a6000640 1 -- 172.21.15.107:0/3549651552 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84980327e0 con 0x7f84a8158a00 2024-08-17T02:46:35.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.476+0000 7f84a7e00640 1 -- 172.21.15.107:0/3549651552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84a8158a00 msgr2=0x7f84a8158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.476+0000 7f84a7e00640 1 --2- 172.21.15.107:0/3549651552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84a8158a00 0x7f84a8158dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8498009910 tx=0x7f84980091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.477+0000 7f84a7e00640 1 -- 172.21.15.107:0/3549651552 shutdown_connections 2024-08-17T02:46:35.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.477+0000 7f84a7e00640 1 --2- 172.21.15.107:0/3549651552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84a80cb190 0x7f84a80cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.477+0000 7f84a7e00640 1 --2- 172.21.15.107:0/3549651552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84a8158a00 0x7f84a8158dd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.477+0000 7f84a7e00640 1 -- 172.21.15.107:0/3549651552 >> 172.21.15.107:0/3549651552 conn(0x7f84a80cfb80 msgr2=0x7f84a80cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:35.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.477+0000 7f84a7e00640 1 -- 172.21.15.107:0/3549651552 shutdown_connections 2024-08-17T02:46:35.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.477+0000 7f84a7e00640 1 -- 172.21.15.107:0/3549651552 wait complete. 2024-08-17T02:46:35.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.478+0000 7f84a7e00640 1 Processor -- start 2024-08-17T02:46:35.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.478+0000 7f84a7e00640 1 -- start start 2024-08-17T02:46:35.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.479+0000 7f84a7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a806e590 0x7f84a815a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.479+0000 7f84a7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84a80cb190 0x7f84a80c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.479+0000 7f84a7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84a8158a00 0x7f84a814f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.479+0000 7f84a7e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a816a1a0 con 0x7f84a806e590 2024-08-17T02:46:35.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.479+0000 7f84a7e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a8169900 con 0x7f84a80cb190 2024-08-17T02:46:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.479+0000 7f84a7e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a8169be0 con 0x7f84a8158a00 2024-08-17T02:46:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.479+0000 7f849fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84a80cb190 0x7f84a80c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.479+0000 7f849fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84a80cb190 0x7f84a80c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35416/0 (socket says 172.21.15.107:35416) 2024-08-17T02:46:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.479+0000 7f849fe00640 1 -- 172.21.15.107:0/777912592 learned_addr learned my addr 172.21.15.107:0/777912592 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:46:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.479+0000 7f84a7400640 1 --2- 172.21.15.107:0/777912592 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84a8158a00 0x7f84a814f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.479+0000 7f84a6a00640 1 --2- 172.21.15.107:0/777912592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a806e590 0x7f84a815a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.480+0000 7f849fe00640 1 -- 172.21.15.107:0/777912592 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84a8158a00 msgr2=0x7f84a814f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.480+0000 7f849fe00640 1 --2- 172.21.15.107:0/777912592 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84a8158a00 0x7f84a814f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.480+0000 7f849fe00640 1 -- 172.21.15.107:0/777912592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a806e590 msgr2=0x7f84a815a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.480+0000 7f849fe00640 1 --2- 172.21.15.107:0/777912592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a806e590 0x7f84a815a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.480+0000 7f849fe00640 1 -- 172.21.15.107:0/777912592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8498009450 con 0x7f84a80cb190 2024-08-17T02:46:35.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.480+0000 7f84a6a00640 1 --2- 172.21.15.107:0/777912592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a806e590 0x7f84a815a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:35.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.480+0000 7f849fe00640 1 --2- 172.21.15.107:0/777912592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84a80cb190 0x7f84a80c7a10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f849000d890 tx=0x7f8490008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:35.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.480+0000 7f849e000640 1 -- 172.21.15.107:0/777912592 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849000de20 con 0x7f84a80cb190 2024-08-17T02:46:35.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.480+0000 7f849e000640 1 -- 172.21.15.107:0/777912592 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849000b8d0 con 0x7f84a80cb190 2024-08-17T02:46:35.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.480+0000 7f849e000640 1 -- 172.21.15.107:0/777912592 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849000bc70 con 0x7f84a80cb190 2024-08-17T02:46:35.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.480+0000 7f84a7e00640 1 -- 172.21.15.107:0/777912592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a8169ec0 con 0x7f84a80cb190 2024-08-17T02:46:35.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.480+0000 7f84a7e00640 1 -- 172.21.15.107:0/777912592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a81691e0 con 0x7f84a80cb190 2024-08-17T02:46:35.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.480+0000 7f849e000640 1 -- 172.21.15.107:0/777912592 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f84900148d0 con 0x7f84a80cb190 2024-08-17T02:46:35.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.481+0000 7f849e000640 1 -- 172.21.15.107:0/777912592 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f849001e4f0 con 0x7f84a80cb190 2024-08-17T02:46:35.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.481+0000 7f84a7e00640 1 -- 172.21.15.107:0/777912592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a80c8830 con 0x7f84a80cb190 2024-08-17T02:46:35.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.484+0000 7f849e000640 1 -- 172.21.15.107:0/777912592 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f8490014dd0 con 0x7f84a80cb190 2024-08-17T02:46:35.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.557+0000 7f84a7e00640 1 -- 172.21.15.107:0/777912592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1766b5a8-d8a2-418f-b792-ec1a51b7c0a5", "id": 1} v 0) v1 -- 0x7f84a8070720 con 0x7f84a80cb190 2024-08-17T02:46:35.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.561+0000 7f849e000640 1 -- 172.21.15.107:0/777912592 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1766b5a8-d8a2-418f-b792-ec1a51b7c0a5", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f849001e6b0 con 0x7f84a80cb190 2024-08-17T02:46:35.562 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-08-17T02:46:35.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.562+0000 7f84a7e00640 1 -- 172.21.15.107:0/777912592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84a80cb190 msgr2=0x7f84a80c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.562+0000 7f84a7e00640 1 --2- 172.21.15.107:0/777912592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84a80cb190 0x7f84a80c7a10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f849000d890 tx=0x7f8490008040 comp rx=0 tx=0).stop 2024-08-17T02:46:35.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.562+0000 7f84a7e00640 1 -- 172.21.15.107:0/777912592 shutdown_connections 2024-08-17T02:46:35.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.562+0000 7f84a7e00640 1 --2- 172.21.15.107:0/777912592 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f84a8158a00 0x7f84a814f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.562+0000 7f84a7e00640 1 --2- 172.21.15.107:0/777912592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84a80cb190 0x7f84a80c7a10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.562+0000 7f84a7e00640 1 --2- 172.21.15.107:0/777912592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a806e590 0x7f84a815a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.562+0000 7f84a7e00640 1 -- 172.21.15.107:0/777912592 >> 172.21.15.107:0/777912592 conn(0x7f84a80cfb80 msgr2=0x7f84a80cff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:35.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.562+0000 7f84a7e00640 1 -- 172.21.15.107:0/777912592 shutdown_connections 2024-08-17T02:46:35.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.562+0000 7f84a7e00640 1 -- 172.21.15.107:0/777912592 wait complete. 2024-08-17T02:46:35.577 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 73126905-9aa6-45ae-977f-1fdef3ac5e3a 2 2024-08-17T02:46:35.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.759+0000 7f258a600640 1 Processor -- start 2024-08-17T02:46:35.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.759+0000 7f258a600640 1 -- start start 2024-08-17T02:46:35.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.760+0000 7f258a600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2584158dd0 0x7f258406e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.760+0000 7f258a600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258406eed0 con 0x7f2584158a00 2024-08-17T02:46:35.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.760+0000 7f258a600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25840cbc50 con 0x7f258406ead0 2024-08-17T02:46:35.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.760+0000 7f258a600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2584159230 con 0x7f2584158dd0 2024-08-17T02:46:35.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.760+0000 7f2583e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2584158dd0 0x7f258406e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.760+0000 7f2583e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2584158dd0 0x7f258406e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35426/0 (socket says 172.21.15.107:35426) 2024-08-17T02:46:35.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.760+0000 7f2583e00640 1 -- 172.21.15.107:0/3217173043 learned_addr learned my addr 172.21.15.107:0/3217173043 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:46:35.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.761+0000 7f2583e00640 1 -- 172.21.15.107:0/3217173043 >> v1:172.21.15.107:6789/0 conn(0x7f258406ead0 legacy=0x7f25840b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.761+0000 7f2583e00640 1 -- 172.21.15.107:0/3217173043 >> v1:172.21.15.5:6789/0 conn(0x7f2584158a00 legacy=0x7f25840cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.761+0000 7f2583e00640 1 -- 172.21.15.107:0/3217173043 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25840cbf30 con 0x7f2584158dd0 2024-08-17T02:46:35.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.762+0000 7f2583e00640 1 --2- 172.21.15.107:0/3217173043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584158dd0 0x7f258406e590 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2570009910 tx=0x7f25700091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a4eb347407e7a57 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:35.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.762+0000 7f2583400640 1 -- 172.21.15.107:0/3217173043 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570032440 con 0x7f2584158dd0 2024-08-17T02:46:35.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.762+0000 7f2583400640 1 -- 172.21.15.107:0/3217173043 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25700325a0 con 0x7f2584158dd0 2024-08-17T02:46:35.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.762+0000 7f2583400640 1 -- 172.21.15.107:0/3217173043 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570032980 con 0x7f2584158dd0 2024-08-17T02:46:35.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.763+0000 7f258a600640 1 -- 172.21.15.107:0/3217173043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584158dd0 msgr2=0x7f258406e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.763+0000 7f258a600640 1 --2- 172.21.15.107:0/3217173043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584158dd0 0x7f258406e590 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2570009910 tx=0x7f25700091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.763+0000 7f258a600640 1 -- 172.21.15.107:0/3217173043 shutdown_connections 2024-08-17T02:46:35.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.763+0000 7f258a600640 1 --2- 172.21.15.107:0/3217173043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584158dd0 0x7f258406e590 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.763+0000 7f258a600640 1 -- 172.21.15.107:0/3217173043 >> 172.21.15.107:0/3217173043 conn(0x7f25840cfb80 msgr2=0x7f25840cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:35.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.763+0000 7f258a600640 1 -- 172.21.15.107:0/3217173043 shutdown_connections 2024-08-17T02:46:35.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.763+0000 7f258a600640 1 -- 172.21.15.107:0/3217173043 wait complete. 2024-08-17T02:46:35.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.764+0000 7f258a600640 1 Processor -- start 2024-08-17T02:46:35.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.764+0000 7f258a600640 1 -- start start 2024-08-17T02:46:35.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.765+0000 7f258a600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258406ead0 0x7f258416c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.765+0000 7f258a600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2584158a00 0x7f2584148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.765+0000 7f258a600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584158dd0 0x7f258415c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:35.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.765+0000 7f258a600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25840c94f0 con 0x7f258406ead0 2024-08-17T02:46:35.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.765+0000 7f258a600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25840c6c30 con 0x7f2584158dd0 2024-08-17T02:46:35.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.765+0000 7f258a600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258416cf90 con 0x7f2584158a00 2024-08-17T02:46:35.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.765+0000 7f2583e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2584158a00 0x7f2584148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.765+0000 7f2583e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2584158a00 0x7f2584148e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:54802/0 (socket says 172.21.15.107:54802) 2024-08-17T02:46:35.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.765+0000 7f2583e00640 1 -- 172.21.15.107:0/958581989 learned_addr learned my addr 172.21.15.107:0/958581989 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:46:35.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.765+0000 7f2589c00640 1 --2- 172.21.15.107:0/958581989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584158dd0 0x7f258415c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.766+0000 7f2589200640 1 --2- 172.21.15.107:0/958581989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258406ead0 0x7f258416c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:35.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.766+0000 7f2583e00640 1 -- 172.21.15.107:0/958581989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584158dd0 msgr2=0x7f258415c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.766+0000 7f2583e00640 1 --2- 172.21.15.107:0/958581989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584158dd0 0x7f258415c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.766+0000 7f2583e00640 1 -- 172.21.15.107:0/958581989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258406ead0 msgr2=0x7f258416c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.766+0000 7f2583e00640 1 --2- 172.21.15.107:0/958581989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258406ead0 0x7f258416c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.766+0000 7f2583e00640 1 -- 172.21.15.107:0/958581989 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2570009450 con 0x7f2584158a00 2024-08-17T02:46:35.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.766+0000 7f2589200640 1 --2- 172.21.15.107:0/958581989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258406ead0 0x7f258416c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:35.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.766+0000 7f2583e00640 1 --2- 172.21.15.107:0/958581989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2584158a00 0x7f2584148e60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2570009970 tx=0x7f2570032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:35.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.766+0000 7f2577e00640 1 -- 172.21.15.107:0/958581989 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570031c80 con 0x7f2584158a00 2024-08-17T02:46:35.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.766+0000 7f2577e00640 1 -- 172.21.15.107:0/958581989 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2570031e00 con 0x7f2584158a00 2024-08-17T02:46:35.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.766+0000 7f258a600640 1 -- 172.21.15.107:0/958581989 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258416d270 con 0x7f2584158a00 2024-08-17T02:46:35.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.766+0000 7f2577e00640 1 -- 172.21.15.107:0/958581989 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257003d670 con 0x7f2584158a00 2024-08-17T02:46:35.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.767+0000 7f258a600640 1 -- 172.21.15.107:0/958581989 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25841493a0 con 0x7f2584158a00 2024-08-17T02:46:35.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.767+0000 7f2577e00640 1 -- 172.21.15.107:0/958581989 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f2570039040 con 0x7f2584158a00 2024-08-17T02:46:35.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.767+0000 7f2577e00640 1 -- 172.21.15.107:0/958581989 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f257003dcf0 con 0x7f2584158a00 2024-08-17T02:46:35.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.768+0000 7f258a600640 1 -- 172.21.15.107:0/958581989 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2584070720 con 0x7f2584158a00 2024-08-17T02:46:35.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.772+0000 7f2577e00640 1 -- 172.21.15.107:0/958581989 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f2570042070 con 0x7f2584158a00 2024-08-17T02:46:35.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.844+0000 7f258a600640 1 -- 172.21.15.107:0/958581989 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd new", "uuid": "73126905-9aa6-45ae-977f-1fdef3ac5e3a", "id": 2} v 0) v1 -- 0x7f25840b22b0 con 0x7f2584158a00 2024-08-17T02:46:35.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.848+0000 7f2577e00640 1 -- 172.21.15.107:0/958581989 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "73126905-9aa6-45ae-977f-1fdef3ac5e3a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2570037070 con 0x7f2584158a00 2024-08-17T02:46:35.849 INFO:teuthology.orchestra.run.smithi107.stdout:2 2024-08-17T02:46:35.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.849+0000 7f258a600640 1 -- 172.21.15.107:0/958581989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2584158a00 msgr2=0x7f2584148e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:35.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.849+0000 7f258a600640 1 --2- 172.21.15.107:0/958581989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2584158a00 0x7f2584148e60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2570009970 tx=0x7f2570032000 comp rx=0 tx=0).stop 2024-08-17T02:46:35.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.849+0000 7f258a600640 1 -- 172.21.15.107:0/958581989 shutdown_connections 2024-08-17T02:46:35.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.849+0000 7f258a600640 1 --2- 172.21.15.107:0/958581989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2584158dd0 0x7f258415c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.849+0000 7f258a600640 1 --2- 172.21.15.107:0/958581989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2584158a00 0x7f2584148e60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.849+0000 7f258a600640 1 --2- 172.21.15.107:0/958581989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258406ead0 0x7f258416c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:35.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.849+0000 7f258a600640 1 -- 172.21.15.107:0/958581989 >> 172.21.15.107:0/958581989 conn(0x7f25840cfb80 msgr2=0x7f25840cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:35.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.849+0000 7f258a600640 1 -- 172.21.15.107:0/958581989 shutdown_connections 2024-08-17T02:46:35.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:35.849+0000 7f258a600640 1 -- 172.21.15.107:0/958581989 wait complete. 2024-08-17T02:46:35.864 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 60ed3139-2a99-499e-b113-cc38ce4489c3 3 2024-08-17T02:46:36.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.010+0000 7f4673200640 1 Processor -- start 2024-08-17T02:46:36.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.010+0000 7f4673200640 1 -- start start 2024-08-17T02:46:36.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.011+0000 7f4673200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4674158a00 0x7f4674158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.011+0000 7f4673200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f467406eca0 0x7f46740cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.011+0000 7f4673200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46740cbc50 con 0x7f46740cb190 2024-08-17T02:46:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.011+0000 7f4673200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46740cbf30 con 0x7f467406eca0 2024-08-17T02:46:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.011+0000 7f4673200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46740cc210 con 0x7f4674158a00 2024-08-17T02:46:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.011+0000 7f4671e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4674158a00 0x7f4674158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.011+0000 7f4671e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4674158a00 0x7f4674158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35444/0 (socket says 172.21.15.107:35444) 2024-08-17T02:46:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.011+0000 7f4671e00640 1 -- 172.21.15.107:0/2603539238 learned_addr learned my addr 172.21.15.107:0/2603539238 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:46:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.012+0000 7f4672800640 1 --2- 172.21.15.107:0/2603539238 >> v2:172.21.15.5:3300/0 conn(0x7f467406eca0 0x7f46740cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.012+0000 7f4671e00640 1 -- 172.21.15.107:0/2603539238 >> v2:172.21.15.5:3300/0 conn(0x7f467406eca0 msgr2=0x7f46740cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:36.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.012+0000 7f4671e00640 1 --2- 172.21.15.107:0/2603539238 >> v2:172.21.15.5:3300/0 conn(0x7f467406eca0 0x7f46740cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.012+0000 7f4671e00640 1 -- 172.21.15.107:0/2603539238 >> v1:172.21.15.107:6789/0 conn(0x7f46740cb190 legacy=0x7f467406e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.012+0000 7f4671e00640 1 -- 172.21.15.107:0/2603539238 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46740b2930 con 0x7f4674158a00 2024-08-17T02:46:36.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.013+0000 7f4671e00640 1 --2- 172.21.15.107:0/2603539238 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4674158a00 0x7f4674158dd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f46740cfae0 tx=0x7f46640091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41262d2b5e2758da server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.013+0000 7f4670a00640 1 -- 172.21.15.107:0/2603539238 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466402ae80 con 0x7f4674158a00 2024-08-17T02:46:36.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.013+0000 7f4670a00640 1 -- 172.21.15.107:0/2603539238 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4664032440 con 0x7f4674158a00 2024-08-17T02:46:36.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.013+0000 7f4670a00640 1 -- 172.21.15.107:0/2603539238 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664032800 con 0x7f4674158a00 2024-08-17T02:46:36.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.014+0000 7f4673200640 1 -- 172.21.15.107:0/2603539238 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4674158a00 msgr2=0x7f4674158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.014+0000 7f4673200640 1 --2- 172.21.15.107:0/2603539238 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4674158a00 0x7f4674158dd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f46740cfae0 tx=0x7f46640091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.014+0000 7f4673200640 1 -- 172.21.15.107:0/2603539238 shutdown_connections 2024-08-17T02:46:36.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.014+0000 7f4673200640 1 --2- 172.21.15.107:0/2603539238 >> v2:172.21.15.5:3300/0 conn(0x7f467406eca0 0x7f46740cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.014+0000 7f4673200640 1 --2- 172.21.15.107:0/2603539238 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4674158a00 0x7f4674158dd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.014+0000 7f4673200640 1 -- 172.21.15.107:0/2603539238 >> 172.21.15.107:0/2603539238 conn(0x7f46740cfb80 msgr2=0x7f46740cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:36.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.014+0000 7f4673200640 1 -- 172.21.15.107:0/2603539238 shutdown_connections 2024-08-17T02:46:36.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.014+0000 7f4673200640 1 -- 172.21.15.107:0/2603539238 wait complete. 2024-08-17T02:46:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.015+0000 7f4673200640 1 Processor -- start 2024-08-17T02:46:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.015+0000 7f4673200640 1 -- start start 2024-08-17T02:46:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.016+0000 7f4673200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f467406eca0 0x7f4674169f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.016+0000 7f4673200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46740cb190 0x7f4674150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.016+0000 7f4673200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4674158a00 0x7f46740c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.016+0000 7f4673200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46740c6b90 con 0x7f46740cb190 2024-08-17T02:46:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.016+0000 7f4673200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46740c7710 con 0x7f4674158a00 2024-08-17T02:46:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.016+0000 7f4673200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46740c6de0 con 0x7f467406eca0 2024-08-17T02:46:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.017+0000 7f4672800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4674158a00 0x7f46740c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.017+0000 7f4671e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f467406eca0 0x7f4674169f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.017+0000 7f4671e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f467406eca0 0x7f4674169f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:54810/0 (socket says 172.21.15.107:54810) 2024-08-17T02:46:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.017+0000 7f4671e00640 1 -- 172.21.15.107:0/998027461 learned_addr learned my addr 172.21.15.107:0/998027461 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:46:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.017+0000 7f4672800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4674158a00 0x7f46740c9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35460/0 (socket says 172.21.15.107:35460) 2024-08-17T02:46:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.017+0000 7f4671400640 1 --2- 172.21.15.107:0/998027461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46740cb190 0x7f4674150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.017+0000 7f4671e00640 1 -- 172.21.15.107:0/998027461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4674158a00 msgr2=0x7f46740c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.017+0000 7f4671e00640 1 --2- 172.21.15.107:0/998027461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4674158a00 0x7f46740c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.017+0000 7f4671e00640 1 -- 172.21.15.107:0/998027461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46740cb190 msgr2=0x7f4674150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.017+0000 7f4671e00640 1 --2- 172.21.15.107:0/998027461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46740cb190 0x7f4674150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.017+0000 7f4671e00640 1 -- 172.21.15.107:0/998027461 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4664009450 con 0x7f467406eca0 2024-08-17T02:46:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.017+0000 7f4671e00640 1 --2- 172.21.15.107:0/998027461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f467406eca0 0x7f4674169f20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4664009940 tx=0x7f4664032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.018+0000 7f4669600640 1 -- 172.21.15.107:0/998027461 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664031bb0 con 0x7f467406eca0 2024-08-17T02:46:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.018+0000 7f4669600640 1 -- 172.21.15.107:0/998027461 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4664031d10 con 0x7f467406eca0 2024-08-17T02:46:36.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.018+0000 7f4673200640 1 -- 172.21.15.107:0/998027461 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46740c70c0 con 0x7f467406eca0 2024-08-17T02:46:36.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.018+0000 7f4669600640 1 -- 172.21.15.107:0/998027461 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466403d690 con 0x7f467406eca0 2024-08-17T02:46:36.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.018+0000 7f4673200640 1 -- 172.21.15.107:0/998027461 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4674150640 con 0x7f467406eca0 2024-08-17T02:46:36.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.018+0000 7f4669600640 1 -- 172.21.15.107:0/998027461 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f4664039040 con 0x7f467406eca0 2024-08-17T02:46:36.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.018+0000 7f4669600640 1 -- 172.21.15.107:0/998027461 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f466403dde0 con 0x7f467406eca0 2024-08-17T02:46:36.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.019+0000 7f4673200640 1 -- 172.21.15.107:0/998027461 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4674150830 con 0x7f467406eca0 2024-08-17T02:46:36.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.022+0000 7f4669600640 1 -- 172.21.15.107:0/998027461 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f4674150830 con 0x7f467406eca0 2024-08-17T02:46:36.083 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:36.083+0000 7f6782c1aec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:46:36.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.097+0000 7f4673200640 1 -- 172.21.15.107:0/998027461 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd new", "uuid": "60ed3139-2a99-499e-b113-cc38ce4489c3", "id": 3} v 0) v1 -- 0x7f46740c7540 con 0x7f467406eca0 2024-08-17T02:46:36.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.102+0000 7f4669600640 1 -- 172.21.15.107:0/998027461 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "60ed3139-2a99-499e-b113-cc38ce4489c3", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4664042070 con 0x7f467406eca0 2024-08-17T02:46:36.102 INFO:teuthology.orchestra.run.smithi107.stdout:3 2024-08-17T02:46:36.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.103+0000 7f4673200640 1 -- 172.21.15.107:0/998027461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f467406eca0 msgr2=0x7f4674169f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.103+0000 7f4673200640 1 --2- 172.21.15.107:0/998027461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f467406eca0 0x7f4674169f20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4664009940 tx=0x7f4664032000 comp rx=0 tx=0).stop 2024-08-17T02:46:36.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.103+0000 7f4673200640 1 -- 172.21.15.107:0/998027461 shutdown_connections 2024-08-17T02:46:36.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.103+0000 7f4673200640 1 --2- 172.21.15.107:0/998027461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4674158a00 0x7f46740c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.103+0000 7f4673200640 1 --2- 172.21.15.107:0/998027461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46740cb190 0x7f4674150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.103+0000 7f4673200640 1 --2- 172.21.15.107:0/998027461 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f467406eca0 0x7f4674169f20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.103+0000 7f4673200640 1 -- 172.21.15.107:0/998027461 >> 172.21.15.107:0/998027461 conn(0x7f46740cfb80 msgr2=0x7f46740cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:36.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.103+0000 7f4673200640 1 -- 172.21.15.107:0/998027461 shutdown_connections 2024-08-17T02:46:36.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.103+0000 7f4673200640 1 -- 172.21.15.107:0/998027461 wait complete. 2024-08-17T02:46:36.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 6640fd16-835f-4242-b9f5-d0b2e5deeb0d 4 2024-08-17T02:46:36.186 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:36.186+0000 7f6782c1aec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:46:36.237 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:36.237+0000 7f6782c1aec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:46:36.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.262+0000 7f4d53e00640 1 Processor -- start 2024-08-17T02:46:36.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.262+0000 7f4d53e00640 1 -- start start 2024-08-17T02:46:36.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.263+0000 7f4d53e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4d54158dd0 0x7f4d5406e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.263+0000 7f4d53e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d5406ead0 0x7f4d540b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.264+0000 7f4d53e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5406eed0 con 0x7f4d54158a00 2024-08-17T02:46:36.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.264+0000 7f4d53e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d54159230 con 0x7f4d5406ead0 2024-08-17T02:46:36.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.264+0000 7f4d53e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d540cbc50 con 0x7f4d54158dd0 2024-08-17T02:46:36.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.264+0000 7f4d52000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4d54158dd0 0x7f4d5406e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.264+0000 7f4d52000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4d54158dd0 0x7f4d5406e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35472/0 (socket says 172.21.15.107:35472) 2024-08-17T02:46:36.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.264+0000 7f4d52000640 1 -- 172.21.15.107:0/4273926043 learned_addr learned my addr 172.21.15.107:0/4273926043 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:46:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.264+0000 7f4d53400640 1 --2- 172.21.15.107:0/4273926043 >> v2:172.21.15.5:3300/0 conn(0x7f4d5406ead0 0x7f4d540b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.264+0000 7f4d52000640 1 -- 172.21.15.107:0/4273926043 >> v2:172.21.15.5:3300/0 conn(0x7f4d5406ead0 msgr2=0x7f4d540b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.264+0000 7f4d52000640 1 --2- 172.21.15.107:0/4273926043 >> v2:172.21.15.5:3300/0 conn(0x7f4d5406ead0 0x7f4d540b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.264+0000 7f4d52000640 1 -- 172.21.15.107:0/4273926043 >> v1:172.21.15.107:6789/0 conn(0x7f4d54158a00 legacy=0x7f4d540cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.264+0000 7f4d52000640 1 -- 172.21.15.107:0/4273926043 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540cbf30 con 0x7f4d54158dd0 2024-08-17T02:46:36.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.265+0000 7f4d52000640 1 --2- 172.21.15.107:0/4273926043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d54158dd0 0x7f4d5406e590 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4d540ca0b0 tx=0x7f4d400091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76da1346f2e8a9ae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.265+0000 7f4d51600640 1 -- 172.21.15.107:0/4273926043 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4002ae80 con 0x7f4d54158dd0 2024-08-17T02:46:36.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.265+0000 7f4d51600640 1 -- 172.21.15.107:0/4273926043 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d40032440 con 0x7f4d54158dd0 2024-08-17T02:46:36.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.265+0000 7f4d51600640 1 -- 172.21.15.107:0/4273926043 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40032800 con 0x7f4d54158dd0 2024-08-17T02:46:36.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.266+0000 7f4d53e00640 1 -- 172.21.15.107:0/4273926043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d54158dd0 msgr2=0x7f4d5406e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.266+0000 7f4d53e00640 1 --2- 172.21.15.107:0/4273926043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d54158dd0 0x7f4d5406e590 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4d540ca0b0 tx=0x7f4d400091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.266+0000 7f4d53e00640 1 -- 172.21.15.107:0/4273926043 shutdown_connections 2024-08-17T02:46:36.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.266+0000 7f4d53e00640 1 --2- 172.21.15.107:0/4273926043 >> v2:172.21.15.5:3300/0 conn(0x7f4d5406ead0 0x7f4d540b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.266+0000 7f4d53e00640 1 --2- 172.21.15.107:0/4273926043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d54158dd0 0x7f4d5406e590 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.266+0000 7f4d53e00640 1 -- 172.21.15.107:0/4273926043 >> 172.21.15.107:0/4273926043 conn(0x7f4d540cfb80 msgr2=0x7f4d540cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:36.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.266+0000 7f4d53e00640 1 -- 172.21.15.107:0/4273926043 shutdown_connections 2024-08-17T02:46:36.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.266+0000 7f4d53e00640 1 -- 172.21.15.107:0/4273926043 wait complete. 2024-08-17T02:46:36.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.268+0000 7f4d53e00640 1 Processor -- start 2024-08-17T02:46:36.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.268+0000 7f4d53e00640 1 -- start start 2024-08-17T02:46:36.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.269+0000 7f4d53e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d5406ead0 0x7f4d5415c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.269+0000 7f4d53e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d54158a00 0x7f4d540c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.269+0000 7f4d53e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d54158dd0 0x7f4d54157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.269+0000 7f4d53e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540c68a0 con 0x7f4d54158a00 2024-08-17T02:46:36.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.269+0000 7f4d53e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5415d8f0 con 0x7f4d5406ead0 2024-08-17T02:46:36.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.269+0000 7f4d53e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5415cce0 con 0x7f4d54158dd0 2024-08-17T02:46:36.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.269+0000 7f4d52a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d5406ead0 0x7f4d5415c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.269+0000 7f4d53400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d54158dd0 0x7f4d54157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.269+0000 7f4d52a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d5406ead0 0x7f4d5415c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35484/0 (socket says 172.21.15.107:35484) 2024-08-17T02:46:36.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.269+0000 7f4d52000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d54158a00 0x7f4d540c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.269+0000 7f4d53400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d54158dd0 0x7f4d54157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:54816/0 (socket says 172.21.15.107:54816) 2024-08-17T02:46:36.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.269+0000 7f4d52a00640 1 -- 172.21.15.107:0/3059474011 learned_addr learned my addr 172.21.15.107:0/3059474011 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:46:36.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.270+0000 7f4d52a00640 1 -- 172.21.15.107:0/3059474011 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d54158dd0 msgr2=0x7f4d54157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.270+0000 7f4d52a00640 1 --2- 172.21.15.107:0/3059474011 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d54158dd0 0x7f4d54157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.270+0000 7f4d52a00640 1 -- 172.21.15.107:0/3059474011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d54158a00 msgr2=0x7f4d540c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.270+0000 7f4d52a00640 1 --2- 172.21.15.107:0/3059474011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d54158a00 0x7f4d540c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.270+0000 7f4d52a00640 1 -- 172.21.15.107:0/3059474011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d40009450 con 0x7f4d5406ead0 2024-08-17T02:46:36.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.270+0000 7f4d52000640 1 --2- 172.21.15.107:0/3059474011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d54158a00 0x7f4d540c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:36.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.270+0000 7f4d52a00640 1 --2- 172.21.15.107:0/3059474011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d5406ead0 0x7f4d5415c650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400c560 tx=0x7f4d44007ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.270+0000 7f4d4a000640 1 -- 172.21.15.107:0/3059474011 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44011590 con 0x7f4d5406ead0 2024-08-17T02:46:36.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.270+0000 7f4d4a000640 1 -- 172.21.15.107:0/3059474011 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d44011710 con 0x7f4d5406ead0 2024-08-17T02:46:36.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.270+0000 7f4d4a000640 1 -- 172.21.15.107:0/3059474011 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44011ad0 con 0x7f4d5406ead0 2024-08-17T02:46:36.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.270+0000 7f4d53e00640 1 -- 172.21.15.107:0/3059474011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5415cfc0 con 0x7f4d5406ead0 2024-08-17T02:46:36.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.270+0000 7f4d53e00640 1 -- 172.21.15.107:0/3059474011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5415d580 con 0x7f4d5406ead0 2024-08-17T02:46:36.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.271+0000 7f4d4a000640 1 -- 172.21.15.107:0/3059474011 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f4d4401c440 con 0x7f4d5406ead0 2024-08-17T02:46:36.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.271+0000 7f4d4a000640 1 -- 172.21.15.107:0/3059474011 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f4d44012930 con 0x7f4d5406ead0 2024-08-17T02:46:36.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.271+0000 7f4d53e00640 1 -- 172.21.15.107:0/3059474011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d54070720 con 0x7f4d5406ead0 2024-08-17T02:46:36.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.275+0000 7f4d4a000640 1 -- 172.21.15.107:0/3059474011 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f4d44017070 con 0x7f4d5406ead0 2024-08-17T02:46:36.303 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:36.303+0000 7fc3fac3aec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:46:36.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.350+0000 7f4d53e00640 1 -- 172.21.15.107:0/3059474011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6640fd16-835f-4242-b9f5-d0b2e5deeb0d", "id": 4} v 0) v1 -- 0x7f4d54063f30 con 0x7f4d5406ead0 2024-08-17T02:46:36.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.354+0000 7f4d4a000640 1 -- 172.21.15.107:0/3059474011 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6640fd16-835f-4242-b9f5-d0b2e5deeb0d", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4d4401c920 con 0x7f4d5406ead0 2024-08-17T02:46:36.355 INFO:teuthology.orchestra.run.smithi107.stdout:4 2024-08-17T02:46:36.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.355+0000 7f4d53e00640 1 -- 172.21.15.107:0/3059474011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d5406ead0 msgr2=0x7f4d5415c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.355+0000 7f4d53e00640 1 --2- 172.21.15.107:0/3059474011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d5406ead0 0x7f4d5415c650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400c560 tx=0x7f4d44007ef0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.355+0000 7f4d53e00640 1 -- 172.21.15.107:0/3059474011 shutdown_connections 2024-08-17T02:46:36.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.355+0000 7f4d53e00640 1 --2- 172.21.15.107:0/3059474011 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d54158dd0 0x7f4d54157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.355+0000 7f4d53e00640 1 --2- 172.21.15.107:0/3059474011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d54158a00 0x7f4d540c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.355+0000 7f4d53e00640 1 --2- 172.21.15.107:0/3059474011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d5406ead0 0x7f4d5415c650 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.355+0000 7f4d53e00640 1 -- 172.21.15.107:0/3059474011 >> 172.21.15.107:0/3059474011 conn(0x7f4d540cfb80 msgr2=0x7f4d540cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:36.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.355+0000 7f4d53e00640 1 -- 172.21.15.107:0/3059474011 shutdown_connections 2024-08-17T02:46:36.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.355+0000 7f4d53e00640 1 -- 172.21.15.107:0/3059474011 wait complete. 2024-08-17T02:46:36.371 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 6a70b251-0ed3-47d8-979a-f2a58a3421ba 5 2024-08-17T02:46:36.410 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:36.408+0000 7fc3fac3aec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:46:36.413 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:36.413+0000 7f6782c1aec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:46:36.460 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:36.459+0000 7fc3fac3aec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:46:36.470 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:36.470+0000 7f6782c1aec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:46:36.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.515+0000 7f4491200640 1 Processor -- start 2024-08-17T02:46:36.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.515+0000 7f4491200640 1 -- start start 2024-08-17T02:46:36.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.516+0000 7f4491200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f448c1588d0 0x7f448c0ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.516+0000 7f4491200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f448c0cf900 0x7f448c0cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.516+0000 7f4491200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448c0af600 con 0x7f448c158ca0 2024-08-17T02:46:36.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.516+0000 7f4491200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448c0cb280 con 0x7f448c1588d0 2024-08-17T02:46:36.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.516+0000 7f4491200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c0afb60 con 0x7f448c0cf900 2024-08-17T02:46:36.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.516+0000 7f448be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f448c0cf900 0x7f448c0cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.516+0000 7f448aa00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f448c158ca0 0x7f448c0cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55976/0 (socket says 172.21.15.107:55976) 2024-08-17T02:46:36.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.516+0000 7f448aa00640 1 -- 172.21.15.107:0/2927904684 learned_addr learned my addr 172.21.15.107:0/2927904684 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:46:36.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.516+0000 7f448b400640 1 --2- 172.21.15.107:0/2927904684 >> v2:172.21.15.5:3300/0 conn(0x7f448c1588d0 0x7f448c0ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.517+0000 7f448a000640 1 -- 172.21.15.107:0/2927904684 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610229276 0 0) 0x7f448c0af600 con 0x7f448c158ca0 2024-08-17T02:46:36.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.517+0000 7f448be00640 1 -- 172.21.15.107:0/2927904684 >> v2:172.21.15.5:3300/0 conn(0x7f448c1588d0 msgr2=0x7f448c0ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:36.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.517+0000 7f448be00640 1 --2- 172.21.15.107:0/2927904684 >> v2:172.21.15.5:3300/0 conn(0x7f448c1588d0 0x7f448c0ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.517+0000 7f448be00640 1 -- 172.21.15.107:0/2927904684 >> v1:172.21.15.107:6789/0 conn(0x7f448c158ca0 legacy=0x7f448c0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.517+0000 7f448be00640 1 -- 172.21.15.107:0/2927904684 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c0d04e0 con 0x7f448c0cf900 2024-08-17T02:46:36.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.518+0000 7f448be00640 1 --2- 172.21.15.107:0/2927904684 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f448c0cf900 0x7f448c0cad40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4484009e60 tx=0x7f4484009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dafb8b718514d46b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.518+0000 7f448a000640 1 -- 172.21.15.107:0/2927904684 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484007550 con 0x7f448c0cf900 2024-08-17T02:46:36.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.518+0000 7f448a000640 1 -- 172.21.15.107:0/2927904684 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448402d050 con 0x7f448c0cf900 2024-08-17T02:46:36.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.518+0000 7f448a000640 1 -- 172.21.15.107:0/2927904684 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840078e0 con 0x7f448c0cf900 2024-08-17T02:46:36.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.519+0000 7f4491200640 1 -- 172.21.15.107:0/2927904684 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f448c0cf900 msgr2=0x7f448c0cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.519+0000 7f4491200640 1 --2- 172.21.15.107:0/2927904684 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f448c0cf900 0x7f448c0cad40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4484009e60 tx=0x7f4484009780 comp rx=0 tx=0).stop 2024-08-17T02:46:36.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.519+0000 7f4491200640 1 -- 172.21.15.107:0/2927904684 shutdown_connections 2024-08-17T02:46:36.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.519+0000 7f4491200640 1 --2- 172.21.15.107:0/2927904684 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f448c0cf900 0x7f448c0cad40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.519+0000 7f4491200640 1 --2- 172.21.15.107:0/2927904684 >> v2:172.21.15.5:3300/0 conn(0x7f448c1588d0 0x7f448c0ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.519+0000 7f4491200640 1 -- 172.21.15.107:0/2927904684 >> 172.21.15.107:0/2927904684 conn(0x7f448c087a80 msgr2=0x7f448c06e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:36.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.519+0000 7f4491200640 1 -- 172.21.15.107:0/2927904684 shutdown_connections 2024-08-17T02:46:36.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.519+0000 7f4491200640 1 -- 172.21.15.107:0/2927904684 wait complete. 2024-08-17T02:46:36.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.521+0000 7f4491200640 1 Processor -- start 2024-08-17T02:46:36.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.521+0000 7f4491200640 1 -- start start 2024-08-17T02:46:36.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f4491200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f448c0cf900 0x7f448c1690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f4491200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f448c1588d0 0x7f448c1547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f4491200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f448c158ca0 0x7f448c0c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f4491200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c0b4620 con 0x7f448c158ca0 2024-08-17T02:46:36.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f4491200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c16d540 con 0x7f448c1588d0 2024-08-17T02:46:36.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f4491200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c0b3cf0 con 0x7f448c0cf900 2024-08-17T02:46:36.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f448aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f448c1588d0 0x7f448c1547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f448b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f448c0cf900 0x7f448c1690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f448aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f448c1588d0 0x7f448c1547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35498/0 (socket says 172.21.15.107:35498) 2024-08-17T02:46:36.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f448aa00640 1 -- 172.21.15.107:0/3659799352 learned_addr learned my addr 172.21.15.107:0/3659799352 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:46:36.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f448be00640 1 --2- 172.21.15.107:0/3659799352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f448c158ca0 0x7f448c0c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f448b400640 1 -- 172.21.15.107:0/3659799352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f448c1588d0 msgr2=0x7f448c1547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f448b400640 1 --2- 172.21.15.107:0/3659799352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f448c1588d0 0x7f448c1547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f448b400640 1 -- 172.21.15.107:0/3659799352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f448c158ca0 msgr2=0x7f448c0c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f448b400640 1 --2- 172.21.15.107:0/3659799352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f448c158ca0 0x7f448c0c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f448b400640 1 -- 172.21.15.107:0/3659799352 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4484009a20 con 0x7f448c0cf900 2024-08-17T02:46:36.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.523+0000 7f448aa00640 1 --2- 172.21.15.107:0/3659799352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f448c1588d0 0x7f448c1547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:36.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.524+0000 7f448b400640 1 --2- 172.21.15.107:0/3659799352 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f448c0cf900 0x7f448c1690a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f447c00e960 tx=0x7f447c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.524+0000 7f4482a00640 1 -- 172.21.15.107:0/3659799352 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00c940 con 0x7f448c0cf900 2024-08-17T02:46:36.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.524+0000 7f4482a00640 1 -- 172.21.15.107:0/3659799352 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c00caa0 con 0x7f448c0cf900 2024-08-17T02:46:36.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.524+0000 7f4491200640 1 -- 172.21.15.107:0/3659799352 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448c0b3fd0 con 0x7f448c0cf900 2024-08-17T02:46:36.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.524+0000 7f4482a00640 1 -- 172.21.15.107:0/3659799352 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00ce20 con 0x7f448c0cf900 2024-08-17T02:46:36.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.524+0000 7f4491200640 1 -- 172.21.15.107:0/3659799352 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448c154d20 con 0x7f448c0cf900 2024-08-17T02:46:36.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.525+0000 7f4482a00640 1 -- 172.21.15.107:0/3659799352 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f447c005970 con 0x7f448c0cf900 2024-08-17T02:46:36.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.526+0000 7f4482a00640 1 -- 172.21.15.107:0/3659799352 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f447c013e30 con 0x7f448c0cf900 2024-08-17T02:46:36.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.526+0000 7f4491200640 1 -- 172.21.15.107:0/3659799352 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f448c158500 con 0x7f448c0cf900 2024-08-17T02:46:36.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.528+0000 7f4482a00640 1 -- 172.21.15.107:0/3659799352 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f448c158500 con 0x7f448c0cf900 2024-08-17T02:46:36.532 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:36.532+0000 7f6782c1aec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:46:36.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.601+0000 7f4491200640 1 -- 172.21.15.107:0/3659799352 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6a70b251-0ed3-47d8-979a-f2a58a3421ba", "id": 5} v 0) v1 -- 0x7f448c070720 con 0x7f448c0cf900 2024-08-17T02:46:36.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.606+0000 7f4482a00640 1 -- 172.21.15.107:0/3659799352 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6a70b251-0ed3-47d8-979a-f2a58a3421ba", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f447c021060 con 0x7f448c0cf900 2024-08-17T02:46:36.607 INFO:teuthology.orchestra.run.smithi107.stdout:5 2024-08-17T02:46:36.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.607+0000 7f4491200640 1 -- 172.21.15.107:0/3659799352 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f448c0cf900 msgr2=0x7f448c1690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.607+0000 7f4491200640 1 --2- 172.21.15.107:0/3659799352 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f448c0cf900 0x7f448c1690a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f447c00e960 tx=0x7f447c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.608+0000 7f4491200640 1 -- 172.21.15.107:0/3659799352 shutdown_connections 2024-08-17T02:46:36.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.608+0000 7f4491200640 1 --2- 172.21.15.107:0/3659799352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f448c158ca0 0x7f448c0c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.608+0000 7f4491200640 1 --2- 172.21.15.107:0/3659799352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f448c1588d0 0x7f448c1547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.608+0000 7f4491200640 1 --2- 172.21.15.107:0/3659799352 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f448c0cf900 0x7f448c1690a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.608+0000 7f4491200640 1 -- 172.21.15.107:0/3659799352 >> 172.21.15.107:0/3659799352 conn(0x7f448c087a80 msgr2=0x7f448c155300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:36.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.608+0000 7f4491200640 1 -- 172.21.15.107:0/3659799352 shutdown_connections 2024-08-17T02:46:36.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.608+0000 7f4491200640 1 -- 172.21.15.107:0/3659799352 wait complete. 2024-08-17T02:46:36.629 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 8e2d91e1-0939-4678-a578-800e02af359d 6 2024-08-17T02:46:36.644 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:36.644+0000 7f6782c1aec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:46:36.645 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:36.645+0000 7fc3fac3aec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:46:36.707 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:36.706+0000 7fc3fac3aec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:46:36.767 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:36.767+0000 7fc3fac3aec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:46:36.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.787+0000 7f72e6e00640 1 Processor -- start 2024-08-17T02:46:36.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.787+0000 7f72e6e00640 1 -- start start 2024-08-17T02:46:36.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.788+0000 7f72e6e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72e01589e0 0x7f72e0158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.788+0000 7f72e6e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72e00ca9c0 0x7f72e00cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.789+0000 7f72e6e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e00af9a0 con 0x7f72e00cda30 2024-08-17T02:46:36.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.789+0000 7f72e6e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e00af810 con 0x7f72e01589e0 2024-08-17T02:46:36.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.789+0000 7f72e6e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e00cb310 con 0x7f72e00ca9c0 2024-08-17T02:46:36.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.789+0000 7f72df400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72e00ca9c0 0x7f72e00cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.789+0000 7f72df400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72e00ca9c0 0x7f72e00cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:54852/0 (socket says 172.21.15.107:54852) 2024-08-17T02:46:36.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.789+0000 7f72df400640 1 -- 172.21.15.107:0/2346994850 learned_addr learned my addr 172.21.15.107:0/2346994850 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:46:36.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.789+0000 7f72dfe00640 1 --2- 172.21.15.107:0/2346994850 >> v2:172.21.15.5:3300/0 conn(0x7f72e01589e0 0x7f72e0158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.789+0000 7f72df400640 1 -- 172.21.15.107:0/2346994850 >> v2:172.21.15.5:3300/0 conn(0x7f72e01589e0 msgr2=0x7f72e0158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:36.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.789+0000 7f72df400640 1 --2- 172.21.15.107:0/2346994850 >> v2:172.21.15.5:3300/0 conn(0x7f72e01589e0 0x7f72e0158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.789+0000 7f72df400640 1 -- 172.21.15.107:0/2346994850 >> v1:172.21.15.5:6789/0 conn(0x7f72e00cda30 legacy=0x7f72e00cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.789+0000 7f72df400640 1 -- 172.21.15.107:0/2346994850 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e00ce740 con 0x7f72e00ca9c0 2024-08-17T02:46:36.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.790+0000 7f72df400640 1 --2- 172.21.15.107:0/2346994850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72e00ca9c0 0x7f72e00cadd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009910 tx=0x7f72cc0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eba1ce77e970da86 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.791+0000 7f72dea00640 1 -- 172.21.15.107:0/2346994850 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc02ae40 con 0x7f72e00ca9c0 2024-08-17T02:46:36.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.791+0000 7f72dea00640 1 -- 172.21.15.107:0/2346994850 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc032440 con 0x7f72e00ca9c0 2024-08-17T02:46:36.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.791+0000 7f72dea00640 1 -- 172.21.15.107:0/2346994850 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc032820 con 0x7f72e00ca9c0 2024-08-17T02:46:36.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.791+0000 7f72e6e00640 1 -- 172.21.15.107:0/2346994850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72e00ca9c0 msgr2=0x7f72e00cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.791+0000 7f72e6e00640 1 --2- 172.21.15.107:0/2346994850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72e00ca9c0 0x7f72e00cadd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009910 tx=0x7f72cc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.791+0000 7f72e6e00640 1 -- 172.21.15.107:0/2346994850 shutdown_connections 2024-08-17T02:46:36.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.791+0000 7f72e6e00640 1 --2- 172.21.15.107:0/2346994850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72e00ca9c0 0x7f72e00cadd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.791+0000 7f72e6e00640 1 --2- 172.21.15.107:0/2346994850 >> v2:172.21.15.5:3300/0 conn(0x7f72e01589e0 0x7f72e0158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.791+0000 7f72e6e00640 1 -- 172.21.15.107:0/2346994850 >> 172.21.15.107:0/2346994850 conn(0x7f72e006e590 msgr2=0x7f72e006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:36.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.791+0000 7f72e6e00640 1 -- 172.21.15.107:0/2346994850 shutdown_connections 2024-08-17T02:46:36.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.791+0000 7f72e6e00640 1 -- 172.21.15.107:0/2346994850 wait complete. 2024-08-17T02:46:36.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.793+0000 7f72e6e00640 1 Processor -- start 2024-08-17T02:46:36.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.793+0000 7f72e6e00640 1 -- start start 2024-08-17T02:46:36.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.794+0000 7f72e6e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72e00ca9c0 0x7f72e0155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.794+0000 7f72e6e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72e00cda30 0x7f72e0148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.794+0000 7f72e6e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72e01589e0 0x7f72e0148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:36.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.794+0000 7f72e6e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e00c7c20 con 0x7f72e01589e0 2024-08-17T02:46:36.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.794+0000 7f72e6e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e00c6e60 con 0x7f72e00ca9c0 2024-08-17T02:46:36.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.794+0000 7f72e6e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e00c7140 con 0x7f72e00cda30 2024-08-17T02:46:36.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.794+0000 7f72df400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72e00cda30 0x7f72e0148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.794+0000 7f72dfe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72e00ca9c0 0x7f72e0155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.794+0000 7f72df400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72e00cda30 0x7f72e0148340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:54858/0 (socket says 172.21.15.107:54858) 2024-08-17T02:46:36.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.794+0000 7f72df400640 1 -- 172.21.15.107:0/995530314 learned_addr learned my addr 172.21.15.107:0/995530314 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:46:36.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.794+0000 7f72e4e00640 1 --2- 172.21.15.107:0/995530314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72e01589e0 0x7f72e0148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:36.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.794+0000 7f72df400640 1 -- 172.21.15.107:0/995530314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72e00ca9c0 msgr2=0x7f72e0155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.794+0000 7f72df400640 1 --2- 172.21.15.107:0/995530314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72e00ca9c0 0x7f72e0155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.794+0000 7f72df400640 1 -- 172.21.15.107:0/995530314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72e01589e0 msgr2=0x7f72e0148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.794+0000 7f72df400640 1 --2- 172.21.15.107:0/995530314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72e01589e0 0x7f72e0148880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.794+0000 7f72df400640 1 -- 172.21.15.107:0/995530314 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc009450 con 0x7f72e00cda30 2024-08-17T02:46:36.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.795+0000 7f72df400640 1 --2- 172.21.15.107:0/995530314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72e00cda30 0x7f72e0148340 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f72cc035040 tx=0x7f72cc032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:36.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.795+0000 7f72d7400640 1 -- 172.21.15.107:0/995530314 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc031c80 con 0x7f72e00cda30 2024-08-17T02:46:36.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.795+0000 7f72d7400640 1 -- 172.21.15.107:0/995530314 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc031e40 con 0x7f72e00cda30 2024-08-17T02:46:36.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.795+0000 7f72e6e00640 1 -- 172.21.15.107:0/995530314 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e00c7420 con 0x7f72e00cda30 2024-08-17T02:46:36.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.795+0000 7f72d7400640 1 -- 172.21.15.107:0/995530314 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc03d670 con 0x7f72e00cda30 2024-08-17T02:46:36.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.795+0000 7f72e6e00640 1 -- 172.21.15.107:0/995530314 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e0159550 con 0x7f72e00cda30 2024-08-17T02:46:36.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.795+0000 7f72d7400640 1 -- 172.21.15.107:0/995530314 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f72cc039040 con 0x7f72e00cda30 2024-08-17T02:46:36.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.795+0000 7f72d7400640 1 -- 172.21.15.107:0/995530314 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f72cc02ae40 con 0x7f72e00cda30 2024-08-17T02:46:36.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.797+0000 7f72e6e00640 1 -- 172.21.15.107:0/995530314 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e00c7930 con 0x7f72e00cda30 2024-08-17T02:46:36.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.799+0000 7f72d7400640 1 -- 172.21.15.107:0/995530314 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f72cc042070 con 0x7f72e00cda30 2024-08-17T02:46:36.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.888+0000 7f72e6e00640 1 -- 172.21.15.107:0/995530314 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8e2d91e1-0939-4678-a578-800e02af359d", "id": 6} v 0) v1 -- 0x7f72e0063fb0 con 0x7f72e00cda30 2024-08-17T02:46:36.893 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:36.892+0000 7fc3fac3aec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:46:36.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.893+0000 7f72d7400640 1 -- 172.21.15.107:0/995530314 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e2d91e1-0939-4678-a578-800e02af359d", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f72cc037070 con 0x7f72e00cda30 2024-08-17T02:46:36.893 INFO:teuthology.orchestra.run.smithi107.stdout:6 2024-08-17T02:46:36.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.894+0000 7f72e6e00640 1 -- 172.21.15.107:0/995530314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72e00cda30 msgr2=0x7f72e0148340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:36.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.894+0000 7f72e6e00640 1 --2- 172.21.15.107:0/995530314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72e00cda30 0x7f72e0148340 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f72cc035040 tx=0x7f72cc032000 comp rx=0 tx=0).stop 2024-08-17T02:46:36.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.894+0000 7f72e6e00640 1 -- 172.21.15.107:0/995530314 shutdown_connections 2024-08-17T02:46:36.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.894+0000 7f72e6e00640 1 --2- 172.21.15.107:0/995530314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72e01589e0 0x7f72e0148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.894+0000 7f72e6e00640 1 --2- 172.21.15.107:0/995530314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72e00cda30 0x7f72e0148340 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.894+0000 7f72e6e00640 1 --2- 172.21.15.107:0/995530314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72e00ca9c0 0x7f72e0155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:36.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.894+0000 7f72e6e00640 1 -- 172.21.15.107:0/995530314 >> 172.21.15.107:0/995530314 conn(0x7f72e006e590 msgr2=0x7f72e00b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:36.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.894+0000 7f72e6e00640 1 -- 172.21.15.107:0/995530314 shutdown_connections 2024-08-17T02:46:36.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:36.894+0000 7f72e6e00640 1 -- 172.21.15.107:0/995530314 wait complete. 2024-08-17T02:46:36.913 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 8c407789-07b3-45dd-9dd5-add2448887ba 7 2024-08-17T02:46:37.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.057+0000 7f1ea5000640 1 Processor -- start 2024-08-17T02:46:37.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.057+0000 7f1ea5000640 1 -- start start 2024-08-17T02:46:37.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.058+0000 7f1ea5000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ea006eca0 0x7f1ea01638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:37.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.058+0000 7f1ea5000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea00cbc50 con 0x7f1ea0158a00 2024-08-17T02:46:37.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.058+0000 7f1ea5000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea00cbf30 con 0x7f1ea0158dd0 2024-08-17T02:46:37.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.058+0000 7f1ea5000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea0159230 con 0x7f1ea006eca0 2024-08-17T02:46:37.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.058+0000 7f1e9fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ea006eca0 0x7f1ea01638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:37.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.058+0000 7f1e9ea00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1ea0158dd0 0x7f1ea006e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55992/0 (socket says 172.21.15.107:55992) 2024-08-17T02:46:37.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.058+0000 7f1e9ea00640 1 -- 172.21.15.107:0/3308560656 learned_addr learned my addr 172.21.15.107:0/3308560656 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-08-17T02:46:37.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.059+0000 7f1e9e000640 1 -- 172.21.15.107:0/3308560656 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113420163 0 0) 0x7f1ea00cbf30 con 0x7f1ea0158dd0 2024-08-17T02:46:37.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.059+0000 7f1e9e000640 1 -- 172.21.15.107:0/3308560656 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e840034e0 con 0x7f1ea0158dd0 2024-08-17T02:46:37.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.059+0000 7f1e9e000640 1 -- 172.21.15.107:0/3308560656 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852752297 0 0) 0x7f1ea00cbc50 con 0x7f1ea0158a00 2024-08-17T02:46:37.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.059+0000 7f1e9fe00640 1 -- 172.21.15.107:0/3308560656 >> v1:172.21.15.107:6789/0 conn(0x7f1ea0158dd0 legacy=0x7f1ea006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.059+0000 7f1e9fe00640 1 -- 172.21.15.107:0/3308560656 >> v1:172.21.15.5:6789/0 conn(0x7f1ea0158a00 legacy=0x7f1ea00cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.059+0000 7f1e9fe00640 1 -- 172.21.15.107:0/3308560656 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea00cc210 con 0x7f1ea006eca0 2024-08-17T02:46:37.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.060+0000 7f1e9fe00640 1 --2- 172.21.15.107:0/3308560656 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ea006eca0 0x7f1ea01638c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009e90 tx=0x7f1e98009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e75b2982069b4507 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:37.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.060+0000 7f1e9e000640 1 -- 172.21.15.107:0/3308560656 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e98007550 con 0x7f1ea006eca0 2024-08-17T02:46:37.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.060+0000 7f1e9e000640 1 -- 172.21.15.107:0/3308560656 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9802d050 con 0x7f1ea006eca0 2024-08-17T02:46:37.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.060+0000 7f1e9e000640 1 -- 172.21.15.107:0/3308560656 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e980078e0 con 0x7f1ea006eca0 2024-08-17T02:46:37.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.061+0000 7f1ea5000640 1 -- 172.21.15.107:0/3308560656 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ea006eca0 msgr2=0x7f1ea01638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.061+0000 7f1ea5000640 1 --2- 172.21.15.107:0/3308560656 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ea006eca0 0x7f1ea01638c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009e90 tx=0x7f1e98009780 comp rx=0 tx=0).stop 2024-08-17T02:46:37.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.061+0000 7f1ea5000640 1 -- 172.21.15.107:0/3308560656 shutdown_connections 2024-08-17T02:46:37.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.061+0000 7f1ea5000640 1 --2- 172.21.15.107:0/3308560656 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ea006eca0 0x7f1ea01638c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.061+0000 7f1ea5000640 1 -- 172.21.15.107:0/3308560656 >> 172.21.15.107:0/3308560656 conn(0x7f1ea00cfb80 msgr2=0x7f1ea00cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:37.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.061+0000 7f1ea5000640 1 -- 172.21.15.107:0/3308560656 shutdown_connections 2024-08-17T02:46:37.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.061+0000 7f1ea5000640 1 -- 172.21.15.107:0/3308560656 wait complete. 2024-08-17T02:46:37.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.062+0000 7f1ea5000640 1 Processor -- start 2024-08-17T02:46:37.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.062+0000 7f1ea5000640 1 -- start start 2024-08-17T02:46:37.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.063+0000 7f1ea5000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ea006eca0 0x7f1ea0168460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:37.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.063+0000 7f1ea5000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ea0158a00 0x7f1ea0159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:37.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.063+0000 7f1ea5000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ea0158dd0 0x7f1ea00afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:37.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.063+0000 7f1ea5000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea0169630 con 0x7f1ea0158dd0 2024-08-17T02:46:37.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.063+0000 7f1ea5000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea015a2c0 con 0x7f1ea006eca0 2024-08-17T02:46:37.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.063+0000 7f1ea5000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea0168a40 con 0x7f1ea0158a00 2024-08-17T02:46:37.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.063+0000 7f1e9f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ea006eca0 0x7f1ea0168460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:37.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.063+0000 7f1e9ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ea0158a00 0x7f1ea0159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:37.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.063+0000 7f1e9f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ea006eca0 0x7f1ea0168460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35514/0 (socket says 172.21.15.107:35514) 2024-08-17T02:46:37.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.063+0000 7f1e9ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ea0158a00 0x7f1ea0159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:54890/0 (socket says 172.21.15.107:54890) 2024-08-17T02:46:37.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.063+0000 7f1e9f400640 1 -- 172.21.15.107:0/3537495550 learned_addr learned my addr 172.21.15.107:0/3537495550 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-08-17T02:46:37.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.063+0000 7f1e9fe00640 1 --2- 172.21.15.107:0/3537495550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ea0158dd0 0x7f1ea00afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:37.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.064+0000 7f1e9ea00640 1 -- 172.21.15.107:0/3537495550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ea006eca0 msgr2=0x7f1ea0168460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.064+0000 7f1e9ea00640 1 --2- 172.21.15.107:0/3537495550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ea006eca0 0x7f1ea0168460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.064+0000 7f1e9ea00640 1 -- 172.21.15.107:0/3537495550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ea0158dd0 msgr2=0x7f1ea00afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.064+0000 7f1e9ea00640 1 --2- 172.21.15.107:0/3537495550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ea0158dd0 0x7f1ea00afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.064+0000 7f1e9ea00640 1 -- 172.21.15.107:0/3537495550 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e98009a20 con 0x7f1ea0158a00 2024-08-17T02:46:37.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.064+0000 7f1e9f400640 1 --2- 172.21.15.107:0/3537495550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ea006eca0 0x7f1ea0168460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:37.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.064+0000 7f1e9ea00640 1 --2- 172.21.15.107:0/3537495550 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ea0158a00 0x7f1ea0159d80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c001ed0 tx=0x7f1e8c007cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:37.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.064+0000 7f1e96a00640 1 -- 172.21.15.107:0/3537495550 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c005aa0 con 0x7f1ea0158a00 2024-08-17T02:46:37.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.064+0000 7f1e96a00640 1 -- 172.21.15.107:0/3537495550 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8c005c00 con 0x7f1ea0158a00 2024-08-17T02:46:37.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.064+0000 7f1e96a00640 1 -- 172.21.15.107:0/3537495550 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c0070d0 con 0x7f1ea0158a00 2024-08-17T02:46:37.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.064+0000 7f1ea5000640 1 -- 172.21.15.107:0/3537495550 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea0168d20 con 0x7f1ea0158a00 2024-08-17T02:46:37.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.064+0000 7f1ea5000640 1 -- 172.21.15.107:0/3537495550 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea01692e0 con 0x7f1ea0158a00 2024-08-17T02:46:37.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.065+0000 7f1e96a00640 1 -- 172.21.15.107:0/3537495550 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f1e8c0074c0 con 0x7f1ea0158a00 2024-08-17T02:46:37.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.065+0000 7f1e96a00640 1 -- 172.21.15.107:0/3537495550 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f1e8c01c440 con 0x7f1ea0158a00 2024-08-17T02:46:37.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.066+0000 7f1ea5000640 1 -- 172.21.15.107:0/3537495550 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea0070720 con 0x7f1ea0158a00 2024-08-17T02:46:37.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.068+0000 7f1e96a00640 1 -- 172.21.15.107:0/3537495550 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f1e8c017070 con 0x7f1ea0158a00 2024-08-17T02:46:37.114 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:37.113+0000 7f6782c1aec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:46:37.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.159+0000 7f1ea5000640 1 -- 172.21.15.107:0/3537495550 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8c407789-07b3-45dd-9dd5-add2448887ba", "id": 7} v 0) v1 -- 0x7f1ea0067420 con 0x7f1ea0158a00 2024-08-17T02:46:37.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.163+0000 7f1e96a00640 1 -- 172.21.15.107:0/3537495550 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c407789-07b3-45dd-9dd5-add2448887ba", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1e8c01ca30 con 0x7f1ea0158a00 2024-08-17T02:46:37.164 INFO:teuthology.orchestra.run.smithi107.stdout:7 2024-08-17T02:46:37.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.164+0000 7f1ea5000640 1 -- 172.21.15.107:0/3537495550 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ea0158a00 msgr2=0x7f1ea0159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.164+0000 7f1ea5000640 1 --2- 172.21.15.107:0/3537495550 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ea0158a00 0x7f1ea0159d80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c001ed0 tx=0x7f1e8c007cc0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.164+0000 7f1ea5000640 1 -- 172.21.15.107:0/3537495550 shutdown_connections 2024-08-17T02:46:37.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.164+0000 7f1ea5000640 1 --2- 172.21.15.107:0/3537495550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ea0158dd0 0x7f1ea00afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.164+0000 7f1ea5000640 1 --2- 172.21.15.107:0/3537495550 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ea0158a00 0x7f1ea0159d80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.164+0000 7f1ea5000640 1 --2- 172.21.15.107:0/3537495550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ea006eca0 0x7f1ea0168460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.164+0000 7f1ea5000640 1 -- 172.21.15.107:0/3537495550 >> 172.21.15.107:0/3537495550 conn(0x7f1ea00cfb80 msgr2=0x7f1ea00c61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:37.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.164+0000 7f1ea5000640 1 -- 172.21.15.107:0/3537495550 shutdown_connections 2024-08-17T02:46:37.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-08-17T02:46:37.164+0000 7f1ea5000640 1 -- 172.21.15.107:0/3537495550 wait complete. 2024-08-17T02:46:37.179 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:46:37.179 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:46:37.184 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:46:37.184 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:46:37.184 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:46:37.188 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:46:37.189 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:46:37.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:46:37.193 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:46:37.193 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:46:37.194 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:46:37.199 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:46:37.199 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:46:37.200 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:46:37.204 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:46:37.205 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:46:37.205 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:46:37.208 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:46:37.209 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:46:37.209 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:46:37.214 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:46:37.214 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:46:37.214 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:46:37.219 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:46:37.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.419+0000 7fedcbe00640 1 Processor -- start 2024-08-17T02:46:37.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.419+0000 7fedcbe00640 1 -- start start 2024-08-17T02:46:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.420+0000 7fedcbe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fedcc15a490 0x7fedcc0ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.420+0000 7fedcbe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fedcc0b1920 0x7fedcc0b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.420+0000 7fedcbe00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedcc15b6b0 con 0x7fedcc158c60 2024-08-17T02:46:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.420+0000 7fedcbe00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedcc0b0540 con 0x7fedcc0b1920 2024-08-17T02:46:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.420+0000 7fedcbe00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedcc15a8b0 con 0x7fedcc15a490 2024-08-17T02:46:37.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.420+0000 7fedcb400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fedcc0b1920 0x7fedcc0b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:37.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.420+0000 7fedcaa00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fedcc158c60 0x7fedcc159030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:48902/0 (socket says 172.21.15.5:48902) 2024-08-17T02:46:37.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.420+0000 7fedcaa00640 1 -- 172.21.15.5:0/3760777358 learned_addr learned my addr 172.21.15.5:0/3760777358 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:46:37.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.420+0000 7fedc2000640 1 --2- 172.21.15.5:0/3760777358 >> v2:172.21.15.107:3300/0 conn(0x7fedcc15a490 0x7fedcc0ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:37.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.421+0000 7fedca000640 1 -- 172.21.15.5:0/3760777358 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142132058 0 0) 0x7fedcc15b6b0 con 0x7fedcc158c60 2024-08-17T02:46:37.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.421+0000 7fedca000640 1 -- 172.21.15.5:0/3760777358 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedb00034e0 con 0x7fedcc158c60 2024-08-17T02:46:37.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.421+0000 7fedcb400640 1 -- 172.21.15.5:0/3760777358 >> v2:172.21.15.107:3300/0 conn(0x7fedcc15a490 msgr2=0x7fedcc0ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:37.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.421+0000 7fedcb400640 1 --2- 172.21.15.5:0/3760777358 >> v2:172.21.15.107:3300/0 conn(0x7fedcc15a490 0x7fedcc0ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.421+0000 7fedcb400640 1 -- 172.21.15.5:0/3760777358 >> v1:172.21.15.107:6789/0 conn(0x7fedcc158c60 legacy=0x7fedcc159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.421+0000 7fedcb400640 1 -- 172.21.15.5:0/3760777358 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc15aac0 con 0x7fedcc0b1920 2024-08-17T02:46:37.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.422+0000 7fedcb400640 1 --2- 172.21.15.5:0/3760777358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0b1920 0x7fedcc0b1d40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0cd4d0 tx=0x7fedc4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b377739e02f37f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:37.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.422+0000 7fedca000640 1 -- 172.21.15.5:0/3760777358 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4007550 con 0x7fedcc0b1920 2024-08-17T02:46:37.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.422+0000 7fedca000640 1 -- 172.21.15.5:0/3760777358 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc402d050 con 0x7fedcc0b1920 2024-08-17T02:46:37.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.422+0000 7fedca000640 1 -- 172.21.15.5:0/3760777358 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4007920 con 0x7fedcc0b1920 2024-08-17T02:46:37.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.422+0000 7fedcbe00640 1 -- 172.21.15.5:0/3760777358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0b1920 msgr2=0x7fedcc0b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.422+0000 7fedcbe00640 1 --2- 172.21.15.5:0/3760777358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0b1920 0x7fedcc0b1d40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0cd4d0 tx=0x7fedc4009780 comp rx=0 tx=0).stop 2024-08-17T02:46:37.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.423+0000 7fedcbe00640 1 -- 172.21.15.5:0/3760777358 shutdown_connections 2024-08-17T02:46:37.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.423+0000 7fedcbe00640 1 --2- 172.21.15.5:0/3760777358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0b1920 0x7fedcc0b1d40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.423+0000 7fedcbe00640 1 --2- 172.21.15.5:0/3760777358 >> v2:172.21.15.107:3300/0 conn(0x7fedcc15a490 0x7fedcc0ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.423+0000 7fedcbe00640 1 -- 172.21.15.5:0/3760777358 >> 172.21.15.5:0/3760777358 conn(0x7fedcc06e590 msgr2=0x7fedcc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:37.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.423+0000 7fedcbe00640 1 -- 172.21.15.5:0/3760777358 shutdown_connections 2024-08-17T02:46:37.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.423+0000 7fedcbe00640 1 -- 172.21.15.5:0/3760777358 wait complete. 2024-08-17T02:46:37.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.424+0000 7fedcbe00640 1 Processor -- start 2024-08-17T02:46:37.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.424+0000 7fedcbe00640 1 -- start start 2024-08-17T02:46:37.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.425+0000 7fedcbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0b1920 0x7fedcc0c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:37.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.425+0000 7fedcbe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedcc158c60 0x7fedcc0c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:37.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.425+0000 7fedcbe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedcc15a490 0x7fedcc0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:37.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.425+0000 7fedcbe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc16c770 con 0x7fedcc0b1920 2024-08-17T02:46:37.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.425+0000 7fedcbe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc0c6550 con 0x7fedcc158c60 2024-08-17T02:46:37.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.425+0000 7fedcbe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc16be80 con 0x7fedcc15a490 2024-08-17T02:46:37.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.425+0000 7fedcaa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0b1920 0x7fedcc0c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:37.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.425+0000 7fedcaa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0b1920 0x7fedcc0c9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43116/0 (socket says 172.21.15.5:43116) 2024-08-17T02:46:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.425+0000 7fedcaa00640 1 -- 172.21.15.5:0/2112516775 learned_addr learned my addr 172.21.15.5:0/2112516775 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.425+0000 7fedc2000640 1 --2- 172.21.15.5:0/2112516775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedcc158c60 0x7fedcc0c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.425+0000 7fedcb400640 1 --2- 172.21.15.5:0/2112516775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedcc15a490 0x7fedcc0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.426+0000 7fedcaa00640 1 -- 172.21.15.5:0/2112516775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedcc15a490 msgr2=0x7fedcc0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.426+0000 7fedcaa00640 1 --2- 172.21.15.5:0/2112516775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedcc15a490 0x7fedcc0b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.426+0000 7fedcaa00640 1 -- 172.21.15.5:0/2112516775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedcc158c60 msgr2=0x7fedcc0c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.426+0000 7fedcaa00640 1 --2- 172.21.15.5:0/2112516775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedcc158c60 0x7fedcc0c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.426+0000 7fedcaa00640 1 -- 172.21.15.5:0/2112516775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc4009a20 con 0x7fedcc0b1920 2024-08-17T02:46:37.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.426+0000 7fedcaa00640 1 --2- 172.21.15.5:0/2112516775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0b1920 0x7fedcc0c9490 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00c5b0 tx=0x7fedbc007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:37.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.426+0000 7fedc2a00640 1 -- 172.21.15.5:0/2112516775 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc005aa0 con 0x7fedcc0b1920 2024-08-17T02:46:37.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.426+0000 7fedc2a00640 1 -- 172.21.15.5:0/2112516775 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedbc005c00 con 0x7fedcc0b1920 2024-08-17T02:46:37.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.426+0000 7fedc2a00640 1 -- 172.21.15.5:0/2112516775 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc0070f0 con 0x7fedcc0b1920 2024-08-17T02:46:37.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.426+0000 7fedcbe00640 1 -- 172.21.15.5:0/2112516775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedcc0c99d0 con 0x7fedcc0b1920 2024-08-17T02:46:37.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.427+0000 7fedcbe00640 1 -- 172.21.15.5:0/2112516775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedcc16c120 con 0x7fedcc0b1920 2024-08-17T02:46:37.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.427+0000 7fedc2a00640 1 -- 172.21.15.5:0/2112516775 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fedbc007520 con 0x7fedcc0b1920 2024-08-17T02:46:37.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.427+0000 7fedc2a00640 1 -- 172.21.15.5:0/2112516775 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fedbc012ae0 con 0x7fedcc0b1920 2024-08-17T02:46:37.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.428+0000 7fedcbe00640 1 -- 172.21.15.5:0/2112516775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedcc0c3410 con 0x7fedcc0b1920 2024-08-17T02:46:37.436 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:37.429+0000 7fc3fac3aec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:46:37.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.430+0000 7fedc2a00640 1 -- 172.21.15.5:0/2112516775 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fedbc012db0 con 0x7fedcc0b1920 2024-08-17T02:46:37.458 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:37.457+0000 7f6782c1aec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:46:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.494+0000 7fedcbe00640 1 -- 172.21.15.5:0/2112516775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedcc070720 con 0x7fedcc0b1920 2024-08-17T02:46:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.495+0000 7fedc2a00640 1 -- 172.21.15.5:0/2112516775 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fedbc01b4c0 con 0x7fedcc0b1920 2024-08-17T02:46:37.495 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:46:37.495 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:37.161503+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:37.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.496+0000 7fedcbe00640 1 -- 172.21.15.5:0/2112516775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0b1920 msgr2=0x7fedcc0c9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.496+0000 7fedcbe00640 1 --2- 172.21.15.5:0/2112516775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0b1920 0x7fedcc0c9490 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00c5b0 tx=0x7fedbc007d70 comp rx=0 tx=0).stop 2024-08-17T02:46:37.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.496+0000 7fedcbe00640 1 -- 172.21.15.5:0/2112516775 shutdown_connections 2024-08-17T02:46:37.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.496+0000 7fedcbe00640 1 --2- 172.21.15.5:0/2112516775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fedcc15a490 0x7fedcc0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.496+0000 7fedcbe00640 1 --2- 172.21.15.5:0/2112516775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedcc158c60 0x7fedcc0c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.496+0000 7fedcbe00640 1 --2- 172.21.15.5:0/2112516775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedcc0b1920 0x7fedcc0c9490 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.496+0000 7fedcbe00640 1 -- 172.21.15.5:0/2112516775 >> 172.21.15.5:0/2112516775 conn(0x7fedcc06e590 msgr2=0x7fedcc0caa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:37.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.496+0000 7fedcbe00640 1 -- 172.21.15.5:0/2112516775 shutdown_connections 2024-08-17T02:46:37.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:37.496+0000 7fedcbe00640 1 -- 172.21.15.5:0/2112516775 wait complete. 2024-08-17T02:46:37.512 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:46:37.513 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:46:37.522 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:37.522+0000 7f6782c1aec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:46:37.638 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:37.638+0000 7f6782c1aec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:46:37.697 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:37.696+0000 7fc3fac3aec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:46:37.755 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:37.755+0000 7fc3fac3aec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:46:37.855 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-08-17T02:46:37.854+0000 7f08fdc322c0 -1 Falling back to public interface 2024-08-17T02:46:37.865 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:37.864+0000 7fc3fac3aec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:46:37.880 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-08-17T02:46:37.879+0000 7f89c412f2c0 -1 Falling back to public interface 2024-08-17T02:46:37.881 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-08-17T02:46:37.880+0000 7fbad17352c0 -1 Falling back to public interface 2024-08-17T02:46:37.881 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-17T02:46:37.880+0000 7fe50c0192c0 -1 Falling back to public interface 2024-08-17T02:46:37.885 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-08-17T02:46:37.885+0000 7f9779a0b2c0 -1 Falling back to public interface 2024-08-17T02:46:37.890 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-08-17T02:46:37.890+0000 7f0bfb5212c0 -1 Falling back to public interface 2024-08-17T02:46:37.893 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-08-17T02:46:37.892+0000 7ff6a9f572c0 -1 Falling back to public interface 2024-08-17T02:46:37.909 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-08-17T02:46:37.909+0000 7f53cce0e2c0 -1 Falling back to public interface 2024-08-17T02:46:37.935 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:37.934+0000 7f6782c1aec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:46:37.990 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:37.989+0000 7f6782c1aec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:46:38.158 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:38.157+0000 7fc3fac3aec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:46:38.175 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:38.174+0000 7f6782c1aec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:46:38.212 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:38.212+0000 7fc3fac3aec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:46:38.235 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:38.234+0000 7f6782c1aec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:46:38.317 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:38.318 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:38.316+0000 7f6782c1aec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:46:38.374 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:38.370+0000 7f6782c1aec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:46:38.388 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:38.388+0000 7fc3fac3aec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:46:38.445 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:38.444+0000 7fc3fac3aec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:46:38.451 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.449+0000 7f28dfe00640 1 Processor -- start 2024-08-17T02:46:38.451 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.450+0000 7f28dfe00640 1 -- start start 2024-08-17T02:46:38.453 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.451+0000 7f28dfe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f28e0156660 0x7f28e00cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:38.453 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.451+0000 7f28dfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28e00d0360 0x7f28e015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:38.453 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.451+0000 7f28dfe00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e00cae20 con 0x7f28e015a7e0 2024-08-17T02:46:38.453 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.451+0000 7f28dfe00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e00cc1b0 con 0x7f28e00d0360 2024-08-17T02:46:38.453 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.451+0000 7f28dfe00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e015ac20 con 0x7f28e0156660 2024-08-17T02:46:38.453 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.451+0000 7f28de000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28e00d0360 0x7f28e015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:38.453 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.451+0000 7f28de000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28e00d0360 0x7f28e015a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43132/0 (socket says 172.21.15.5:43132) 2024-08-17T02:46:38.453 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.451+0000 7f28de000640 1 -- 172.21.15.5:0/3548089257 learned_addr learned my addr 172.21.15.5:0/3548089257 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:38.453 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.451+0000 7f28dea00640 1 --2- 172.21.15.5:0/3548089257 >> v2:172.21.15.107:3300/0 conn(0x7f28e0156660 0x7f28e00cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:38.454 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.451+0000 7f28de000640 1 -- 172.21.15.5:0/3548089257 >> v2:172.21.15.107:3300/0 conn(0x7f28e0156660 msgr2=0x7f28e00cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:38.454 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.452+0000 7f28de000640 1 --2- 172.21.15.5:0/3548089257 >> v2:172.21.15.107:3300/0 conn(0x7f28e0156660 0x7f28e00cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.454 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.452+0000 7f28de000640 1 -- 172.21.15.5:0/3548089257 >> v1:172.21.15.107:6789/0 conn(0x7f28e015a7e0 legacy=0x7f28e00cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:38.454 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.452+0000 7f28de000640 1 -- 172.21.15.5:0/3548089257 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e00cb0c0 con 0x7f28e00d0360 2024-08-17T02:46:38.455 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.453+0000 7f28de000640 1 --2- 172.21.15.5:0/3548089257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e00d0360 0x7f28e015a2a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f28e0068100 tx=0x7f28cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72316f2ece30edf7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:38.455 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.453+0000 7f28dd600640 1 -- 172.21.15.5:0/3548089257 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc032440 con 0x7f28e00d0360 2024-08-17T02:46:38.455 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.453+0000 7f28dd600640 1 -- 172.21.15.5:0/3548089257 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc0325a0 con 0x7f28e00d0360 2024-08-17T02:46:38.456 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.453+0000 7f28dd600640 1 -- 172.21.15.5:0/3548089257 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc032980 con 0x7f28e00d0360 2024-08-17T02:46:38.456 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.453+0000 7f28dfe00640 1 -- 172.21.15.5:0/3548089257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e00d0360 msgr2=0x7f28e015a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:38.456 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.453+0000 7f28dfe00640 1 --2- 172.21.15.5:0/3548089257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e00d0360 0x7f28e015a2a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f28e0068100 tx=0x7f28cc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.456 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.454+0000 7f28dfe00640 1 -- 172.21.15.5:0/3548089257 shutdown_connections 2024-08-17T02:46:38.456 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.454+0000 7f28dfe00640 1 --2- 172.21.15.5:0/3548089257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e00d0360 0x7f28e015a2a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.456 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.454+0000 7f28dfe00640 1 --2- 172.21.15.5:0/3548089257 >> v2:172.21.15.107:3300/0 conn(0x7f28e0156660 0x7f28e00cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.456 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.454+0000 7f28dfe00640 1 -- 172.21.15.5:0/3548089257 >> 172.21.15.5:0/3548089257 conn(0x7f28e006e4e0 msgr2=0x7f28e006e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:38.456 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.454+0000 7f28dfe00640 1 -- 172.21.15.5:0/3548089257 shutdown_connections 2024-08-17T02:46:38.456 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.454+0000 7f28dfe00640 1 -- 172.21.15.5:0/3548089257 wait complete. 2024-08-17T02:46:38.459 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.455+0000 7f28dfe00640 1 Processor -- start 2024-08-17T02:46:38.459 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.455+0000 7f28dfe00640 1 -- start start 2024-08-17T02:46:38.459 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.456+0000 7f28dfe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28e00d0360 0x7f28e00b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:38.459 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.456+0000 7f28dfe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28e0156660 0x7f28e00c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:38.459 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.456+0000 7f28dfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e015a7e0 0x7f28e00c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:38.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.456+0000 7f28dfe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e00c6fd0 con 0x7f28e015a7e0 2024-08-17T02:46:38.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.456+0000 7f28dfe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e00c72b0 con 0x7f28e00d0360 2024-08-17T02:46:38.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.456+0000 7f28dfe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e00c7590 con 0x7f28e0156660 2024-08-17T02:46:38.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.456+0000 7f28dea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28e00d0360 0x7f28e00b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:38.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.456+0000 7f28dea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28e00d0360 0x7f28e00b5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:45798/0 (socket says 172.21.15.5:45798) 2024-08-17T02:46:38.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.456+0000 7f28df400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e015a7e0 0x7f28e00c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:38.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.456+0000 7f28dea00640 1 -- 172.21.15.5:0/1885793915 learned_addr learned my addr 172.21.15.5:0/1885793915 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:38.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.456+0000 7f28de000640 1 --2- 172.21.15.5:0/1885793915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28e0156660 0x7f28e00c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:38.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.457+0000 7f28dea00640 1 -- 172.21.15.5:0/1885793915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28e0156660 msgr2=0x7f28e00c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:38.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.457+0000 7f28dea00640 1 --2- 172.21.15.5:0/1885793915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28e0156660 0x7f28e00c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.457+0000 7f28dea00640 1 -- 172.21.15.5:0/1885793915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e015a7e0 msgr2=0x7f28e00c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:38.460 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.457+0000 7f28dea00640 1 --2- 172.21.15.5:0/1885793915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e015a7e0 0x7f28e00c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.457+0000 7f28dea00640 1 -- 172.21.15.5:0/1885793915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc009450 con 0x7f28e00d0360 2024-08-17T02:46:38.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.457+0000 7f28dea00640 1 --2- 172.21.15.5:0/1885793915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28e00d0360 0x7f28e00b5070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f28d000e900 tx=0x7f28d00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:38.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.457+0000 7f28d6000640 1 -- 172.21.15.5:0/1885793915 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d000c8e0 con 0x7f28e00d0360 2024-08-17T02:46:38.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.457+0000 7f28d6000640 1 -- 172.21.15.5:0/1885793915 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d000ca40 con 0x7f28e00d0360 2024-08-17T02:46:38.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.457+0000 7f28d6000640 1 -- 172.21.15.5:0/1885793915 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d000cde0 con 0x7f28e00d0360 2024-08-17T02:46:38.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.457+0000 7f28dfe00640 1 -- 172.21.15.5:0/1885793915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e00c7870 con 0x7f28e00d0360 2024-08-17T02:46:38.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.457+0000 7f28dfe00640 1 -- 172.21.15.5:0/1885793915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e00b55b0 con 0x7f28e00d0360 2024-08-17T02:46:38.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.458+0000 7f28d6000640 1 -- 172.21.15.5:0/1885793915 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f28d0005970 con 0x7f28e00d0360 2024-08-17T02:46:38.461 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.458+0000 7f28d6000640 1 -- 172.21.15.5:0/1885793915 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f28d0005c20 con 0x7f28e00d0360 2024-08-17T02:46:38.462 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.459+0000 7f28dfe00640 1 -- 172.21.15.5:0/1885793915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e0088a80 con 0x7f28e00d0360 2024-08-17T02:46:38.462 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.461+0000 7f28d6000640 1 -- 172.21.15.5:0/1885793915 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f28d0021060 con 0x7f28e00d0360 2024-08-17T02:46:38.526 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:38.525+0000 7fc3fac3aec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:46:38.526 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.525+0000 7f28dfe00640 1 -- 172.21.15.5:0/1885793915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28e00cbae0 con 0x7f28e00d0360 2024-08-17T02:46:38.527 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.526+0000 7f28d6000640 1 -- 172.21.15.5:0/1885793915 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f28d0029020 con 0x7f28e00d0360 2024-08-17T02:46:38.527 INFO:teuthology.misc.health.smithi005.stdout: 2024-08-17T02:46:38.528 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:37.161503+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:38.529 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.527+0000 7f28dfe00640 1 -- 172.21.15.5:0/1885793915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28e00d0360 msgr2=0x7f28e00b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:38.529 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.527+0000 7f28dfe00640 1 --2- 172.21.15.5:0/1885793915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28e00d0360 0x7f28e00b5070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f28d000e900 tx=0x7f28d00090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.529 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.527+0000 7f28dfe00640 1 -- 172.21.15.5:0/1885793915 shutdown_connections 2024-08-17T02:46:38.529 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.527+0000 7f28dfe00640 1 --2- 172.21.15.5:0/1885793915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e015a7e0 0x7f28e00c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.529 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.527+0000 7f28dfe00640 1 --2- 172.21.15.5:0/1885793915 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28e0156660 0x7f28e00c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.529 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.527+0000 7f28dfe00640 1 --2- 172.21.15.5:0/1885793915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28e00d0360 0x7f28e00b5070 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:38.529 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.527+0000 7f28dfe00640 1 -- 172.21.15.5:0/1885793915 >> 172.21.15.5:0/1885793915 conn(0x7f28e006e4e0 msgr2=0x7f28e00cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:38.529 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.527+0000 7f28dfe00640 1 -- 172.21.15.5:0/1885793915 shutdown_connections 2024-08-17T02:46:38.529 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:38.527+0000 7f28dfe00640 1 -- 172.21.15.5:0/1885793915 wait complete. 2024-08-17T02:46:38.540 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:46:38.575 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:38.575+0000 7fc3fac3aec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:46:38.923 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:38.921+0000 7f6782c1aec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:46:39.038 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:39.037+0000 7f6782c1aec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:46:39.101 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:39.100+0000 7fc3fac3aec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:46:39.208 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-08-17T02:46:39.207+0000 7fc3fac3aec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:46:40.058 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:40.056+0000 7f6767400640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:46:40.058 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-17T02:46:40.057+0000 7f6767400640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:46:41.404 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-08-17T02:46:41.402+0000 7f08fdc322c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:46:41.446 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-08-17T02:46:41.445+0000 7f89c412f2c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:46:41.458 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-17T02:46:41.456+0000 7fe50c0192c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:46:41.507 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-08-17T02:46:41.507+0000 7f9779a0b2c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:46:41.509 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-08-17T02:46:41.508+0000 7f0bfb5212c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:46:41.515 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-08-17T02:46:41.513+0000 7fbad17352c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:46:41.518 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-08-17T02:46:41.518+0000 7f53cce0e2c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:46:41.533 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-08-17T02:46:41.532+0000 7ff6a9f572c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:46:44.857 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-08-17T02:46:44.856+0000 7f08f7000640 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:46:44.862 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-08-17T02:46:44.861+0000 7ff6a3600640 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:46:44.863 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-08-17T02:46:44.862+0000 7f08ee400640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:44.869 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-08-17T02:46:44.868+0000 7ff69aa00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:44.887 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-08-17T02:46:44.886+0000 7fbacae00640 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:46:44.894 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-08-17T02:46:44.893+0000 7fbac2200640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:44.901 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-17T02:46:44.900+0000 7fe505400640 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:46:44.907 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-17T02:46:44.906+0000 7fe4fc800640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:45.347 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:45.388 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-08-17T02:46:45.388+0000 7f0bf4c00640 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:46:45.395 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-08-17T02:46:45.395+0000 7f0bec000640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:45.397 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-08-17T02:46:45.397+0000 7f53c8000640 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:46:45.405 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-08-17T02:46:45.405+0000 7f53bd600640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:45.407 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-08-17T02:46:45.407+0000 7f9772e00640 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:46:45.414 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-08-17T02:46:45.413+0000 7f976a200640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:45.422 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-08-17T02:46:45.422+0000 7f89bd800640 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:46:45.427 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-08-17T02:46:45.427+0000 7f89b4c00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:45.485 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.484+0000 7f72d1200640 1 Processor -- start 2024-08-17T02:46:45.485 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.484+0000 7f72d1200640 1 -- start start 2024-08-17T02:46:45.487 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.485+0000 7f72d1200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f72cc156660 0x7f72cc0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.487 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.485+0000 7f72d1200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72cc0d0360 0x7f72cc15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.487 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.485+0000 7f72d1200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc0cae20 con 0x7f72cc15a7e0 2024-08-17T02:46:45.488 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.485+0000 7f72d1200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc0cc1b0 con 0x7f72cc156660 2024-08-17T02:46:45.488 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.485+0000 7f72d1200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0cb0c0 con 0x7f72cc0d0360 2024-08-17T02:46:45.488 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.485+0000 7f72cbe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f72cc15a7e0 0x7f72cc0cdac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33776/0 (socket says 172.21.15.5:33776) 2024-08-17T02:46:45.488 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.485+0000 7f72cbe00640 1 -- 172.21.15.5:0/2475580890 learned_addr learned my addr 172.21.15.5:0/2475580890 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:46:45.488 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.485+0000 7f72cb400640 1 --2- 172.21.15.5:0/2475580890 >> v2:172.21.15.107:3300/0 conn(0x7f72cc156660 0x7f72cc0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.488 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.485+0000 7f72c2a00640 1 --2- 172.21.15.5:0/2475580890 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72cc0d0360 0x7f72cc15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.488 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.486+0000 7f72cb400640 1 -- 172.21.15.5:0/2475580890 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72cc0d0360 msgr2=0x7f72cc15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:45.489 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.486+0000 7f72cb400640 1 --2- 172.21.15.5:0/2475580890 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72cc0d0360 0x7f72cc15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.489 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.486+0000 7f72cb400640 1 -- 172.21.15.5:0/2475580890 >> v1:172.21.15.5:6789/0 conn(0x7f72cc15a7e0 legacy=0x7f72cc0cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.489 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.486+0000 7f72cb400640 1 -- 172.21.15.5:0/2475580890 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc0cf340 con 0x7f72cc156660 2024-08-17T02:46:45.489 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.486+0000 7f72caa00640 1 -- 172.21.15.5:0/2475580890 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071652294 0 0) 0x7f72cc0cae20 con 0x7f72cc15a7e0 2024-08-17T02:46:45.490 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.487+0000 7f72cb400640 1 --2- 172.21.15.5:0/2475580890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72cc156660 0x7f72cc0cfe20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009850 tx=0x7f72bc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f055dba7e83c3f39 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.490 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.487+0000 7f72caa00640 1 -- 172.21.15.5:0/2475580890 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc02ae10 con 0x7f72cc156660 2024-08-17T02:46:45.491 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.487+0000 7f72caa00640 1 -- 172.21.15.5:0/2475580890 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc032440 con 0x7f72cc156660 2024-08-17T02:46:45.491 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.487+0000 7f72caa00640 1 -- 172.21.15.5:0/2475580890 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0327e0 con 0x7f72cc156660 2024-08-17T02:46:45.491 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.487+0000 7f72d1200640 1 -- 172.21.15.5:0/2475580890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72cc156660 msgr2=0x7f72cc0cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.491 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.487+0000 7f72d1200640 1 --2- 172.21.15.5:0/2475580890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72cc156660 0x7f72cc0cfe20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009850 tx=0x7f72bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.491 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.488+0000 7f72d1200640 1 -- 172.21.15.5:0/2475580890 shutdown_connections 2024-08-17T02:46:45.491 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.488+0000 7f72d1200640 1 --2- 172.21.15.5:0/2475580890 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72cc0d0360 0x7f72cc15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.491 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.488+0000 7f72d1200640 1 --2- 172.21.15.5:0/2475580890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72cc156660 0x7f72cc0cfe20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.492 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.488+0000 7f72d1200640 1 -- 172.21.15.5:0/2475580890 >> 172.21.15.5:0/2475580890 conn(0x7f72cc06e4e0 msgr2=0x7f72cc06e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:45.492 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.488+0000 7f72d1200640 1 -- 172.21.15.5:0/2475580890 shutdown_connections 2024-08-17T02:46:45.492 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.488+0000 7f72d1200640 1 -- 172.21.15.5:0/2475580890 wait complete. 2024-08-17T02:46:45.492 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.489+0000 7f72d1200640 1 Processor -- start 2024-08-17T02:46:45.492 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.489+0000 7f72d1200640 1 -- start start 2024-08-17T02:46:45.495 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.490+0000 7f72d1200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72cc0d0360 0x7f72cc154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.495 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.490+0000 7f72d1200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc156660 0x7f72cc0b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.495 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.490+0000 7f72d1200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72cc15a7e0 0x7f72cc0b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.495 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.490+0000 7f72d1200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc169a60 con 0x7f72cc156660 2024-08-17T02:46:45.495 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.490+0000 7f72d1200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0c84f0 con 0x7f72cc15a7e0 2024-08-17T02:46:45.496 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.490+0000 7f72d1200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0c8790 con 0x7f72cc0d0360 2024-08-17T02:46:45.496 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.490+0000 7f72c2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc156660 0x7f72cc0b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.496 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.490+0000 7f72c2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc156660 0x7f72cc0b4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43212/0 (socket says 172.21.15.5:43212) 2024-08-17T02:46:45.496 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.490+0000 7f72c2a00640 1 -- 172.21.15.5:0/1019378661 learned_addr learned my addr 172.21.15.5:0/1019378661 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:45.496 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.490+0000 7f72cbe00640 1 --2- 172.21.15.5:0/1019378661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72cc15a7e0 0x7f72cc0b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.496 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.490+0000 7f72cb400640 1 --2- 172.21.15.5:0/1019378661 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72cc0d0360 0x7f72cc154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.496 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.491+0000 7f72c2a00640 1 -- 172.21.15.5:0/1019378661 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72cc0d0360 msgr2=0x7f72cc154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.496 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.491+0000 7f72c2a00640 1 --2- 172.21.15.5:0/1019378661 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72cc0d0360 0x7f72cc154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.496 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.491+0000 7f72c2a00640 1 -- 172.21.15.5:0/1019378661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72cc15a7e0 msgr2=0x7f72cc0b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.496 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.491+0000 7f72c2a00640 1 --2- 172.21.15.5:0/1019378661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72cc15a7e0 0x7f72cc0b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.497 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.491+0000 7f72c2a00640 1 -- 172.21.15.5:0/1019378661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc009390 con 0x7f72cc156660 2024-08-17T02:46:45.497 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.491+0000 7f72c2a00640 1 --2- 172.21.15.5:0/1019378661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc156660 0x7f72cc0b4e60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f72b400ea20 tx=0x7f72b40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.497 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.491+0000 7f72c3400640 1 -- 172.21.15.5:0/1019378661 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b400ca10 con 0x7f72cc156660 2024-08-17T02:46:45.497 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.491+0000 7f72c3400640 1 -- 172.21.15.5:0/1019378661 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b400cb70 con 0x7f72cc156660 2024-08-17T02:46:45.497 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.491+0000 7f72d1200640 1 -- 172.21.15.5:0/1019378661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72cc0c8a70 con 0x7f72cc156660 2024-08-17T02:46:45.497 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.491+0000 7f72c3400640 1 -- 172.21.15.5:0/1019378661 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4013470 con 0x7f72cc156660 2024-08-17T02:46:45.497 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.491+0000 7f72d1200640 1 -- 172.21.15.5:0/1019378661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72cc0c9030 con 0x7f72cc156660 2024-08-17T02:46:45.497 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.492+0000 7f72d1200640 1 -- 172.21.15.5:0/1019378661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72cc088a80 con 0x7f72cc156660 2024-08-17T02:46:45.497 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.493+0000 7f72c3400640 1 -- 172.21.15.5:0/1019378661 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f72b4013860 con 0x7f72cc156660 2024-08-17T02:46:45.497 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.494+0000 7f72c3400640 1 --2- 172.21.15.5:0/1019378661 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f72a80650f0 0x7f72a80675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.498 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.494+0000 7f72c3400640 1 -- 172.21.15.5:0/1019378661 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f72b40819d0 con 0x7f72cc156660 2024-08-17T02:46:45.498 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.494+0000 7f72cb400640 1 --2- 172.21.15.5:0/1019378661 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f72a80650f0 0x7f72a80675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.498 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.495+0000 7f72cb400640 1 --2- 172.21.15.5:0/1019378661 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f72a80650f0 0x7f72a80675a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f72bc034000 tx=0x7f72bc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.500 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.499+0000 7f72c3400640 1 -- 172.21.15.5:0/1019378661 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f72b40509d0 con 0x7f72cc156660 2024-08-17T02:46:45.685 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.684+0000 7f72d1200640 1 -- 172.21.15.5:0/1019378661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72cc071010 con 0x7f72cc156660 2024-08-17T02:46:45.686 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.684+0000 7f72c3400640 1 -- 172.21.15.5:0/1019378661 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f72b4053ff0 con 0x7f72cc156660 2024-08-17T02:46:45.686 INFO:teuthology.misc.health.smithi005.stdout: 2024-08-17T02:46:45.686 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":12,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:43.056877+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:45.688 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.687+0000 7f72d1200640 1 -- 172.21.15.5:0/1019378661 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f72a80650f0 msgr2=0x7f72a80675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.688 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.687+0000 7f72d1200640 1 --2- 172.21.15.5:0/1019378661 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f72a80650f0 0x7f72a80675a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f72bc034000 tx=0x7f72bc032000 comp rx=0 tx=0).stop 2024-08-17T02:46:45.688 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.687+0000 7f72d1200640 1 -- 172.21.15.5:0/1019378661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc156660 msgr2=0x7f72cc0b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.689 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.687+0000 7f72d1200640 1 --2- 172.21.15.5:0/1019378661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc156660 0x7f72cc0b4e60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f72b400ea20 tx=0x7f72b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.689 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.687+0000 7f72d1200640 1 -- 172.21.15.5:0/1019378661 shutdown_connections 2024-08-17T02:46:45.689 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.687+0000 7f72d1200640 1 --2- 172.21.15.5:0/1019378661 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f72a80650f0 0x7f72a80675a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.689 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.687+0000 7f72d1200640 1 --2- 172.21.15.5:0/1019378661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72cc15a7e0 0x7f72cc0b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.689 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.687+0000 7f72d1200640 1 --2- 172.21.15.5:0/1019378661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72cc156660 0x7f72cc0b4e60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.689 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.687+0000 7f72d1200640 1 --2- 172.21.15.5:0/1019378661 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f72cc0d0360 0x7f72cc154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.689 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.687+0000 7f72d1200640 1 -- 172.21.15.5:0/1019378661 >> 172.21.15.5:0/1019378661 conn(0x7f72cc06e4e0 msgr2=0x7f72cc0c9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:45.689 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.687+0000 7f72d1200640 1 -- 172.21.15.5:0/1019378661 shutdown_connections 2024-08-17T02:46:45.689 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:45.687+0000 7f72d1200640 1 -- 172.21.15.5:0/1019378661 wait complete. 2024-08-17T02:46:45.701 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:46:52.509 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:52.650 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.648+0000 7fbb1e200640 1 Processor -- start 2024-08-17T02:46:52.650 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.649+0000 7fbb1e200640 1 -- start start 2024-08-17T02:46:52.651 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.650+0000 7fbb1e200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbb180d03d0 0x7fbb180cd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.652 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.650+0000 7fbb1e200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb180ce430 con 0x7fbb18158c10 2024-08-17T02:46:52.652 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.650+0000 7fbb1e200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb180cdb00 con 0x7fbb18158fe0 2024-08-17T02:46:52.652 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.650+0000 7fbb1e200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb180cdde0 con 0x7fbb180d03d0 2024-08-17T02:46:52.652 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.650+0000 7fbb1ce00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbb18158c10 0x7fbb180ce8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51576/0 (socket says 172.21.15.5:51576) 2024-08-17T02:46:52.652 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.650+0000 7fbb1ce00640 1 -- 172.21.15.5:0/2464653789 learned_addr learned my addr 172.21.15.5:0/2464653789 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:46:52.652 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.650+0000 7fbb1d800640 1 --2- 172.21.15.5:0/2464653789 >> v2:172.21.15.107:3300/0 conn(0x7fbb180d03d0 0x7fbb180cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.653 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.651+0000 7fbb17400640 1 -- 172.21.15.5:0/2464653789 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039017115 0 0) 0x7fbb180ce430 con 0x7fbb18158c10 2024-08-17T02:46:52.653 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.651+0000 7fbb17400640 1 -- 172.21.15.5:0/2464653789 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb000034e0 con 0x7fbb18158c10 2024-08-17T02:46:52.653 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.651+0000 7fbb1d800640 1 -- 172.21.15.5:0/2464653789 >> v1:172.21.15.107:6789/0 conn(0x7fbb18158fe0 legacy=0x7fbb180cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.653 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.651+0000 7fbb1d800640 1 -- 172.21.15.5:0/2464653789 >> v1:172.21.15.5:6789/0 conn(0x7fbb18158c10 legacy=0x7fbb180ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.653 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.651+0000 7fbb1d800640 1 -- 172.21.15.5:0/2464653789 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb180ce0c0 con 0x7fbb180d03d0 2024-08-17T02:46:52.653 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.652+0000 7fbb1d800640 1 --2- 172.21.15.5:0/2464653789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb180d03d0 0x7fbb180cd210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbb10009e60 tx=0x7fbb10009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=499950e23ab6596b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:52.654 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.652+0000 7fbb17400640 1 -- 172.21.15.5:0/2464653789 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10007550 con 0x7fbb180d03d0 2024-08-17T02:46:52.655 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.652+0000 7fbb17400640 1 -- 172.21.15.5:0/2464653789 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1002d050 con 0x7fbb180d03d0 2024-08-17T02:46:52.655 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.652+0000 7fbb17400640 1 -- 172.21.15.5:0/2464653789 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb100078e0 con 0x7fbb180d03d0 2024-08-17T02:46:52.655 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.653+0000 7fbb1e200640 1 -- 172.21.15.5:0/2464653789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb180d03d0 msgr2=0x7fbb180cd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.655 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.653+0000 7fbb1e200640 1 --2- 172.21.15.5:0/2464653789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb180d03d0 0x7fbb180cd210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbb10009e60 tx=0x7fbb10009780 comp rx=0 tx=0).stop 2024-08-17T02:46:52.655 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.653+0000 7fbb1e200640 1 -- 172.21.15.5:0/2464653789 shutdown_connections 2024-08-17T02:46:52.655 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.653+0000 7fbb1e200640 1 --2- 172.21.15.5:0/2464653789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb180d03d0 0x7fbb180cd210 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.655 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.653+0000 7fbb1e200640 1 -- 172.21.15.5:0/2464653789 >> 172.21.15.5:0/2464653789 conn(0x7fbb1806e4e0 msgr2=0x7fbb1806e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:52.655 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.653+0000 7fbb1e200640 1 -- 172.21.15.5:0/2464653789 shutdown_connections 2024-08-17T02:46:52.655 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.653+0000 7fbb1e200640 1 -- 172.21.15.5:0/2464653789 wait complete. 2024-08-17T02:46:52.656 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.654+0000 7fbb1e200640 1 Processor -- start 2024-08-17T02:46:52.656 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.654+0000 7fbb1e200640 1 -- start start 2024-08-17T02:46:52.658 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.655+0000 7fbb1e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb180d03d0 0x7fbb18154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.658 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.655+0000 7fbb1e200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb18158c10 0x7fbb1815de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.658 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.655+0000 7fbb1e200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb18158fe0 0x7fbb1815e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.658 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.655+0000 7fbb1e200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb180c5ad0 con 0x7fbb180d03d0 2024-08-17T02:46:52.658 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.655+0000 7fbb1e200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1815e8c0 con 0x7fbb18158c10 2024-08-17T02:46:52.658 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.655+0000 7fbb1e200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb180c4ec0 con 0x7fbb18158fe0 2024-08-17T02:46:52.658 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.656+0000 7fbb1ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb180d03d0 0x7fbb18154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.659 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.656+0000 7fbb1ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb180d03d0 0x7fbb18154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52736/0 (socket says 172.21.15.5:52736) 2024-08-17T02:46:52.659 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.656+0000 7fbb1ce00640 1 -- 172.21.15.5:0/1772412319 learned_addr learned my addr 172.21.15.5:0/1772412319 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:52.659 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.656+0000 7fbb17e00640 1 --2- 172.21.15.5:0/1772412319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb18158c10 0x7fbb1815de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.659 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.656+0000 7fbb1d800640 1 --2- 172.21.15.5:0/1772412319 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb18158fe0 0x7fbb1815e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.659 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.656+0000 7fbb1ce00640 1 -- 172.21.15.5:0/1772412319 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb18158fe0 msgr2=0x7fbb1815e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.659 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.656+0000 7fbb1ce00640 1 --2- 172.21.15.5:0/1772412319 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb18158fe0 0x7fbb1815e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.659 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.656+0000 7fbb1ce00640 1 -- 172.21.15.5:0/1772412319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb18158c10 msgr2=0x7fbb1815de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.659 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.656+0000 7fbb1ce00640 1 --2- 172.21.15.5:0/1772412319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb18158c10 0x7fbb1815de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.659 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.656+0000 7fbb1ce00640 1 -- 172.21.15.5:0/1772412319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb10009a20 con 0x7fbb180d03d0 2024-08-17T02:46:52.659 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.656+0000 7fbb1ce00640 1 --2- 172.21.15.5:0/1772412319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb180d03d0 0x7fbb18154d60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00c5b0 tx=0x7fbb0c007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:52.660 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.657+0000 7fbb0be00640 1 -- 172.21.15.5:0/1772412319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c005b70 con 0x7fbb180d03d0 2024-08-17T02:46:52.660 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.657+0000 7fbb0be00640 1 -- 172.21.15.5:0/1772412319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c005cf0 con 0x7fbb180d03d0 2024-08-17T02:46:52.660 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.657+0000 7fbb1e200640 1 -- 172.21.15.5:0/1772412319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb180c51a0 con 0x7fbb180d03d0 2024-08-17T02:46:52.660 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.657+0000 7fbb0be00640 1 -- 172.21.15.5:0/1772412319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c007340 con 0x7fbb180d03d0 2024-08-17T02:46:52.660 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.657+0000 7fbb1e200640 1 -- 172.21.15.5:0/1772412319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb180c5760 con 0x7fbb180d03d0 2024-08-17T02:46:52.661 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.658+0000 7fbb1e200640 1 -- 172.21.15.5:0/1772412319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb18064540 con 0x7fbb180d03d0 2024-08-17T02:46:52.661 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.659+0000 7fbb0be00640 1 -- 172.21.15.5:0/1772412319 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbb0c01b400 con 0x7fbb180d03d0 2024-08-17T02:46:52.661 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.659+0000 7fbb0be00640 1 --2- 172.21.15.5:0/1772412319 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbaf8065150 0x7fbaf8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.661 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.660+0000 7fbb0be00640 1 -- 172.21.15.5:0/1772412319 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbb0c081c30 con 0x7fbb180d03d0 2024-08-17T02:46:52.661 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.660+0000 7fbb17e00640 1 --2- 172.21.15.5:0/1772412319 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbaf8065150 0x7fbaf8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.662 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.660+0000 7fbb17e00640 1 --2- 172.21.15.5:0/1772412319 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbaf8065150 0x7fbaf8067600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb181585d0 tx=0x7fbb04007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:52.665 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.664+0000 7fbb0be00640 1 -- 172.21.15.5:0/1772412319 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbb0c050020 con 0x7fbb180d03d0 2024-08-17T02:46:52.846 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.845+0000 7fbb1e200640 1 -- 172.21.15.5:0/1772412319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb18071010 con 0x7fbb180d03d0 2024-08-17T02:46:52.847 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.846+0000 7fbb0be00640 1 -- 172.21.15.5:0/1772412319 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12079 (secure 0 0 0) 0x7fbb0c053640 con 0x7fbb180d03d0 2024-08-17T02:46:52.848 INFO:teuthology.misc.health.smithi005.stdout: 2024-08-17T02:46:52.848 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":16,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:49.110477+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:52.850 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.847+0000 7fbb1e200640 1 -- 172.21.15.5:0/1772412319 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbaf8065150 msgr2=0x7fbaf8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.850 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.847+0000 7fbb1e200640 1 --2- 172.21.15.5:0/1772412319 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbaf8065150 0x7fbaf8067600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb181585d0 tx=0x7fbb04007e30 comp rx=0 tx=0).stop 2024-08-17T02:46:52.850 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.847+0000 7fbb1e200640 1 -- 172.21.15.5:0/1772412319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb180d03d0 msgr2=0x7fbb18154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.850 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.847+0000 7fbb1e200640 1 --2- 172.21.15.5:0/1772412319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb180d03d0 0x7fbb18154d60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00c5b0 tx=0x7fbb0c007d70 comp rx=0 tx=0).stop 2024-08-17T02:46:52.850 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.848+0000 7fbb1e200640 1 -- 172.21.15.5:0/1772412319 shutdown_connections 2024-08-17T02:46:52.851 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.848+0000 7fbb1e200640 1 --2- 172.21.15.5:0/1772412319 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbaf8065150 0x7fbaf8067600 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.851 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.848+0000 7fbb1e200640 1 --2- 172.21.15.5:0/1772412319 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb18158fe0 0x7fbb1815e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.851 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.848+0000 7fbb1e200640 1 --2- 172.21.15.5:0/1772412319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb18158c10 0x7fbb1815de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.851 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.848+0000 7fbb1e200640 1 --2- 172.21.15.5:0/1772412319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb180d03d0 0x7fbb18154d60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.851 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.848+0000 7fbb1e200640 1 -- 172.21.15.5:0/1772412319 >> 172.21.15.5:0/1772412319 conn(0x7fbb1806e4e0 msgr2=0x7fbb1814d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:52.851 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.848+0000 7fbb1e200640 1 -- 172.21.15.5:0/1772412319 shutdown_connections 2024-08-17T02:46:52.851 INFO:teuthology.misc.health.smithi005.stderr:2024-08-17T02:46:52.848+0000 7fbb1e200640 1 -- 172.21.15.5:0/1772412319 wait complete. 2024-08-17T02:46:52.862 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:46:52.862 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:46:52.863 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:46:52.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:46:52.867 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:46:52.867 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:46:52.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:46:52.870 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:46:52.870 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:46:52.871 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:46:52.875 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:46:52.875 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:46:52.875 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:46:52.879 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:46:52.879 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:46:52.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:52.994 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-17T02:46:52.994 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-17T02:46:53.008 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-08-17T02:46:53.010 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-08-17T02:46:53.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.039+0000 7f5a7e200640 1 Processor -- start 2024-08-17T02:46:53.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.039+0000 7f5a7e200640 1 -- start start 2024-08-17T02:46:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.040+0000 7f5a7e200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5a78158c60 0x7f5a7815a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.040+0000 7f5a7e200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a780b1920 0x7f5a780b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.040+0000 7f5a7e200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7815b6b0 con 0x7f5a78159030 2024-08-17T02:46:53.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.040+0000 7f5a7e200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a780b0540 con 0x7f5a780b1920 2024-08-17T02:46:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.040+0000 7f5a7e200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7815aac0 con 0x7f5a78158c60 2024-08-17T02:46:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.040+0000 7f5a7d800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a780b1920 0x7f5a780b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.040+0000 7f5a7d800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a780b1920 0x7f5a780b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52786/0 (socket says 172.21.15.5:52786) 2024-08-17T02:46:53.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.040+0000 7f5a7d800640 1 -- 172.21.15.5:0/1102540960 learned_addr learned my addr 172.21.15.5:0/1102540960 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.040+0000 7f5a7ce00640 1 --2- 172.21.15.5:0/1102540960 >> v2:172.21.15.107:3300/0 conn(0x7f5a78158c60 0x7f5a7815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.041+0000 7f5a7d800640 1 -- 172.21.15.5:0/1102540960 >> v2:172.21.15.107:3300/0 conn(0x7f5a78158c60 msgr2=0x7f5a7815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.041+0000 7f5a7d800640 1 --2- 172.21.15.5:0/1102540960 >> v2:172.21.15.107:3300/0 conn(0x7f5a78158c60 0x7f5a7815a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.041+0000 7f5a7d800640 1 -- 172.21.15.5:0/1102540960 >> v1:172.21.15.107:6789/0 conn(0x7f5a78159030 legacy=0x7f5a780ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.041+0000 7f5a7d800640 1 -- 172.21.15.5:0/1102540960 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7815ad80 con 0x7f5a780b1920 2024-08-17T02:46:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.042+0000 7f5a7d800640 1 --2- 172.21.15.5:0/1102540960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a780b1920 0x7f5a780b1d20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5a780889c0 tx=0x7f5a70009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284e058713625aaa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.042+0000 7f5a77400640 1 -- 172.21.15.5:0/1102540960 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7002e050 con 0x7f5a780b1920 2024-08-17T02:46:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.042+0000 7f5a77400640 1 -- 172.21.15.5:0/1102540960 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a70007400 con 0x7f5a780b1920 2024-08-17T02:46:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.042+0000 7f5a77400640 1 -- 172.21.15.5:0/1102540960 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a700077e0 con 0x7f5a780b1920 2024-08-17T02:46:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.043+0000 7f5a7e200640 1 -- 172.21.15.5:0/1102540960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a780b1920 msgr2=0x7f5a780b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.043+0000 7f5a7e200640 1 --2- 172.21.15.5:0/1102540960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a780b1920 0x7f5a780b1d20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5a780889c0 tx=0x7f5a70009840 comp rx=0 tx=0).stop 2024-08-17T02:46:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.043+0000 7f5a7e200640 1 -- 172.21.15.5:0/1102540960 shutdown_connections 2024-08-17T02:46:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.043+0000 7f5a7e200640 1 --2- 172.21.15.5:0/1102540960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a780b1920 0x7f5a780b1d20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.043+0000 7f5a7e200640 1 --2- 172.21.15.5:0/1102540960 >> v2:172.21.15.107:3300/0 conn(0x7f5a78158c60 0x7f5a7815a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.043+0000 7f5a7e200640 1 -- 172.21.15.5:0/1102540960 >> 172.21.15.5:0/1102540960 conn(0x7f5a7806e590 msgr2=0x7f5a7806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.043+0000 7f5a7e200640 1 -- 172.21.15.5:0/1102540960 shutdown_connections 2024-08-17T02:46:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.043+0000 7f5a7e200640 1 -- 172.21.15.5:0/1102540960 wait complete. 2024-08-17T02:46:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.044+0000 7f5a7e200640 1 Processor -- start 2024-08-17T02:46:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.044+0000 7f5a7e200640 1 -- start start 2024-08-17T02:46:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.045+0000 7f5a7e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a780b1920 0x7f5a78157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.045+0000 7f5a7e200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a78158c60 0x7f5a780c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.045+0000 7f5a7e200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a78159030 0x7f5a7815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.045+0000 7f5a7e200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a780c4640 con 0x7f5a780b1920 2024-08-17T02:46:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.045+0000 7f5a7e200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a780c4340 con 0x7f5a78159030 2024-08-17T02:46:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.045+0000 7f5a7e200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7815f0b0 con 0x7f5a78158c60 2024-08-17T02:46:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.045+0000 7f5a7ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a780b1920 0x7f5a78157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.045+0000 7f5a7ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a780b1920 0x7f5a78157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52792/0 (socket says 172.21.15.5:52792) 2024-08-17T02:46:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.045+0000 7f5a7ce00640 1 -- 172.21.15.5:0/3346672717 learned_addr learned my addr 172.21.15.5:0/3346672717 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.045+0000 7f5a77e00640 1 --2- 172.21.15.5:0/3346672717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a78158c60 0x7f5a780c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.045+0000 7f5a7d800640 1 --2- 172.21.15.5:0/3346672717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a78159030 0x7f5a7815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.046+0000 7f5a7d800640 1 -- 172.21.15.5:0/3346672717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a78158c60 msgr2=0x7f5a780c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.046+0000 7f5a7d800640 1 --2- 172.21.15.5:0/3346672717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a78158c60 0x7f5a780c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.046+0000 7f5a7d800640 1 -- 172.21.15.5:0/3346672717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a780b1920 msgr2=0x7f5a78157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.046+0000 7f5a7d800640 1 --2- 172.21.15.5:0/3346672717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a780b1920 0x7f5a78157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.046+0000 7f5a7d800640 1 -- 172.21.15.5:0/3346672717 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a70009ae0 con 0x7f5a78159030 2024-08-17T02:46:53.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.046+0000 7f5a7d800640 1 --2- 172.21.15.5:0/3346672717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a78159030 0x7f5a7815e0b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5a70031000 tx=0x7f5a70037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.046+0000 7f5a6be00640 1 -- 172.21.15.5:0/3346672717 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a70033e40 con 0x7f5a78159030 2024-08-17T02:46:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.046+0000 7f5a6be00640 1 -- 172.21.15.5:0/3346672717 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7003c410 con 0x7f5a78159030 2024-08-17T02:46:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.046+0000 7f5a7e200640 1 -- 172.21.15.5:0/3346672717 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7815f390 con 0x7f5a78159030 2024-08-17T02:46:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.047+0000 7f5a6be00640 1 -- 172.21.15.5:0/3346672717 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7003c7d0 con 0x7f5a78159030 2024-08-17T02:46:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.047+0000 7f5a7e200640 1 -- 172.21.15.5:0/3346672717 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a781581b0 con 0x7f5a78159030 2024-08-17T02:46:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.048+0000 7f5a69600640 1 -- 172.21.15.5:0/3346672717 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a780c47f0 con 0x7f5a78159030 2024-08-17T02:46:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.048+0000 7f5a6be00640 1 -- 172.21.15.5:0/3346672717 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5a70039050 con 0x7f5a78159030 2024-08-17T02:46:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.049+0000 7f5a6be00640 1 --2- 172.21.15.5:0/3346672717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5a58065150 0x7f5a58067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.049+0000 7f5a6be00640 1 -- 172.21.15.5:0/3346672717 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5a700a2a60 con 0x7f5a78159030 2024-08-17T02:46:53.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.049+0000 7f5a7ce00640 1 --2- 172.21.15.5:0/3346672717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5a58065150 0x7f5a58067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.050+0000 7f5a7ce00640 1 --2- 172.21.15.5:0/3346672717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5a58065150 0x7f5a58067600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c007c70 tx=0x7f5a6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.054+0000 7f5a6be00640 1 -- 172.21.15.5:0/3346672717 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5a780c47f0 con 0x7f5a78159030 2024-08-17T02:46:53.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.236+0000 7f5a69600640 1 -- 172.21.15.5:0/3346672717 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a780c47f0 con 0x7f5a78159030 2024-08-17T02:46:53.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.237+0000 7f5a6be00640 1 -- 172.21.15.5:0/3346672717 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f5a780c47f0 con 0x7f5a78159030 2024-08-17T02:46:53.238 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:46:53.238 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:49.110477+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:53.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.239+0000 7f5a69600640 1 -- 172.21.15.5:0/3346672717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5a58065150 msgr2=0x7f5a58067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.239+0000 7f5a69600640 1 --2- 172.21.15.5:0/3346672717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5a58065150 0x7f5a58067600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c007c70 tx=0x7f5a6c008040 comp rx=0 tx=0).stop 2024-08-17T02:46:53.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.239+0000 7f5a69600640 1 -- 172.21.15.5:0/3346672717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a78159030 msgr2=0x7f5a7815e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.239+0000 7f5a69600640 1 --2- 172.21.15.5:0/3346672717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a78159030 0x7f5a7815e0b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5a70031000 tx=0x7f5a70037000 comp rx=0 tx=0).stop 2024-08-17T02:46:53.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.239+0000 7f5a69600640 1 -- 172.21.15.5:0/3346672717 shutdown_connections 2024-08-17T02:46:53.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.239+0000 7f5a69600640 1 --2- 172.21.15.5:0/3346672717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5a58065150 0x7f5a58067600 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.239+0000 7f5a69600640 1 --2- 172.21.15.5:0/3346672717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a78159030 0x7f5a7815e0b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.239+0000 7f5a69600640 1 --2- 172.21.15.5:0/3346672717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5a78158c60 0x7f5a780c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.239+0000 7f5a69600640 1 --2- 172.21.15.5:0/3346672717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a780b1920 0x7f5a78157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.239+0000 7f5a69600640 1 -- 172.21.15.5:0/3346672717 >> 172.21.15.5:0/3346672717 conn(0x7f5a7806e590 msgr2=0x7f5a780cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:53.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.239+0000 7f5a69600640 1 -- 172.21.15.5:0/3346672717 shutdown_connections 2024-08-17T02:46:53.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.239+0000 7f5a69600640 1 -- 172.21.15.5:0/3346672717 wait complete. 2024-08-17T02:46:53.255 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:47.106425+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:46:53.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.410+0000 7f9dc9600640 1 Processor -- start 2024-08-17T02:46:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.411+0000 7f9dc9600640 1 -- start start 2024-08-17T02:46:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.412+0000 7f9dc9600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9dc41565e0 0x7f9dc40cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.412+0000 7f9dc9600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9dc40cc4f0 0x7f9dc40cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.412+0000 7f9dc9600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc40cde80 con 0x7f9dc41569b0 2024-08-17T02:46:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.412+0000 7f9dc9600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc40af500 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.412+0000 7f9dc9600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc40ce440 con 0x7f9dc41565e0 2024-08-17T02:46:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.412+0000 7f9dc8c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9dc40cc4f0 0x7f9dc40cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.412+0000 7f9dbbe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9dc41569b0 0x7f9dc4159ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51600/0 (socket says 172.21.15.5:51600) 2024-08-17T02:46:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.412+0000 7f9dc8c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9dc40cc4f0 0x7f9dc40cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52804/0 (socket says 172.21.15.5:52804) 2024-08-17T02:46:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.412+0000 7f9dbbe00640 1 -- 172.21.15.5:0/285260160 learned_addr learned my addr 172.21.15.5:0/285260160 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:46:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.412+0000 7f9dc3e00640 1 --2- 172.21.15.5:0/285260160 >> v2:172.21.15.107:3300/0 conn(0x7f9dc41565e0 0x7f9dc40cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.413+0000 7f9dc8c00640 1 -- 172.21.15.5:0/285260160 >> v2:172.21.15.107:3300/0 conn(0x7f9dc41565e0 msgr2=0x7f9dc40cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.413+0000 7f9dc8c00640 1 --2- 172.21.15.5:0/285260160 >> v2:172.21.15.107:3300/0 conn(0x7f9dc41565e0 0x7f9dc40cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.413+0000 7f9dc8c00640 1 -- 172.21.15.5:0/285260160 >> v1:172.21.15.5:6789/0 conn(0x7f9dc41569b0 legacy=0x7f9dc4159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.413+0000 7f9dc8c00640 1 -- 172.21.15.5:0/285260160 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc415a340 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.413+0000 7f9dc3e00640 1 --2- 172.21.15.5:0/285260160 >> v2:172.21.15.107:3300/0 conn(0x7f9dc41565e0 0x7f9dc40cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.414+0000 7f9dc8c00640 1 --2- 172.21.15.5:0/285260160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dc40cc4f0 0x7f9dc40cc970 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4064910 tx=0x7f9dbc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f2d062aed3f14b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.414+0000 7f9dc3400640 1 -- 172.21.15.5:0/285260160 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc007550 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.414+0000 7f9dc3400640 1 -- 172.21.15.5:0/285260160 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc02d050 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.414+0000 7f9dc3400640 1 -- 172.21.15.5:0/285260160 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc007920 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.414+0000 7f9dc9600640 1 -- 172.21.15.5:0/285260160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dc40cc4f0 msgr2=0x7f9dc40cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.414+0000 7f9dc9600640 1 --2- 172.21.15.5:0/285260160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dc40cc4f0 0x7f9dc40cc970 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4064910 tx=0x7f9dbc009780 comp rx=0 tx=0).stop 2024-08-17T02:46:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.414+0000 7f9dc9600640 1 -- 172.21.15.5:0/285260160 shutdown_connections 2024-08-17T02:46:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.414+0000 7f9dc9600640 1 --2- 172.21.15.5:0/285260160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dc40cc4f0 0x7f9dc40cc970 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.414+0000 7f9dc9600640 1 --2- 172.21.15.5:0/285260160 >> v2:172.21.15.107:3300/0 conn(0x7f9dc41565e0 0x7f9dc40cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.414+0000 7f9dc9600640 1 -- 172.21.15.5:0/285260160 >> 172.21.15.5:0/285260160 conn(0x7f9dc4087a80 msgr2=0x7f9dc406e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.415+0000 7f9dc9600640 1 -- 172.21.15.5:0/285260160 shutdown_connections 2024-08-17T02:46:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.415+0000 7f9dc9600640 1 -- 172.21.15.5:0/285260160 wait complete. 2024-08-17T02:46:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.416+0000 7f9dc9600640 1 Processor -- start 2024-08-17T02:46:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.416+0000 7f9dc9600640 1 -- start start 2024-08-17T02:46:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.417+0000 7f9dc9600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dc40cc4f0 0x7f9dc40c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.417+0000 7f9dc9600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dc41565e0 0x7f9dc41694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.417+0000 7f9dc9600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9dc414c540 0x7f9dc40c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.417+0000 7f9dc9600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc4169a20 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.417+0000 7f9dc9600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40c72a0 con 0x7f9dc41565e0 2024-08-17T02:46:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.417+0000 7f9dc9600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40c7580 con 0x7f9dc414c540 2024-08-17T02:46:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.417+0000 7f9dc3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dc40cc4f0 0x7f9dc40c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.417+0000 7f9dc3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dc40cc4f0 0x7f9dc40c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52812/0 (socket says 172.21.15.5:52812) 2024-08-17T02:46:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.417+0000 7f9dc3e00640 1 -- 172.21.15.5:0/3425228021 learned_addr learned my addr 172.21.15.5:0/3425228021 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.417+0000 7f9dc8c00640 1 --2- 172.21.15.5:0/3425228021 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9dc414c540 0x7f9dc40c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.417+0000 7f9dbbe00640 1 --2- 172.21.15.5:0/3425228021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dc41565e0 0x7f9dc41694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.418+0000 7f9dc3e00640 1 -- 172.21.15.5:0/3425228021 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9dc414c540 msgr2=0x7f9dc40c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.418+0000 7f9dc3e00640 1 --2- 172.21.15.5:0/3425228021 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9dc414c540 0x7f9dc40c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.418+0000 7f9dc3e00640 1 -- 172.21.15.5:0/3425228021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dc41565e0 msgr2=0x7f9dc41694e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.418+0000 7f9dc3e00640 1 --2- 172.21.15.5:0/3425228021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dc41565e0 0x7f9dc41694e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.418+0000 7f9dc3e00640 1 -- 172.21.15.5:0/3425228021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc009a20 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.418+0000 7f9dc3e00640 1 --2- 172.21.15.5:0/3425228021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dc40cc4f0 0x7f9dc40c6cc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9db400d890 tx=0x7f9db4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.418+0000 7f9dbb400640 1 -- 172.21.15.5:0/3425228021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db400de80 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.418+0000 7f9dbb400640 1 -- 172.21.15.5:0/3425228021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db400b8d0 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.418+0000 7f9dc9600640 1 -- 172.21.15.5:0/3425228021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc40c7860 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.418+0000 7f9dbb400640 1 -- 172.21.15.5:0/3425228021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db400bc90 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.418+0000 7f9dc9600640 1 -- 172.21.15.5:0/3425228021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc40c7e20 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.420+0000 7f9dc9600640 1 -- 172.21.15.5:0/3425228021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc4070720 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.420+0000 7f9dbb400640 1 -- 172.21.15.5:0/3425228021 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9db401e460 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.421+0000 7f9dbb400640 1 --2- 172.21.15.5:0/3425228021 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9da0065150 0x7f9da0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.421+0000 7f9dbb400640 1 -- 172.21.15.5:0/3425228021 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9db40828f0 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.421+0000 7f9dbbe00640 1 --2- 172.21.15.5:0/3425228021 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9da0065150 0x7f9da0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.422+0000 7f9dbbe00640 1 --2- 172.21.15.5:0/3425228021 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9da0065150 0x7f9da0067600 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40c6c70 tx=0x7f9dac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.425+0000 7f9dbb400640 1 -- 172.21.15.5:0/3425228021 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9db4050c60 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.610+0000 7f9dc9600640 1 -- 172.21.15.5:0/3425228021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9dc40b2210 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.610+0000 7f9dbb400640 1 -- 172.21.15.5:0/3425228021 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9db4054280 con 0x7f9dc40cc4f0 2024-08-17T02:46:53.612 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:46:53.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.612+0000 7f9dc9600640 1 -- 172.21.15.5:0/3425228021 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9da0065150 msgr2=0x7f9da0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.612+0000 7f9dc9600640 1 --2- 172.21.15.5:0/3425228021 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9da0065150 0x7f9da0067600 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40c6c70 tx=0x7f9dac009040 comp rx=0 tx=0).stop 2024-08-17T02:46:53.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.612+0000 7f9dc9600640 1 -- 172.21.15.5:0/3425228021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dc40cc4f0 msgr2=0x7f9dc40c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.612+0000 7f9dc9600640 1 --2- 172.21.15.5:0/3425228021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dc40cc4f0 0x7f9dc40c6cc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9db400d890 tx=0x7f9db4008040 comp rx=0 tx=0).stop 2024-08-17T02:46:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.612+0000 7f9dc9600640 1 -- 172.21.15.5:0/3425228021 shutdown_connections 2024-08-17T02:46:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.612+0000 7f9dc9600640 1 --2- 172.21.15.5:0/3425228021 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9da0065150 0x7f9da0067600 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.612+0000 7f9dc9600640 1 --2- 172.21.15.5:0/3425228021 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9dc414c540 0x7f9dc40c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.612+0000 7f9dc9600640 1 --2- 172.21.15.5:0/3425228021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dc41565e0 0x7f9dc41694e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.612+0000 7f9dc9600640 1 --2- 172.21.15.5:0/3425228021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dc40cc4f0 0x7f9dc40c6cc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.613+0000 7f9dc9600640 1 -- 172.21.15.5:0/3425228021 >> 172.21.15.5:0/3425228021 conn(0x7f9dc4087a80 msgr2=0x7f9dc40c6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.613+0000 7f9dc9600640 1 -- 172.21.15.5:0/3425228021 shutdown_connections 2024-08-17T02:46:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.613+0000 7f9dc9600640 1 -- 172.21.15.5:0/3425228021 wait complete. 2024-08-17T02:46:53.629 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.777+0000 7f4711400640 1 Processor -- start 2024-08-17T02:46:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.778+0000 7f4711400640 1 -- start start 2024-08-17T02:46:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.779+0000 7f4711400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f470c156f90 0x7f470c0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.779+0000 7f4711400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f470c15a590 0x7f470c13fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.779+0000 7f4711400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470c06d7c0 con 0x7f470c0b0e30 2024-08-17T02:46:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.779+0000 7f4711400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470c15ab30 con 0x7f470c15a590 2024-08-17T02:46:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.779+0000 7f4711400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470c15ae10 con 0x7f470c156f90 2024-08-17T02:46:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.779+0000 7f470be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f470c0b0e30 0x7f470c0cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51614/0 (socket says 172.21.15.5:51614) 2024-08-17T02:46:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.779+0000 7f470be00640 1 -- 172.21.15.5:0/1380380850 learned_addr learned my addr 172.21.15.5:0/1380380850 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:46:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.779+0000 7f4710a00640 1 --2- 172.21.15.5:0/1380380850 >> v2:172.21.15.5:3300/0 conn(0x7f470c15a590 0x7f470c13fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.779+0000 7f4703e00640 1 --2- 172.21.15.5:0/1380380850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f470c156f90 0x7f470c0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.780+0000 7f470b400640 1 -- 172.21.15.5:0/1380380850 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844564409 0 0) 0x7f470c06d7c0 con 0x7f470c0b0e30 2024-08-17T02:46:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.780+0000 7f470b400640 1 -- 172.21.15.5:0/1380380850 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46f00034e0 con 0x7f470c0b0e30 2024-08-17T02:46:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.780+0000 7f4710a00640 1 -- 172.21.15.5:0/1380380850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f470c156f90 msgr2=0x7f470c0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.780+0000 7f4710a00640 1 --2- 172.21.15.5:0/1380380850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f470c156f90 0x7f470c0b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.780+0000 7f4710a00640 1 -- 172.21.15.5:0/1380380850 >> v1:172.21.15.5:6789/0 conn(0x7f470c0b0e30 legacy=0x7f470c0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.780+0000 7f4710a00640 1 -- 172.21.15.5:0/1380380850 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c15b0f0 con 0x7f470c15a590 2024-08-17T02:46:53.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.781+0000 7f4710a00640 1 --2- 172.21.15.5:0/1380380850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c15a590 0x7f470c13fcc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4704009e60 tx=0x7f4704009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d9f1202d65c989 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.781+0000 7f470b400640 1 -- 172.21.15.5:0/1380380850 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704007550 con 0x7f470c15a590 2024-08-17T02:46:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.781+0000 7f470b400640 1 -- 172.21.15.5:0/1380380850 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470402d050 con 0x7f470c15a590 2024-08-17T02:46:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.781+0000 7f470b400640 1 -- 172.21.15.5:0/1380380850 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704007900 con 0x7f470c15a590 2024-08-17T02:46:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.781+0000 7f4711400640 1 -- 172.21.15.5:0/1380380850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c15a590 msgr2=0x7f470c13fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.781+0000 7f4711400640 1 --2- 172.21.15.5:0/1380380850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c15a590 0x7f470c13fcc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4704009e60 tx=0x7f4704009780 comp rx=0 tx=0).stop 2024-08-17T02:46:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.782+0000 7f4711400640 1 -- 172.21.15.5:0/1380380850 shutdown_connections 2024-08-17T02:46:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.782+0000 7f4711400640 1 --2- 172.21.15.5:0/1380380850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c15a590 0x7f470c13fcc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.782+0000 7f4711400640 1 --2- 172.21.15.5:0/1380380850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f470c156f90 0x7f470c0b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.782+0000 7f4711400640 1 -- 172.21.15.5:0/1380380850 >> 172.21.15.5:0/1380380850 conn(0x7f470c062af0 msgr2=0x7f470c062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.782+0000 7f4711400640 1 -- 172.21.15.5:0/1380380850 shutdown_connections 2024-08-17T02:46:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.782+0000 7f4711400640 1 -- 172.21.15.5:0/1380380850 wait complete. 2024-08-17T02:46:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.783+0000 7f4711400640 1 Processor -- start 2024-08-17T02:46:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.783+0000 7f4711400640 1 -- start start 2024-08-17T02:46:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.784+0000 7f4711400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f470c0b0e30 0x7f470c1588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.784+0000 7f4711400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c156f90 0x7f470c136150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.784+0000 7f4711400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f470c15a590 0x7f470c138220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.784+0000 7f4711400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c1591a0 con 0x7f470c156f90 2024-08-17T02:46:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.784+0000 7f4711400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c159480 con 0x7f470c0b0e30 2024-08-17T02:46:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.784+0000 7f4711400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470c159760 con 0x7f470c15a590 2024-08-17T02:46:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.784+0000 7f4703e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c156f90 0x7f470c136150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.784+0000 7f4703e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c156f90 0x7f470c136150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52830/0 (socket says 172.21.15.5:52830) 2024-08-17T02:46:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.784+0000 7f4703e00640 1 -- 172.21.15.5:0/869501502 learned_addr learned my addr 172.21.15.5:0/869501502 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.784+0000 7f470be00640 1 --2- 172.21.15.5:0/869501502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f470c0b0e30 0x7f470c1588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.784+0000 7f4710a00640 1 --2- 172.21.15.5:0/869501502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f470c15a590 0x7f470c138220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.785+0000 7f4703e00640 1 -- 172.21.15.5:0/869501502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f470c15a590 msgr2=0x7f470c138220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.785+0000 7f4703e00640 1 --2- 172.21.15.5:0/869501502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f470c15a590 0x7f470c138220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.785+0000 7f4703e00640 1 -- 172.21.15.5:0/869501502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f470c0b0e30 msgr2=0x7f470c1588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.785+0000 7f4703e00640 1 --2- 172.21.15.5:0/869501502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f470c0b0e30 0x7f470c1588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.785+0000 7f4703e00640 1 -- 172.21.15.5:0/869501502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4704009a20 con 0x7f470c156f90 2024-08-17T02:46:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.785+0000 7f4703e00640 1 --2- 172.21.15.5:0/869501502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c156f90 0x7f470c136150 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f46f400ea20 tx=0x7f46f40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.785+0000 7f4703400640 1 -- 172.21.15.5:0/869501502 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f400ca10 con 0x7f470c156f90 2024-08-17T02:46:53.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.785+0000 7f4703400640 1 -- 172.21.15.5:0/869501502 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f400cb70 con 0x7f470c156f90 2024-08-17T02:46:53.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.785+0000 7f4703400640 1 -- 172.21.15.5:0/869501502 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4013470 con 0x7f470c156f90 2024-08-17T02:46:53.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.785+0000 7f4711400640 1 -- 172.21.15.5:0/869501502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470c159a40 con 0x7f470c156f90 2024-08-17T02:46:53.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.785+0000 7f4711400640 1 -- 172.21.15.5:0/869501502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470c15a240 con 0x7f470c156f90 2024-08-17T02:46:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.786+0000 7f4711400640 1 -- 172.21.15.5:0/869501502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470c070720 con 0x7f470c156f90 2024-08-17T02:46:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.787+0000 7f4703400640 1 -- 172.21.15.5:0/869501502 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f46f4013860 con 0x7f470c156f90 2024-08-17T02:46:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.788+0000 7f4703400640 1 --2- 172.21.15.5:0/869501502 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f46e8065150 0x7f46e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.788+0000 7f4703400640 1 -- 172.21.15.5:0/869501502 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f46f40823e0 con 0x7f470c156f90 2024-08-17T02:46:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.788+0000 7f470be00640 1 --2- 172.21.15.5:0/869501502 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f46e8065150 0x7f46e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.789+0000 7f470be00640 1 --2- 172.21.15.5:0/869501502 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f46e8065150 0x7f46e8067600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f46fc005840 tx=0x7f46fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:53.792+0000 7f4703400640 1 -- 172.21.15.5:0/869501502 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f46f4050800 con 0x7f470c156f90 2024-08-17T02:46:54.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.018+0000 7f4711400640 1 -- 172.21.15.5:0/869501502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f470c1545f0 con 0x7f470c156f90 2024-08-17T02:46:54.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.018+0000 7f4703400640 1 -- 172.21.15.5:0/869501502 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f46f4017de0 con 0x7f470c156f90 2024-08-17T02:46:54.020 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:46:54.020 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/3624354828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3624354828},{"type":"v1","addr":"172.21.15.5:6836","nonce":3624354828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2614098803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2614098803},{"type":"v1","addr":"172.21.15.107:6835","nonce":2614098803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1090239725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1090239725},{"type":"v1","addr":"172.21.15.5:6837","nonce":1090239725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2631760450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2631760450},{"type":"v1","addr":"172.21.15.107:6834","nonce":2631760450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-08-17T02:46:54.020 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2024-08-17T02:46:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.021+0000 7f4711400640 1 -- 172.21.15.5:0/869501502 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f46e8065150 msgr2=0x7f46e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.021+0000 7f4711400640 1 --2- 172.21.15.5:0/869501502 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f46e8065150 0x7f46e8067600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f46fc005840 tx=0x7f46fc009040 comp rx=0 tx=0).stop 2024-08-17T02:46:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.021+0000 7f4711400640 1 -- 172.21.15.5:0/869501502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c156f90 msgr2=0x7f470c136150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.021+0000 7f4711400640 1 --2- 172.21.15.5:0/869501502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c156f90 0x7f470c136150 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f46f400ea20 tx=0x7f46f40090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.021+0000 7f4711400640 1 -- 172.21.15.5:0/869501502 shutdown_connections 2024-08-17T02:46:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.021+0000 7f4711400640 1 --2- 172.21.15.5:0/869501502 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f46e8065150 0x7f46e8067600 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.021+0000 7f4711400640 1 --2- 172.21.15.5:0/869501502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f470c15a590 0x7f470c138220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.021+0000 7f4711400640 1 --2- 172.21.15.5:0/869501502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f470c156f90 0x7f470c136150 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.021+0000 7f4711400640 1 --2- 172.21.15.5:0/869501502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f470c0b0e30 0x7f470c1588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.021+0000 7f4711400640 1 -- 172.21.15.5:0/869501502 >> 172.21.15.5:0/869501502 conn(0x7f470c062af0 msgr2=0x7f470c06dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.021+0000 7f4711400640 1 -- 172.21.15.5:0/869501502 shutdown_connections 2024-08-17T02:46:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.021+0000 7f4711400640 1 -- 172.21.15.5:0/869501502 wait complete. 2024-08-17T02:46:54.037 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:54.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.187+0000 7fef40400640 1 Processor -- start 2024-08-17T02:46:54.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.187+0000 7fef40400640 1 -- start start 2024-08-17T02:46:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.188+0000 7fef40400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fef38158a20 0x7fef380a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.188+0000 7fef40400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fef380ae860 0x7fef3806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.188+0000 7fef40400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef380aed90 con 0x7fef38158df0 2024-08-17T02:46:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.188+0000 7fef40400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef380af070 con 0x7fef38158a20 2024-08-17T02:46:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.188+0000 7fef40400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef380af350 con 0x7fef380ae860 2024-08-17T02:46:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.188+0000 7fef3da00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fef38158a20 0x7fef380a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.188+0000 7fef3e400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fef38158df0 0x7fef3815c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51616/0 (socket says 172.21.15.5:51616) 2024-08-17T02:46:54.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.188+0000 7fef3e400640 1 -- 172.21.15.5:0/3169705249 learned_addr learned my addr 172.21.15.5:0/3169705249 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:46:54.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.188+0000 7fef3d000640 1 --2- 172.21.15.5:0/3169705249 >> v2:172.21.15.107:3300/0 conn(0x7fef380ae860 0x7fef3806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.189+0000 7fef3da00640 1 -- 172.21.15.5:0/3169705249 >> v2:172.21.15.107:3300/0 conn(0x7fef380ae860 msgr2=0x7fef3806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:54.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.189+0000 7fef3da00640 1 --2- 172.21.15.5:0/3169705249 >> v2:172.21.15.107:3300/0 conn(0x7fef380ae860 0x7fef3806d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.189+0000 7fef3da00640 1 -- 172.21.15.5:0/3169705249 >> v1:172.21.15.5:6789/0 conn(0x7fef38158df0 legacy=0x7fef3815c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.189+0000 7fef3da00640 1 -- 172.21.15.5:0/3169705249 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef380af630 con 0x7fef38158a20 2024-08-17T02:46:54.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.190+0000 7fef3da00640 1 --2- 172.21.15.5:0/3169705249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef38158a20 0x7fef380a89c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fef380ab350 tx=0x7fef2c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332a8a418f0c3337 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.190+0000 7fef37e00640 1 -- 172.21.15.5:0/3169705249 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c02adb0 con 0x7fef38158a20 2024-08-17T02:46:54.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.190+0000 7fef37e00640 1 -- 172.21.15.5:0/3169705249 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c032440 con 0x7fef38158a20 2024-08-17T02:46:54.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.190+0000 7fef37e00640 1 -- 172.21.15.5:0/3169705249 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c032820 con 0x7fef38158a20 2024-08-17T02:46:54.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.191+0000 7fef40400640 1 -- 172.21.15.5:0/3169705249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef38158a20 msgr2=0x7fef380a89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.191+0000 7fef40400640 1 --2- 172.21.15.5:0/3169705249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef38158a20 0x7fef380a89c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fef380ab350 tx=0x7fef2c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.191+0000 7fef40400640 1 -- 172.21.15.5:0/3169705249 shutdown_connections 2024-08-17T02:46:54.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.191+0000 7fef40400640 1 --2- 172.21.15.5:0/3169705249 >> v2:172.21.15.107:3300/0 conn(0x7fef380ae860 0x7fef3806d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.191+0000 7fef40400640 1 --2- 172.21.15.5:0/3169705249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef38158a20 0x7fef380a89c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.191+0000 7fef40400640 1 -- 172.21.15.5:0/3169705249 >> 172.21.15.5:0/3169705249 conn(0x7fef38066e60 msgr2=0x7fef38067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:54.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.191+0000 7fef40400640 1 -- 172.21.15.5:0/3169705249 shutdown_connections 2024-08-17T02:46:54.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.191+0000 7fef40400640 1 -- 172.21.15.5:0/3169705249 wait complete. 2024-08-17T02:46:54.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.192+0000 7fef40400640 1 Processor -- start 2024-08-17T02:46:54.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.192+0000 7fef40400640 1 -- start start 2024-08-17T02:46:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.193+0000 7fef40400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef380ae860 0x7fef381484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.193+0000 7fef40400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef38158a20 0x7fef3806a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.193+0000 7fef40400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef38158df0 0x7fef3806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.193+0000 7fef40400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3814a5c0 con 0x7fef38158df0 2024-08-17T02:46:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.193+0000 7fef40400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef381499b0 con 0x7fef38158a20 2024-08-17T02:46:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.193+0000 7fef40400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef38149c90 con 0x7fef380ae860 2024-08-17T02:46:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.193+0000 7fef3e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef38158df0 0x7fef3806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.194+0000 7fef3e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef38158df0 0x7fef3806aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52862/0 (socket says 172.21.15.5:52862) 2024-08-17T02:46:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.194+0000 7fef3e400640 1 -- 172.21.15.5:0/3483807927 learned_addr learned my addr 172.21.15.5:0/3483807927 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.194+0000 7fef3da00640 1 --2- 172.21.15.5:0/3483807927 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef380ae860 0x7fef381484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.194+0000 7fef3d000640 1 --2- 172.21.15.5:0/3483807927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef38158a20 0x7fef3806a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.194+0000 7fef3e400640 1 -- 172.21.15.5:0/3483807927 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef380ae860 msgr2=0x7fef381484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.194+0000 7fef3e400640 1 --2- 172.21.15.5:0/3483807927 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef380ae860 0x7fef381484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.194+0000 7fef3e400640 1 -- 172.21.15.5:0/3483807927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef38158a20 msgr2=0x7fef3806a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.194+0000 7fef3e400640 1 --2- 172.21.15.5:0/3483807927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef38158a20 0x7fef3806a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.194+0000 7fef3e400640 1 -- 172.21.15.5:0/3483807927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c009390 con 0x7fef38158df0 2024-08-17T02:46:54.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.194+0000 7fef3e400640 1 --2- 172.21.15.5:0/3483807927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef38158df0 0x7fef3806aef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fef3000cbc0 tx=0x7fef300019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.194+0000 7fef34c00640 1 -- 172.21.15.5:0/3483807927 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3000a640 con 0x7fef38158df0 2024-08-17T02:46:54.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.195+0000 7fef34c00640 1 -- 172.21.15.5:0/3483807927 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3000a7a0 con 0x7fef38158df0 2024-08-17T02:46:54.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.195+0000 7fef34c00640 1 -- 172.21.15.5:0/3483807927 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3000ab20 con 0x7fef38158df0 2024-08-17T02:46:54.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.195+0000 7fef40400640 1 -- 172.21.15.5:0/3483807927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef38149f70 con 0x7fef38158df0 2024-08-17T02:46:54.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.195+0000 7fef40400640 1 -- 172.21.15.5:0/3483807927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef38148a10 con 0x7fef38158df0 2024-08-17T02:46:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.196+0000 7fef40400640 1 -- 172.21.15.5:0/3483807927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3814a770 con 0x7fef38158df0 2024-08-17T02:46:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.197+0000 7fef34c00640 1 -- 172.21.15.5:0/3483807927 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fef30007300 con 0x7fef38158df0 2024-08-17T02:46:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.198+0000 7fef34c00640 1 --2- 172.21.15.5:0/3483807927 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fef18065150 0x7fef18067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.198+0000 7fef34c00640 1 -- 172.21.15.5:0/3483807927 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fef300822e0 con 0x7fef38158df0 2024-08-17T02:46:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.198+0000 7fef3da00640 1 --2- 172.21.15.5:0/3483807927 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fef18065150 0x7fef18067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.199+0000 7fef3da00640 1 --2- 172.21.15.5:0/3483807927 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fef18065150 0x7fef18067600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef2c034000 tx=0x7fef2c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.202+0000 7fef34c00640 1 -- 172.21.15.5:0/3483807927 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fef30050790 con 0x7fef38158df0 2024-08-17T02:46:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.387+0000 7fef40400640 1 -- 172.21.15.5:0/3483807927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef38063fb0 con 0x7fef38158df0 2024-08-17T02:46:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.388+0000 7fef34c00640 1 -- 172.21.15.5:0/3483807927 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12079 (secure 0 0 0) 0x7fef30004b20 con 0x7fef38158df0 2024-08-17T02:46:54.390 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:46:54.390 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:49.110477+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:54.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.390+0000 7fef40400640 1 -- 172.21.15.5:0/3483807927 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fef18065150 msgr2=0x7fef18067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.390+0000 7fef40400640 1 --2- 172.21.15.5:0/3483807927 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fef18065150 0x7fef18067600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef2c034000 tx=0x7fef2c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:54.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.390+0000 7fef40400640 1 -- 172.21.15.5:0/3483807927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef38158df0 msgr2=0x7fef3806aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.390+0000 7fef40400640 1 --2- 172.21.15.5:0/3483807927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef38158df0 0x7fef3806aef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fef3000cbc0 tx=0x7fef300019c0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.390+0000 7fef40400640 1 -- 172.21.15.5:0/3483807927 shutdown_connections 2024-08-17T02:46:54.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.390+0000 7fef40400640 1 --2- 172.21.15.5:0/3483807927 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fef18065150 0x7fef18067600 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.390+0000 7fef40400640 1 --2- 172.21.15.5:0/3483807927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef38158df0 0x7fef3806aef0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.390+0000 7fef40400640 1 --2- 172.21.15.5:0/3483807927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef38158a20 0x7fef3806a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.390+0000 7fef40400640 1 --2- 172.21.15.5:0/3483807927 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef380ae860 0x7fef381484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.390+0000 7fef40400640 1 -- 172.21.15.5:0/3483807927 >> 172.21.15.5:0/3483807927 conn(0x7fef38066e60 msgr2=0x7fef38153c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:54.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.391+0000 7fef40400640 1 -- 172.21.15.5:0/3483807927 shutdown_connections 2024-08-17T02:46:54.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.391+0000 7fef40400640 1 -- 172.21.15.5:0/3483807927 wait complete. 2024-08-17T02:46:54.406 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:47.106425+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:46:54.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.559+0000 7fc17a600640 1 Processor -- start 2024-08-17T02:46:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.559+0000 7fc17a600640 1 -- start start 2024-08-17T02:46:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.560+0000 7fc17a600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc174156730 0x7fc1740ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.560+0000 7fc17a600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc174156b00 0x7fc1740caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.560+0000 7fc17a600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1740ce6a0 con 0x7fc1740cc6a0 2024-08-17T02:46:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.560+0000 7fc17a600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1740cddb0 con 0x7fc174156730 2024-08-17T02:46:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.560+0000 7fc17a600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17415a2c0 con 0x7fc174156b00 2024-08-17T02:46:54.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.560+0000 7fc173400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc174156730 0x7fc1740ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.561+0000 7fc173400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc174156730 0x7fc1740ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52866/0 (socket says 172.21.15.5:52866) 2024-08-17T02:46:54.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.561+0000 7fc173400640 1 -- 172.21.15.5:0/1078446865 learned_addr learned my addr 172.21.15.5:0/1078446865 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:54.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.561+0000 7fc172a00640 1 --2- 172.21.15.5:0/1078446865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc174156b00 0x7fc1740caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.561+0000 7fc173400640 1 -- 172.21.15.5:0/1078446865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc174156b00 msgr2=0x7fc1740caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:54.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.561+0000 7fc173400640 1 --2- 172.21.15.5:0/1078446865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc174156b00 0x7fc1740caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.561+0000 7fc173400640 1 -- 172.21.15.5:0/1078446865 >> v1:172.21.15.107:6789/0 conn(0x7fc1740cc6a0 legacy=0x7fc1740ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:54.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.561+0000 7fc173400640 1 -- 172.21.15.5:0/1078446865 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740cfb40 con 0x7fc174156730 2024-08-17T02:46:54.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.562+0000 7fc173400640 1 --2- 172.21.15.5:0/1078446865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc174156730 0x7fc1740ca5b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc164009910 tx=0x7fc1640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48f6dc476a3fe4a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.562+0000 7fc172000640 1 -- 172.21.15.5:0/1078446865 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16402ad20 con 0x7fc174156730 2024-08-17T02:46:54.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.562+0000 7fc172000640 1 -- 172.21.15.5:0/1078446865 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16402ae80 con 0x7fc174156730 2024-08-17T02:46:54.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.562+0000 7fc172000640 1 -- 172.21.15.5:0/1078446865 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164032670 con 0x7fc174156730 2024-08-17T02:46:54.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.563+0000 7fc17a600640 1 -- 172.21.15.5:0/1078446865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc174156730 msgr2=0x7fc1740ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.563+0000 7fc17a600640 1 --2- 172.21.15.5:0/1078446865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc174156730 0x7fc1740ca5b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc164009910 tx=0x7fc1640091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.563+0000 7fc17a600640 1 -- 172.21.15.5:0/1078446865 shutdown_connections 2024-08-17T02:46:54.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.563+0000 7fc17a600640 1 --2- 172.21.15.5:0/1078446865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc174156b00 0x7fc1740caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.563+0000 7fc17a600640 1 --2- 172.21.15.5:0/1078446865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc174156730 0x7fc1740ca5b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.563+0000 7fc17a600640 1 -- 172.21.15.5:0/1078446865 >> 172.21.15.5:0/1078446865 conn(0x7fc17406e590 msgr2=0x7fc17406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:54.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.563+0000 7fc17a600640 1 -- 172.21.15.5:0/1078446865 shutdown_connections 2024-08-17T02:46:54.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.563+0000 7fc17a600640 1 -- 172.21.15.5:0/1078446865 wait complete. 2024-08-17T02:46:54.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.564+0000 7fc17a600640 1 Processor -- start 2024-08-17T02:46:54.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.564+0000 7fc17a600640 1 -- start start 2024-08-17T02:46:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.565+0000 7fc17a600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1740cc6a0 0x7fc174153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.565+0000 7fc17a600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc174156730 0x7fc1740b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.565+0000 7fc17a600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc174156b00 0x7fc1740b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.565+0000 7fc17a600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17416c6b0 con 0x7fc174156b00 2024-08-17T02:46:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.565+0000 7fc17a600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740b3070 con 0x7fc174156730 2024-08-17T02:46:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.565+0000 7fc17a600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740b3350 con 0x7fc1740cc6a0 2024-08-17T02:46:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.566+0000 7fc173e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc174156b00 0x7fc1740b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.566+0000 7fc173e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc174156b00 0x7fc1740b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52870/0 (socket says 172.21.15.5:52870) 2024-08-17T02:46:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.566+0000 7fc173e00640 1 -- 172.21.15.5:0/258818806 learned_addr learned my addr 172.21.15.5:0/258818806 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.566+0000 7fc173e00640 1 -- 172.21.15.5:0/258818806 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1740cc6a0 msgr2=0x7fc174153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.566+0000 7fc173e00640 1 --2- 172.21.15.5:0/258818806 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1740cc6a0 0x7fc174153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.566+0000 7fc173e00640 1 -- 172.21.15.5:0/258818806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc174156730 msgr2=0x7fc1740b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.566+0000 7fc173e00640 1 --2- 172.21.15.5:0/258818806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc174156730 0x7fc1740b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.566+0000 7fc173e00640 1 -- 172.21.15.5:0/258818806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc164009450 con 0x7fc174156b00 2024-08-17T02:46:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.566+0000 7fc173e00640 1 --2- 172.21.15.5:0/258818806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc174156b00 0x7fc1740b0c80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00c890 tx=0x7fc16c002640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.566+0000 7fc16aa00640 1 -- 172.21.15.5:0/258818806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00ce80 con 0x7fc174156b00 2024-08-17T02:46:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.567+0000 7fc16aa00640 1 -- 172.21.15.5:0/258818806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c00a7f0 con 0x7fc174156b00 2024-08-17T02:46:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.567+0000 7fc16aa00640 1 -- 172.21.15.5:0/258818806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00abf0 con 0x7fc174156b00 2024-08-17T02:46:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.567+0000 7fc17a600640 1 -- 172.21.15.5:0/258818806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1740b3630 con 0x7fc174156b00 2024-08-17T02:46:54.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.567+0000 7fc17a600640 1 -- 172.21.15.5:0/258818806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1740b3bf0 con 0x7fc174156b00 2024-08-17T02:46:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.568+0000 7fc17a600640 1 -- 172.21.15.5:0/258818806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1740b3e10 con 0x7fc174156b00 2024-08-17T02:46:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.569+0000 7fc16aa00640 1 -- 172.21.15.5:0/258818806 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc16c00ad50 con 0x7fc174156b00 2024-08-17T02:46:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.569+0000 7fc16aa00640 1 --2- 172.21.15.5:0/258818806 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc154065150 0x7fc154067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.569+0000 7fc16aa00640 1 -- 172.21.15.5:0/258818806 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc16c082590 con 0x7fc174156b00 2024-08-17T02:46:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.570+0000 7fc173400640 1 --2- 172.21.15.5:0/258818806 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc154065150 0x7fc154067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.570+0000 7fc173400640 1 --2- 172.21.15.5:0/258818806 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc154065150 0x7fc154067600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc164034000 tx=0x7fc164032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.573+0000 7fc16aa00640 1 -- 172.21.15.5:0/258818806 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc16c050900 con 0x7fc174156b00 2024-08-17T02:46:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.756+0000 7fc17a600640 1 -- 172.21.15.5:0/258818806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc174063fb0 con 0x7fc174156b00 2024-08-17T02:46:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.756+0000 7fc16aa00640 1 -- 172.21.15.5:0/258818806 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc16c0160a0 con 0x7fc174156b00 2024-08-17T02:46:54.758 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:46:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.758+0000 7fc17a600640 1 -- 172.21.15.5:0/258818806 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc154065150 msgr2=0x7fc154067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.758+0000 7fc17a600640 1 --2- 172.21.15.5:0/258818806 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc154065150 0x7fc154067600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc164034000 tx=0x7fc164032000 comp rx=0 tx=0).stop 2024-08-17T02:46:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.758+0000 7fc17a600640 1 -- 172.21.15.5:0/258818806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc174156b00 msgr2=0x7fc1740b0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.758+0000 7fc17a600640 1 --2- 172.21.15.5:0/258818806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc174156b00 0x7fc1740b0c80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00c890 tx=0x7fc16c002640 comp rx=0 tx=0).stop 2024-08-17T02:46:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.758+0000 7fc17a600640 1 -- 172.21.15.5:0/258818806 shutdown_connections 2024-08-17T02:46:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.758+0000 7fc17a600640 1 --2- 172.21.15.5:0/258818806 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc154065150 0x7fc154067600 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.758+0000 7fc17a600640 1 --2- 172.21.15.5:0/258818806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc174156b00 0x7fc1740b0c80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.758+0000 7fc17a600640 1 --2- 172.21.15.5:0/258818806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc174156730 0x7fc1740b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.758+0000 7fc17a600640 1 --2- 172.21.15.5:0/258818806 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1740cc6a0 0x7fc174153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.758+0000 7fc17a600640 1 -- 172.21.15.5:0/258818806 >> 172.21.15.5:0/258818806 conn(0x7fc17406e590 msgr2=0x7fc174154880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.759+0000 7fc17a600640 1 -- 172.21.15.5:0/258818806 shutdown_connections 2024-08-17T02:46:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.759+0000 7fc17a600640 1 -- 172.21.15.5:0/258818806 wait complete. 2024-08-17T02:46:54.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:46:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.924+0000 7f0673a00640 1 Processor -- start 2024-08-17T02:46:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.924+0000 7f0673a00640 1 -- start start 2024-08-17T02:46:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.926+0000 7f0673a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f066c155040 0x7f066c158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.926+0000 7f0673a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f066c1591c0 0x7f066c06e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.926+0000 7f0673a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f066c0aeeb0 con 0x7f066c06e5a0 2024-08-17T02:46:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.926+0000 7f0673a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066c159610 con 0x7f066c155040 2024-08-17T02:46:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.926+0000 7f0673a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066c06dee0 con 0x7f066c1591c0 2024-08-17T02:46:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.926+0000 7f0671a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f066c06e5a0 0x7f066c06d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51622/0 (socket says 172.21.15.5:51622) 2024-08-17T02:46:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.926+0000 7f0671a00640 1 -- 172.21.15.5:0/207205974 learned_addr learned my addr 172.21.15.5:0/207205974 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:46:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.926+0000 7f0663e00640 1 --2- 172.21.15.5:0/207205974 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f066c1591c0 0x7f066c06e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.926+0000 7f0671000640 1 --2- 172.21.15.5:0/207205974 >> v2:172.21.15.107:3300/0 conn(0x7f066c155040 0x7f066c158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.926+0000 7f066be00640 1 -- 172.21.15.5:0/207205974 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26492023 0 0) 0x7f066c0aeeb0 con 0x7f066c06e5a0 2024-08-17T02:46:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.926+0000 7f066be00640 1 -- 172.21.15.5:0/207205974 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06500034e0 con 0x7f066c06e5a0 2024-08-17T02:46:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.927+0000 7f0663e00640 1 -- 172.21.15.5:0/207205974 >> v2:172.21.15.107:3300/0 conn(0x7f066c155040 msgr2=0x7f066c158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.927+0000 7f0663e00640 1 --2- 172.21.15.5:0/207205974 >> v2:172.21.15.107:3300/0 conn(0x7f066c155040 0x7f066c158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.927+0000 7f0663e00640 1 -- 172.21.15.5:0/207205974 >> v1:172.21.15.5:6789/0 conn(0x7f066c06e5a0 legacy=0x7f066c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.927+0000 7f0663e00640 1 -- 172.21.15.5:0/207205974 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c06e9e0 con 0x7f066c1591c0 2024-08-17T02:46:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.927+0000 7f0671000640 1 --2- 172.21.15.5:0/207205974 >> v2:172.21.15.107:3300/0 conn(0x7f066c155040 0x7f066c158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.928+0000 7f0663e00640 1 --2- 172.21.15.5:0/207205974 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f066c1591c0 0x7f066c06e060 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0654009850 tx=0x7f06540090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=185b3ff23c19ee3c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.928+0000 7f066be00640 1 -- 172.21.15.5:0/207205974 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065402ad00 con 0x7f066c1591c0 2024-08-17T02:46:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.928+0000 7f066be00640 1 -- 172.21.15.5:0/207205974 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065402ae60 con 0x7f066c1591c0 2024-08-17T02:46:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.928+0000 7f066be00640 1 -- 172.21.15.5:0/207205974 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654032670 con 0x7f066c1591c0 2024-08-17T02:46:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.929+0000 7f0673a00640 1 -- 172.21.15.5:0/207205974 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f066c1591c0 msgr2=0x7f066c06e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.929+0000 7f0673a00640 1 --2- 172.21.15.5:0/207205974 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f066c1591c0 0x7f066c06e060 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0654009850 tx=0x7f06540090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.929+0000 7f0673a00640 1 -- 172.21.15.5:0/207205974 shutdown_connections 2024-08-17T02:46:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.929+0000 7f0673a00640 1 --2- 172.21.15.5:0/207205974 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f066c1591c0 0x7f066c06e060 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.929+0000 7f0673a00640 1 --2- 172.21.15.5:0/207205974 >> v2:172.21.15.107:3300/0 conn(0x7f066c155040 0x7f066c158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.929+0000 7f0673a00640 1 -- 172.21.15.5:0/207205974 >> 172.21.15.5:0/207205974 conn(0x7f066c066e60 msgr2=0x7f066c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.929+0000 7f0673a00640 1 -- 172.21.15.5:0/207205974 shutdown_connections 2024-08-17T02:46:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.929+0000 7f0673a00640 1 -- 172.21.15.5:0/207205974 wait complete. 2024-08-17T02:46:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.930+0000 7f0673a00640 1 Processor -- start 2024-08-17T02:46:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.930+0000 7f0673a00640 1 -- start start 2024-08-17T02:46:54.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.931+0000 7f0673a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f066c06e5a0 0x7f066c0c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.931+0000 7f0673a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f066c155040 0x7f066c0c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.931+0000 7f0673a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f066c1591c0 0x7f066c0c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.931+0000 7f0673a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c155410 con 0x7f066c155040 2024-08-17T02:46:54.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.931+0000 7f0673a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c153aa0 con 0x7f066c1591c0 2024-08-17T02:46:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.931+0000 7f0673a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066c0c13a0 con 0x7f066c06e5a0 2024-08-17T02:46:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.931+0000 7f0663e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f066c155040 0x7f066c0c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.931+0000 7f0663e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f066c155040 0x7f066c0c07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52876/0 (socket says 172.21.15.5:52876) 2024-08-17T02:46:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.931+0000 7f0663e00640 1 -- 172.21.15.5:0/2649554664 learned_addr learned my addr 172.21.15.5:0/2649554664 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.932+0000 7f0671000640 1 --2- 172.21.15.5:0/2649554664 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f066c06e5a0 0x7f066c0c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.932+0000 7f0671a00640 1 --2- 172.21.15.5:0/2649554664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f066c1591c0 0x7f066c0c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.932+0000 7f0663e00640 1 -- 172.21.15.5:0/2649554664 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f066c06e5a0 msgr2=0x7f066c0c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.932+0000 7f0663e00640 1 --2- 172.21.15.5:0/2649554664 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f066c06e5a0 0x7f066c0c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.932+0000 7f0663e00640 1 -- 172.21.15.5:0/2649554664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f066c1591c0 msgr2=0x7f066c0c0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.932+0000 7f0663e00640 1 --2- 172.21.15.5:0/2649554664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f066c1591c0 0x7f066c0c0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.932+0000 7f0663e00640 1 -- 172.21.15.5:0/2649554664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c009390 con 0x7f066c155040 2024-08-17T02:46:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.932+0000 7f0671a00640 1 --2- 172.21.15.5:0/2649554664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f066c1591c0 0x7f066c0c0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.932+0000 7f0663e00640 1 --2- 172.21.15.5:0/2649554664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f066c155040 0x7f066c0c07e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f06540098b0 tx=0x7f0654032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.932+0000 7f0668c00640 1 -- 172.21.15.5:0/2649554664 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065403b6e0 con 0x7f066c155040 2024-08-17T02:46:54.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.932+0000 7f0668c00640 1 -- 172.21.15.5:0/2649554664 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065403b840 con 0x7f066c155040 2024-08-17T02:46:54.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.932+0000 7f0668c00640 1 -- 172.21.15.5:0/2649554664 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065403bc00 con 0x7f066c155040 2024-08-17T02:46:54.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.932+0000 7f0673a00640 1 -- 172.21.15.5:0/2649554664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0654009390 con 0x7f066c155040 2024-08-17T02:46:54.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.933+0000 7f0673a00640 1 -- 172.21.15.5:0/2649554664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066c0c1960 con 0x7f066c155040 2024-08-17T02:46:54.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.934+0000 7f0673a00640 1 -- 172.21.15.5:0/2649554664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066c063fb0 con 0x7f066c155040 2024-08-17T02:46:54.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.934+0000 7f0668c00640 1 -- 172.21.15.5:0/2649554664 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0654043030 con 0x7f066c155040 2024-08-17T02:46:54.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.935+0000 7f0668c00640 1 --2- 172.21.15.5:0/2649554664 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0648065150 0x7f0648067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.935+0000 7f0668c00640 1 -- 172.21.15.5:0/2649554664 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0654041070 con 0x7f066c155040 2024-08-17T02:46:54.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.935+0000 7f0671000640 1 --2- 172.21.15.5:0/2649554664 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0648065150 0x7f0648067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.936+0000 7f0671000640 1 --2- 172.21.15.5:0/2649554664 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0648065150 0x7f0648067600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f065c009360 tx=0x7f065c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:54.939+0000 7f0668c00640 1 -- 172.21.15.5:0/2649554664 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0654070ab0 con 0x7f066c155040 2024-08-17T02:46:55.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.126+0000 7f0673a00640 1 -- 172.21.15.5:0/2649554664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f066c158fa0 con 0x7f066c155040 2024-08-17T02:46:55.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.126+0000 7f0668c00640 1 -- 172.21.15.5:0/2649554664 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0654037060 con 0x7f066c155040 2024-08-17T02:46:55.127 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:46:55.128 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-17T02:46:55.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:46:55.128 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-17T02:46:55.128 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-17T02:46:55.128 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:46:55.128 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-17T02:46:55.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.128+0000 7f0673a00640 1 -- 172.21.15.5:0/2649554664 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0648065150 msgr2=0x7f0648067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.128+0000 7f0673a00640 1 --2- 172.21.15.5:0/2649554664 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0648065150 0x7f0648067600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f065c009360 tx=0x7f065c008040 comp rx=0 tx=0).stop 2024-08-17T02:46:55.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.128+0000 7f0673a00640 1 -- 172.21.15.5:0/2649554664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f066c155040 msgr2=0x7f066c0c07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.128+0000 7f0673a00640 1 --2- 172.21.15.5:0/2649554664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f066c155040 0x7f066c0c07e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f06540098b0 tx=0x7f0654032000 comp rx=0 tx=0).stop 2024-08-17T02:46:55.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.128+0000 7f0673a00640 1 -- 172.21.15.5:0/2649554664 shutdown_connections 2024-08-17T02:46:55.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.128+0000 7f0673a00640 1 --2- 172.21.15.5:0/2649554664 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0648065150 0x7f0648067600 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.128+0000 7f0673a00640 1 --2- 172.21.15.5:0/2649554664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f066c1591c0 0x7f066c0c0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.128+0000 7f0673a00640 1 --2- 172.21.15.5:0/2649554664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f066c155040 0x7f066c0c07e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.128+0000 7f0673a00640 1 --2- 172.21.15.5:0/2649554664 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f066c06e5a0 0x7f066c0c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.128+0000 7f0673a00640 1 -- 172.21.15.5:0/2649554664 >> 172.21.15.5:0/2649554664 conn(0x7f066c066e60 msgr2=0x7f066c0ab020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.128+0000 7f0673a00640 1 -- 172.21.15.5:0/2649554664 shutdown_connections 2024-08-17T02:46:55.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.128+0000 7f0673a00640 1 -- 172.21.15.5:0/2649554664 wait complete. 2024-08-17T02:46:55.145 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:46:55.146 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:46:55.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.299+0000 7f46b6400640 1 Processor -- start 2024-08-17T02:46:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.299+0000 7f46b6400640 1 -- start start 2024-08-17T02:46:55.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.300+0000 7f46b6400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46b00acb20 0x7f46b0163720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.300+0000 7f46b6400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b00aa7a0 con 0x7f46b00aee90 2024-08-17T02:46:55.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.300+0000 7f46b6400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b00a9bb0 con 0x7f46b0158b50 2024-08-17T02:46:55.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.300+0000 7f46b6400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b0158f20 con 0x7f46b00acb20 2024-08-17T02:46:55.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.301+0000 7f46afe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f46b00aee90 0x7f46b00ac410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51624/0 (socket says 172.21.15.5:51624) 2024-08-17T02:46:55.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.301+0000 7f46afe00640 1 -- 172.21.15.5:0/511101670 learned_addr learned my addr 172.21.15.5:0/511101670 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:46:55.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.301+0000 7f46b5a00640 1 --2- 172.21.15.5:0/511101670 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46b00acb20 0x7f46b0163720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.301+0000 7f46af400640 1 -- 172.21.15.5:0/511101670 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491544058 0 0) 0x7f46b00aa7a0 con 0x7f46b00aee90 2024-08-17T02:46:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.301+0000 7f46af400640 1 -- 172.21.15.5:0/511101670 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46980034e0 con 0x7f46b00aee90 2024-08-17T02:46:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.301+0000 7f46af400640 1 -- 172.21.15.5:0/511101670 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564724222 0 0) 0x7f46b00a9bb0 con 0x7f46b0158b50 2024-08-17T02:46:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.301+0000 7f46af400640 1 -- 172.21.15.5:0/511101670 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46b00aa7a0 con 0x7f46b0158b50 2024-08-17T02:46:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.301+0000 7f46b5a00640 1 -- 172.21.15.5:0/511101670 >> v1:172.21.15.107:6789/0 conn(0x7f46b0158b50 legacy=0x7f46b0062e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.301+0000 7f46b5a00640 1 -- 172.21.15.5:0/511101670 >> v1:172.21.15.5:6789/0 conn(0x7f46b00aee90 legacy=0x7f46b00ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.301+0000 7f46b5a00640 1 -- 172.21.15.5:0/511101670 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b00a9e70 con 0x7f46b00acb20 2024-08-17T02:46:55.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.303+0000 7f46b5a00640 1 --2- 172.21.15.5:0/511101670 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46b00acb20 0x7f46b0163720 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009e90 tx=0x7f46a8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd84ecf1edafb741 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.303+0000 7f46af400640 1 -- 172.21.15.5:0/511101670 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a8007550 con 0x7f46b00acb20 2024-08-17T02:46:55.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.303+0000 7f46af400640 1 -- 172.21.15.5:0/511101670 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a802d050 con 0x7f46b00acb20 2024-08-17T02:46:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.303+0000 7f46af400640 1 -- 172.21.15.5:0/511101670 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a80078c0 con 0x7f46b00acb20 2024-08-17T02:46:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.304+0000 7f46b6400640 1 -- 172.21.15.5:0/511101670 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46b00acb20 msgr2=0x7f46b0163720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.304+0000 7f46b6400640 1 --2- 172.21.15.5:0/511101670 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46b00acb20 0x7f46b0163720 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009e90 tx=0x7f46a8009780 comp rx=0 tx=0).stop 2024-08-17T02:46:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.304+0000 7f46b6400640 1 -- 172.21.15.5:0/511101670 shutdown_connections 2024-08-17T02:46:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.304+0000 7f46b6400640 1 --2- 172.21.15.5:0/511101670 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46b00acb20 0x7f46b0163720 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.304+0000 7f46b6400640 1 -- 172.21.15.5:0/511101670 >> 172.21.15.5:0/511101670 conn(0x7f46b006eb50 msgr2=0x7f46b0066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.304+0000 7f46b6400640 1 -- 172.21.15.5:0/511101670 shutdown_connections 2024-08-17T02:46:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.304+0000 7f46b6400640 1 -- 172.21.15.5:0/511101670 wait complete. 2024-08-17T02:46:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.305+0000 7f46b6400640 1 Processor -- start 2024-08-17T02:46:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.305+0000 7f46b6400640 1 -- start start 2024-08-17T02:46:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.306+0000 7f46b6400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46b00acb20 0x7f46b014ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.306+0000 7f46b6400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46b0158b50 0x7f46b00ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.306+0000 7f46b6400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46b00cadf0 0x7f46b00c26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.306+0000 7f46b6400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b00c8af0 con 0x7f46b00cadf0 2024-08-17T02:46:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.306+0000 7f46b6400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b00c8d90 con 0x7f46b00acb20 2024-08-17T02:46:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.306+0000 7f46b6400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b00c9070 con 0x7f46b0158b50 2024-08-17T02:46:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.306+0000 7f46b5a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46b00cadf0 0x7f46b00c26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.306+0000 7f46afe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46b0158b50 0x7f46b00ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.306+0000 7f46b5a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46b00cadf0 0x7f46b00c26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52880/0 (socket says 172.21.15.5:52880) 2024-08-17T02:46:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.306+0000 7f46b5a00640 1 -- 172.21.15.5:0/2602536218 learned_addr learned my addr 172.21.15.5:0/2602536218 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:55.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.306+0000 7f46b5000640 1 --2- 172.21.15.5:0/2602536218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46b00acb20 0x7f46b014ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.307+0000 7f46afe00640 1 -- 172.21.15.5:0/2602536218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46b00acb20 msgr2=0x7f46b014ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.307+0000 7f46afe00640 1 --2- 172.21.15.5:0/2602536218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46b00acb20 0x7f46b014ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.307+0000 7f46afe00640 1 -- 172.21.15.5:0/2602536218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46b00cadf0 msgr2=0x7f46b00c26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.307+0000 7f46afe00640 1 --2- 172.21.15.5:0/2602536218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46b00cadf0 0x7f46b00c26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.307+0000 7f46afe00640 1 -- 172.21.15.5:0/2602536218 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a8009a20 con 0x7f46b0158b50 2024-08-17T02:46:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.307+0000 7f46afe00640 1 --2- 172.21.15.5:0/2602536218 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46b0158b50 0x7f46b00ca3f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f469c00c490 tx=0x7f469c007d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.307+0000 7f46a3e00640 1 -- 172.21.15.5:0/2602536218 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c005aa0 con 0x7f46b0158b50 2024-08-17T02:46:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.307+0000 7f46a3e00640 1 -- 172.21.15.5:0/2602536218 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c005c00 con 0x7f46b0158b50 2024-08-17T02:46:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.307+0000 7f46a3e00640 1 -- 172.21.15.5:0/2602536218 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c0070d0 con 0x7f46b0158b50 2024-08-17T02:46:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.307+0000 7f46b6400640 1 -- 172.21.15.5:0/2602536218 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b00c9350 con 0x7f46b0158b50 2024-08-17T02:46:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.308+0000 7f46b6400640 1 -- 172.21.15.5:0/2602536218 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b014d200 con 0x7f46b0158b50 2024-08-17T02:46:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.308+0000 7f46b6400640 1 -- 172.21.15.5:0/2602536218 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b00c97d0 con 0x7f46b0158b50 2024-08-17T02:46:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.309+0000 7f46a3e00640 1 -- 172.21.15.5:0/2602536218 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f469c007500 con 0x7f46b0158b50 2024-08-17T02:46:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.310+0000 7f46a3e00640 1 --2- 172.21.15.5:0/2602536218 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4690065150 0x7f4690067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.310+0000 7f46a3e00640 1 -- 172.21.15.5:0/2602536218 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f469c081540 con 0x7f46b0158b50 2024-08-17T02:46:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.310+0000 7f46b5000640 1 --2- 172.21.15.5:0/2602536218 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4690065150 0x7f4690067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.311+0000 7f46b5000640 1 --2- 172.21.15.5:0/2602536218 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4690065150 0x7f4690067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f46a4003970 tx=0x7f46a4007cc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.316+0000 7f46a3e00640 1 -- 172.21.15.5:0/2602536218 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f469c04f960 con 0x7f46b0158b50 2024-08-17T02:46:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:55.501+0000 7f46b6400640 1 -- 172.21.15.5:0/2602536218 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f46b00c91b0 con 0x7f46b0158b50 2024-08-17T02:46:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.145+0000 7f46a3e00640 1 -- 172.21.15.5:0/2602536218 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f46b00c91b0 con 0x7f46b0158b50 2024-08-17T02:46:56.147 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-17T02:46:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.151+0000 7f46b6400640 1 -- 172.21.15.5:0/2602536218 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4690065150 msgr2=0x7f4690067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.151+0000 7f46b6400640 1 --2- 172.21.15.5:0/2602536218 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4690065150 0x7f4690067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f46a4003970 tx=0x7f46a4007cc0 comp rx=0 tx=0).stop 2024-08-17T02:46:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.151+0000 7f46b6400640 1 -- 172.21.15.5:0/2602536218 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46b0158b50 msgr2=0x7f46b00ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.151+0000 7f46b6400640 1 --2- 172.21.15.5:0/2602536218 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46b0158b50 0x7f46b00ca3f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f469c00c490 tx=0x7f469c007d00 comp rx=0 tx=0).stop 2024-08-17T02:46:56.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.151+0000 7f46b6400640 1 -- 172.21.15.5:0/2602536218 shutdown_connections 2024-08-17T02:46:56.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.151+0000 7f46b6400640 1 --2- 172.21.15.5:0/2602536218 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4690065150 0x7f4690067600 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:56.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.151+0000 7f46b6400640 1 --2- 172.21.15.5:0/2602536218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46b00cadf0 0x7f46b00c26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:56.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.151+0000 7f46b6400640 1 --2- 172.21.15.5:0/2602536218 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46b0158b50 0x7f46b00ca3f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:56.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.151+0000 7f46b6400640 1 --2- 172.21.15.5:0/2602536218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46b00acb20 0x7f46b014ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:56.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.151+0000 7f46b6400640 1 -- 172.21.15.5:0/2602536218 >> 172.21.15.5:0/2602536218 conn(0x7f46b006eb50 msgr2=0x7f46b006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:56.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.151+0000 7f46b6400640 1 -- 172.21.15.5:0/2602536218 shutdown_connections 2024-08-17T02:46:56.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.152+0000 7f46b6400640 1 -- 172.21.15.5:0/2602536218 wait complete. 2024-08-17T02:46:56.173 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:46:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.333+0000 7f684c600640 1 Processor -- start 2024-08-17T02:46:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.333+0000 7f684c600640 1 -- start start 2024-08-17T02:46:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.334+0000 7f684c600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6844158f20 0x7f6844062f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.334+0000 7f684c600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f684415a950 0x7f68440a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.334+0000 7f684c600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68440a9630 0x7f68440679a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.334+0000 7f684c600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68440a9ab0 con 0x7f684415a950 2024-08-17T02:46:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.334+0000 7f684c600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6844067510 con 0x7f6844158f20 2024-08-17T02:46:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.334+0000 7f684c600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6844066f00 con 0x7f68440a9630 2024-08-17T02:46:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.335+0000 7f6849200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f684415a950 0x7f68440a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.335+0000 7f6849200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f684415a950 0x7f68440a90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59678/0 (socket says 172.21.15.5:59678) 2024-08-17T02:46:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.335+0000 7f6849200640 1 -- 172.21.15.5:0/1540766672 learned_addr learned my addr 172.21.15.5:0/1540766672 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.335+0000 7f6849c00640 1 --2- 172.21.15.5:0/1540766672 >> v2:172.21.15.107:3300/0 conn(0x7f6844158f20 0x7f6844062f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.335+0000 7f684a600640 1 --2- 172.21.15.5:0/1540766672 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68440a9630 0x7f68440679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.335+0000 7f6849200640 1 -- 172.21.15.5:0/1540766672 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68440a9630 msgr2=0x7f68440679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.335+0000 7f6849200640 1 --2- 172.21.15.5:0/1540766672 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68440a9630 0x7f68440679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.335+0000 7f6849200640 1 -- 172.21.15.5:0/1540766672 >> v2:172.21.15.107:3300/0 conn(0x7f6844158f20 msgr2=0x7f6844062f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.335+0000 7f6849200640 1 --2- 172.21.15.5:0/1540766672 >> v2:172.21.15.107:3300/0 conn(0x7f6844158f20 0x7f6844062f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.335+0000 7f6849200640 1 -- 172.21.15.5:0/1540766672 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68440ccda0 con 0x7f684415a950 2024-08-17T02:46:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.336+0000 7f6849200640 1 --2- 172.21.15.5:0/1540766672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684415a950 0x7f68440a90f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6844071b40 tx=0x7f68300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e26839d0cb3792 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.336+0000 7f6843e00640 1 -- 172.21.15.5:0/1540766672 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683002add0 con 0x7f684415a950 2024-08-17T02:46:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.337+0000 7f6843e00640 1 -- 172.21.15.5:0/1540766672 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6830032440 con 0x7f684415a950 2024-08-17T02:46:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.337+0000 7f6843e00640 1 -- 172.21.15.5:0/1540766672 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6830032820 con 0x7f684415a950 2024-08-17T02:46:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.337+0000 7f684c600640 1 -- 172.21.15.5:0/1540766672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684415a950 msgr2=0x7f68440a90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.337+0000 7f684c600640 1 --2- 172.21.15.5:0/1540766672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684415a950 0x7f68440a90f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6844071b40 tx=0x7f68300091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.337+0000 7f684c600640 1 -- 172.21.15.5:0/1540766672 shutdown_connections 2024-08-17T02:46:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.337+0000 7f684c600640 1 --2- 172.21.15.5:0/1540766672 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68440a9630 0x7f68440679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.337+0000 7f684c600640 1 --2- 172.21.15.5:0/1540766672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684415a950 0x7f68440a90f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:56.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.337+0000 7f684c600640 1 --2- 172.21.15.5:0/1540766672 >> v2:172.21.15.107:3300/0 conn(0x7f6844158f20 0x7f6844062f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:56.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.337+0000 7f684c600640 1 -- 172.21.15.5:0/1540766672 >> 172.21.15.5:0/1540766672 conn(0x7f684406e5b0 msgr2=0x7f68440b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:56.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.337+0000 7f684c600640 1 -- 172.21.15.5:0/1540766672 shutdown_connections 2024-08-17T02:46:56.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.337+0000 7f684c600640 1 -- 172.21.15.5:0/1540766672 wait complete. 2024-08-17T02:46:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.338+0000 7f684c600640 1 Processor -- start 2024-08-17T02:46:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.339+0000 7f684c600640 1 -- start start 2024-08-17T02:46:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.339+0000 7f684c600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440a9630 0x7f684414c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.339+0000 7f684c600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6844158f20 0x7f68440ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.339+0000 7f684c600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684415a950 0x7f6844153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.340+0000 7f684c600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684414d580 con 0x7f68440a9630 2024-08-17T02:46:56.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.340+0000 7f684c600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684414e4c0 con 0x7f6844158f20 2024-08-17T02:46:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.340+0000 7f684c600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6844168a40 con 0x7f684415a950 2024-08-17T02:46:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.340+0000 7f6849c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440a9630 0x7f684414c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.340+0000 7f6849c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440a9630 0x7f684414c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59692/0 (socket says 172.21.15.5:59692) 2024-08-17T02:46:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.340+0000 7f6849c00640 1 -- 172.21.15.5:0/2914378230 learned_addr learned my addr 172.21.15.5:0/2914378230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.340+0000 7f6849200640 1 --2- 172.21.15.5:0/2914378230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6844158f20 0x7f68440ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.340+0000 7f684a600640 1 --2- 172.21.15.5:0/2914378230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684415a950 0x7f6844153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.340+0000 7f6849c00640 1 -- 172.21.15.5:0/2914378230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684415a950 msgr2=0x7f6844153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.340+0000 7f6849c00640 1 --2- 172.21.15.5:0/2914378230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684415a950 0x7f6844153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.340+0000 7f6849c00640 1 -- 172.21.15.5:0/2914378230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6844158f20 msgr2=0x7f68440ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.340+0000 7f6849c00640 1 --2- 172.21.15.5:0/2914378230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6844158f20 0x7f68440ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.340+0000 7f6849c00640 1 -- 172.21.15.5:0/2914378230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6830009450 con 0x7f68440a9630 2024-08-17T02:46:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.340+0000 7f684a600640 1 --2- 172.21.15.5:0/2914378230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684415a950 0x7f6844153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.340+0000 7f6849c00640 1 --2- 172.21.15.5:0/2914378230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440a9630 0x7f684414c990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f683800ea20 tx=0x7f68380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.341+0000 7f6840c00640 1 -- 172.21.15.5:0/2914378230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683800ca10 con 0x7f68440a9630 2024-08-17T02:46:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.341+0000 7f6840c00640 1 -- 172.21.15.5:0/2914378230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683800cb70 con 0x7f68440a9630 2024-08-17T02:46:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.341+0000 7f6840c00640 1 -- 172.21.15.5:0/2914378230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838013470 con 0x7f68440a9630 2024-08-17T02:46:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.341+0000 7f684c600640 1 -- 172.21.15.5:0/2914378230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6844168ce0 con 0x7f68440a9630 2024-08-17T02:46:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.341+0000 7f684c600640 1 -- 172.21.15.5:0/2914378230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6844169580 con 0x7f68440a9630 2024-08-17T02:46:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.342+0000 7f684c600640 1 -- 172.21.15.5:0/2914378230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68441690e0 con 0x7f68440a9630 2024-08-17T02:46:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.343+0000 7f6840c00640 1 -- 172.21.15.5:0/2914378230 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6838013860 con 0x7f68440a9630 2024-08-17T02:46:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.344+0000 7f6840c00640 1 --2- 172.21.15.5:0/2914378230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6824065150 0x7f6824067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.344+0000 7f6840c00640 1 -- 172.21.15.5:0/2914378230 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f6838082600 con 0x7f68440a9630 2024-08-17T02:46:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.344+0000 7f6849200640 1 --2- 172.21.15.5:0/2914378230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6824065150 0x7f6824067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:56.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.345+0000 7f6849200640 1 --2- 172.21.15.5:0/2914378230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6824065150 0x7f6824067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6830034000 tx=0x7f6830032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:56.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.348+0000 7f6840c00640 1 -- 172.21.15.5:0/2914378230 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6838050800 con 0x7f68440a9630 2024-08-17T02:46:56.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:56.530+0000 7f684c600640 1 -- 172.21.15.5:0/2914378230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6844063fb0 con 0x7f68440a9630 2024-08-17T02:46:57.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.156+0000 7f6840c00640 1 -- 172.21.15.5:0/2914378230 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6838053e20 con 0x7f68440a9630 2024-08-17T02:46:57.158 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-17T02:46:57.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.164+0000 7f684c600640 1 -- 172.21.15.5:0/2914378230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6824065150 msgr2=0x7f6824067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.164+0000 7f684c600640 1 --2- 172.21.15.5:0/2914378230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6824065150 0x7f6824067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6830034000 tx=0x7f6830032000 comp rx=0 tx=0).stop 2024-08-17T02:46:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.164+0000 7f684c600640 1 -- 172.21.15.5:0/2914378230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440a9630 msgr2=0x7f684414c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.164+0000 7f684c600640 1 --2- 172.21.15.5:0/2914378230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440a9630 0x7f684414c990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f683800ea20 tx=0x7f68380090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.164+0000 7f684c600640 1 -- 172.21.15.5:0/2914378230 shutdown_connections 2024-08-17T02:46:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.164+0000 7f684c600640 1 --2- 172.21.15.5:0/2914378230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6824065150 0x7f6824067600 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.164+0000 7f684c600640 1 --2- 172.21.15.5:0/2914378230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684415a950 0x7f6844153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.164+0000 7f684c600640 1 --2- 172.21.15.5:0/2914378230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6844158f20 0x7f68440ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.164+0000 7f684c600640 1 --2- 172.21.15.5:0/2914378230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440a9630 0x7f684414c990 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.164+0000 7f684c600640 1 -- 172.21.15.5:0/2914378230 >> 172.21.15.5:0/2914378230 conn(0x7f684406e5b0 msgr2=0x7f68440cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.166+0000 7f684c600640 1 -- 172.21.15.5:0/2914378230 shutdown_connections 2024-08-17T02:46:57.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.166+0000 7f684c600640 1 -- 172.21.15.5:0/2914378230 wait complete. 2024-08-17T02:46:57.198 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:46:57.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:46:57.329 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:46:57.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.351+0000 7f278e000640 1 Processor -- start 2024-08-17T02:46:57.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.352+0000 7f278e000640 1 -- start start 2024-08-17T02:46:57.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.353+0000 7f278e000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27880cb0d0 0x7f2788158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.353+0000 7f278e000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f27880cda30 0x7f27880cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.353+0000 7f278e000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27880af9a0 con 0x7f27881589e0 2024-08-17T02:46:57.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.353+0000 7f278e000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27880af810 con 0x7f27880cb0d0 2024-08-17T02:46:57.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.353+0000 7f278e000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27880ce740 con 0x7f27880cda30 2024-08-17T02:46:57.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.353+0000 7f277ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27880cb0d0 0x7f2788158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.353+0000 7f2787400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f27881589e0 0x7f27880ca9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37018/0 (socket says 172.21.15.5:37018) 2024-08-17T02:46:57.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.353+0000 7f2787400640 1 -- 172.21.15.5:0/373391916 learned_addr learned my addr 172.21.15.5:0/373391916 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:46:57.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.353+0000 7f2787e00640 1 --2- 172.21.15.5:0/373391916 >> v2:172.21.15.107:3300/0 conn(0x7f27880cda30 0x7f27880cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.354+0000 7f277ea00640 1 -- 172.21.15.5:0/373391916 >> v2:172.21.15.107:3300/0 conn(0x7f27880cda30 msgr2=0x7f27880cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:57.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.354+0000 7f277ea00640 1 --2- 172.21.15.5:0/373391916 >> v2:172.21.15.107:3300/0 conn(0x7f27880cda30 0x7f27880cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.354+0000 7f277ea00640 1 -- 172.21.15.5:0/373391916 >> v1:172.21.15.5:6789/0 conn(0x7f27881589e0 legacy=0x7f27880ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.354+0000 7f277ea00640 1 -- 172.21.15.5:0/373391916 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27880cea00 con 0x7f27880cb0d0 2024-08-17T02:46:57.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.354+0000 7f2786a00640 1 -- 172.21.15.5:0/373391916 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086001039 0 0) 0x7f27880af9a0 con 0x7f27881589e0 2024-08-17T02:46:57.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.355+0000 7f277ea00640 1 --2- 172.21.15.5:0/373391916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27880cb0d0 0x7f2788158db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f27880cbe00 tx=0x7f27700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8f96d747b354b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.355+0000 7f2786a00640 1 -- 172.21.15.5:0/373391916 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277002adb0 con 0x7f27880cb0d0 2024-08-17T02:46:57.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.355+0000 7f2786a00640 1 -- 172.21.15.5:0/373391916 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2770032440 con 0x7f27880cb0d0 2024-08-17T02:46:57.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.355+0000 7f2786a00640 1 -- 172.21.15.5:0/373391916 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27700327e0 con 0x7f27880cb0d0 2024-08-17T02:46:57.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.356+0000 7f278e000640 1 -- 172.21.15.5:0/373391916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27880cb0d0 msgr2=0x7f2788158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.356+0000 7f278e000640 1 --2- 172.21.15.5:0/373391916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27880cb0d0 0x7f2788158db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f27880cbe00 tx=0x7f27700090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.356+0000 7f278e000640 1 -- 172.21.15.5:0/373391916 shutdown_connections 2024-08-17T02:46:57.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.356+0000 7f278e000640 1 --2- 172.21.15.5:0/373391916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27880cb0d0 0x7f2788158db0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.356+0000 7f278e000640 1 --2- 172.21.15.5:0/373391916 >> v2:172.21.15.107:3300/0 conn(0x7f27880cda30 0x7f27880cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.356+0000 7f278e000640 1 -- 172.21.15.5:0/373391916 >> 172.21.15.5:0/373391916 conn(0x7f278806e590 msgr2=0x7f278806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:57.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.356+0000 7f278e000640 1 -- 172.21.15.5:0/373391916 shutdown_connections 2024-08-17T02:46:57.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.356+0000 7f278e000640 1 -- 172.21.15.5:0/373391916 wait complete. 2024-08-17T02:46:57.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.357+0000 7f278e000640 1 Processor -- start 2024-08-17T02:46:57.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.358+0000 7f278e000640 1 -- start start 2024-08-17T02:46:57.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.358+0000 7f278e000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27880cb0d0 0x7f2788168ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.358+0000 7f278e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27880cda30 0x7f2788151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.358+0000 7f278e000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27881589e0 0x7f27880b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.358+0000 7f278e000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2788158ec0 con 0x7f27880cda30 2024-08-17T02:46:57.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.358+0000 7f278e000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2788152500 con 0x7f27880cb0d0 2024-08-17T02:46:57.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.358+0000 7f278e000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2788169510 con 0x7f27881589e0 2024-08-17T02:46:57.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.359+0000 7f277ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27880cda30 0x7f2788151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.359+0000 7f277ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27880cda30 0x7f2788151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59708/0 (socket says 172.21.15.5:59708) 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.359+0000 7f277ea00640 1 -- 172.21.15.5:0/892765381 learned_addr learned my addr 172.21.15.5:0/892765381 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.359+0000 7f2787e00640 1 --2- 172.21.15.5:0/892765381 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27881589e0 0x7f27880b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.359+0000 7f2787400640 1 --2- 172.21.15.5:0/892765381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27880cb0d0 0x7f2788168ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.359+0000 7f277ea00640 1 -- 172.21.15.5:0/892765381 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27881589e0 msgr2=0x7f27880b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.359+0000 7f277ea00640 1 --2- 172.21.15.5:0/892765381 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27881589e0 0x7f27880b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.359+0000 7f277ea00640 1 -- 172.21.15.5:0/892765381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27880cb0d0 msgr2=0x7f2788168ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.359+0000 7f277ea00640 1 --2- 172.21.15.5:0/892765381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27880cb0d0 0x7f2788168ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.359+0000 7f277ea00640 1 -- 172.21.15.5:0/892765381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770009390 con 0x7f27880cda30 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.359+0000 7f277ea00640 1 --2- 172.21.15.5:0/892765381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27880cda30 0x7f2788151fc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2770009360 tx=0x7f2770032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.360+0000 7f277f400640 1 -- 172.21.15.5:0/892765381 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770031de0 con 0x7f27880cda30 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.360+0000 7f277f400640 1 -- 172.21.15.5:0/892765381 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277003d420 con 0x7f27880cda30 2024-08-17T02:46:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.360+0000 7f277f400640 1 -- 172.21.15.5:0/892765381 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277003d7e0 con 0x7f27880cda30 2024-08-17T02:46:57.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.360+0000 7f278e000640 1 -- 172.21.15.5:0/892765381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27881697f0 con 0x7f27880cda30 2024-08-17T02:46:57.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.360+0000 7f278e000640 1 -- 172.21.15.5:0/892765381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2788169db0 con 0x7f27880cda30 2024-08-17T02:46:57.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.361+0000 7f278e000640 1 -- 172.21.15.5:0/892765381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2788063fb0 con 0x7f27880cda30 2024-08-17T02:46:57.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.362+0000 7f277f400640 1 -- 172.21.15.5:0/892765381 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2770039040 con 0x7f27880cda30 2024-08-17T02:46:57.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.362+0000 7f277f400640 1 --2- 172.21.15.5:0/892765381 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2764065150 0x7f2764067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:57.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.362+0000 7f277f400640 1 -- 172.21.15.5:0/892765381 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f27700a2450 con 0x7f27880cda30 2024-08-17T02:46:57.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.363+0000 7f2787400640 1 --2- 172.21.15.5:0/892765381 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2764065150 0x7f2764067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:57.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.363+0000 7f2787400640 1 --2- 172.21.15.5:0/892765381 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2764065150 0x7f2764067600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2778007160 tx=0x7f2778007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:57.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.367+0000 7f277f400640 1 -- 172.21.15.5:0/892765381 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2770070580 con 0x7f27880cda30 2024-08-17T02:46:57.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:57.588+0000 7f278e000640 1 -- 172.21.15.5:0/892765381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f27880c4d90 con 0x7f27880cda30 2024-08-17T02:46:58.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.159+0000 7f277f400640 1 -- 172.21.15.5:0/892765381 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2770073ba0 con 0x7f27880cda30 2024-08-17T02:46:58.161 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:46:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.164+0000 7f278e000640 1 -- 172.21.15.5:0/892765381 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2764065150 msgr2=0x7f2764067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.164+0000 7f278e000640 1 --2- 172.21.15.5:0/892765381 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2764065150 0x7f2764067600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2778007160 tx=0x7f2778007ec0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.164+0000 7f278e000640 1 -- 172.21.15.5:0/892765381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27880cda30 msgr2=0x7f2788151fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.164+0000 7f278e000640 1 --2- 172.21.15.5:0/892765381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27880cda30 0x7f2788151fc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2770009360 tx=0x7f2770032000 comp rx=0 tx=0).stop 2024-08-17T02:46:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.165+0000 7f278e000640 1 -- 172.21.15.5:0/892765381 shutdown_connections 2024-08-17T02:46:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.165+0000 7f278e000640 1 --2- 172.21.15.5:0/892765381 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2764065150 0x7f2764067600 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.165+0000 7f278e000640 1 --2- 172.21.15.5:0/892765381 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f27881589e0 0x7f27880b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.165+0000 7f278e000640 1 --2- 172.21.15.5:0/892765381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27880cda30 0x7f2788151fc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.165+0000 7f278e000640 1 --2- 172.21.15.5:0/892765381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27880cb0d0 0x7f2788168ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.165+0000 7f278e000640 1 -- 172.21.15.5:0/892765381 >> 172.21.15.5:0/892765381 conn(0x7f278806e590 msgr2=0x7f2788154b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.166+0000 7f278e000640 1 -- 172.21.15.5:0/892765381 shutdown_connections 2024-08-17T02:46:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.166+0000 7f278e000640 1 -- 172.21.15.5:0/892765381 wait complete. 2024-08-17T02:46:58.211 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:58.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.365+0000 7f4671400640 1 Processor -- start 2024-08-17T02:46:58.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.365+0000 7f4671400640 1 -- start start 2024-08-17T02:46:58.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.366+0000 7f4671400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f466c0ca050 0x7f466c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.367+0000 7f4671400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466c0cb160 con 0x7f466c0ad960 2024-08-17T02:46:58.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.367+0000 7f4671400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466c0b0d10 con 0x7f466c0add30 2024-08-17T02:46:58.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.367+0000 7f4671400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c0ca550 con 0x7f466c0ca050 2024-08-17T02:46:58.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.367+0000 7f466a800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f466c0ad960 0x7f466c156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37026/0 (socket says 172.21.15.5:37026) 2024-08-17T02:46:58.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.367+0000 7f466a800640 1 -- 172.21.15.5:0/1838457519 learned_addr learned my addr 172.21.15.5:0/1838457519 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:46:58.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.367+0000 7f4663e00640 1 --2- 172.21.15.5:0/1838457519 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f466c0ca050 0x7f466c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.367+0000 7f4669e00640 1 -- 172.21.15.5:0/1838457519 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905645000 0 0) 0x7f466c0cb160 con 0x7f466c0ad960 2024-08-17T02:46:58.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.367+0000 7f4669e00640 1 -- 172.21.15.5:0/1838457519 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46500034e0 con 0x7f466c0ad960 2024-08-17T02:46:58.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.367+0000 7f4669e00640 1 -- 172.21.15.5:0/1838457519 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848551159 0 0) 0x7f466c0b0d10 con 0x7f466c0add30 2024-08-17T02:46:58.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.367+0000 7f4669e00640 1 -- 172.21.15.5:0/1838457519 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f466c0cb160 con 0x7f466c0add30 2024-08-17T02:46:58.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.367+0000 7f4663e00640 1 -- 172.21.15.5:0/1838457519 >> v1:172.21.15.107:6789/0 conn(0x7f466c0add30 legacy=0x7f466c0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.368+0000 7f4663e00640 1 -- 172.21.15.5:0/1838457519 >> v1:172.21.15.5:6789/0 conn(0x7f466c0ad960 legacy=0x7f466c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.368+0000 7f4669e00640 1 -- 172.21.15.5:0/1838457519 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1838768243 0 0) 0x7f46500034e0 con 0x7f466c0ad960 2024-08-17T02:46:58.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.368+0000 7f4663e00640 1 -- 172.21.15.5:0/1838457519 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c0ca830 con 0x7f466c0ca050 2024-08-17T02:46:58.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.369+0000 7f4663e00640 1 --2- 172.21.15.5:0/1838457519 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f466c0ca050 0x7f466c156b30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4654009880 tx=0x7f46540090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a1363c315a9546b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:58.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.369+0000 7f4669e00640 1 -- 172.21.15.5:0/1838457519 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c001470 con 0x7f466c0ca050 2024-08-17T02:46:58.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.369+0000 7f4669e00640 1 -- 172.21.15.5:0/1838457519 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465402ab50 con 0x7f466c0ca050 2024-08-17T02:46:58.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.369+0000 7f4669e00640 1 -- 172.21.15.5:0/1838457519 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4654032440 con 0x7f466c0ca050 2024-08-17T02:46:58.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.369+0000 7f4671400640 1 -- 172.21.15.5:0/1838457519 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f466c0ca050 msgr2=0x7f466c156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.369+0000 7f4671400640 1 --2- 172.21.15.5:0/1838457519 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f466c0ca050 0x7f466c156b30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4654009880 tx=0x7f46540090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.370+0000 7f4671400640 1 -- 172.21.15.5:0/1838457519 shutdown_connections 2024-08-17T02:46:58.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.370+0000 7f4671400640 1 --2- 172.21.15.5:0/1838457519 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f466c0ca050 0x7f466c156b30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.370+0000 7f4671400640 1 -- 172.21.15.5:0/1838457519 >> 172.21.15.5:0/1838457519 conn(0x7f466c066e60 msgr2=0x7f466c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:58.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.370+0000 7f4671400640 1 -- 172.21.15.5:0/1838457519 shutdown_connections 2024-08-17T02:46:58.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.370+0000 7f4671400640 1 -- 172.21.15.5:0/1838457519 wait complete. 2024-08-17T02:46:58.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.371+0000 7f4671400640 1 Processor -- start 2024-08-17T02:46:58.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.371+0000 7f4671400640 1 -- start start 2024-08-17T02:46:58.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.372+0000 7f4671400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466c0ad960 0x7f466c0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.372+0000 7f4671400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f466c0add30 0x7f466c0a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.372+0000 7f4671400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f466c0ca050 0x7f466c0a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.372+0000 7f4671400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c0ab110 con 0x7f466c0ad960 2024-08-17T02:46:58.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.372+0000 7f4671400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c169350 con 0x7f466c0add30 2024-08-17T02:46:58.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.372+0000 7f4671400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c0aa490 con 0x7f466c0ca050 2024-08-17T02:46:58.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.372+0000 7f466a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466c0ad960 0x7f466c0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.372+0000 7f466a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466c0ad960 0x7f466c0c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59714/0 (socket says 172.21.15.5:59714) 2024-08-17T02:46:58.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.372+0000 7f466a800640 1 -- 172.21.15.5:0/971187655 learned_addr learned my addr 172.21.15.5:0/971187655 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:58.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.372+0000 7f4663e00640 1 --2- 172.21.15.5:0/971187655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f466c0add30 0x7f466c0a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.372+0000 7f466b200640 1 --2- 172.21.15.5:0/971187655 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f466c0ca050 0x7f466c0a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.373+0000 7f466a800640 1 -- 172.21.15.5:0/971187655 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f466c0ca050 msgr2=0x7f466c0a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.373+0000 7f466a800640 1 --2- 172.21.15.5:0/971187655 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f466c0ca050 0x7f466c0a9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.373+0000 7f466a800640 1 -- 172.21.15.5:0/971187655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f466c0add30 msgr2=0x7f466c0a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.373+0000 7f466a800640 1 --2- 172.21.15.5:0/971187655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f466c0add30 0x7f466c0a98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.373+0000 7f466a800640 1 -- 172.21.15.5:0/971187655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4654009390 con 0x7f466c0ad960 2024-08-17T02:46:58.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.373+0000 7f4663e00640 1 --2- 172.21.15.5:0/971187655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f466c0add30 0x7f466c0a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:58.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.373+0000 7f466a800640 1 --2- 172.21.15.5:0/971187655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466c0ad960 0x7f466c0c8220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f465c001380 tx=0x7f465c001bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:58.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.373+0000 7f4662000640 1 -- 172.21.15.5:0/971187655 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c007360 con 0x7f466c0ad960 2024-08-17T02:46:58.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.373+0000 7f4662000640 1 -- 172.21.15.5:0/971187655 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c0074e0 con 0x7f466c0ad960 2024-08-17T02:46:58.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.373+0000 7f4662000640 1 -- 172.21.15.5:0/971187655 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c0049f0 con 0x7f466c0ad960 2024-08-17T02:46:58.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.373+0000 7f4671400640 1 -- 172.21.15.5:0/971187655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466c0aa770 con 0x7f466c0ad960 2024-08-17T02:46:58.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.374+0000 7f4671400640 1 -- 172.21.15.5:0/971187655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466c0aad30 con 0x7f466c0ad960 2024-08-17T02:46:58.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.375+0000 7f4671400640 1 -- 172.21.15.5:0/971187655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466c0ab250 con 0x7f466c0ad960 2024-08-17T02:46:58.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.375+0000 7f4662000640 1 -- 172.21.15.5:0/971187655 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f465c00a5b0 con 0x7f466c0ad960 2024-08-17T02:46:58.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.376+0000 7f4662000640 1 --2- 172.21.15.5:0/971187655 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4648065150 0x7f4648067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.376+0000 7f4662000640 1 -- 172.21.15.5:0/971187655 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f465c081ca0 con 0x7f466c0ad960 2024-08-17T02:46:58.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.377+0000 7f4663e00640 1 --2- 172.21.15.5:0/971187655 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4648065150 0x7f4648067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.377+0000 7f4663e00640 1 --2- 172.21.15.5:0/971187655 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4648065150 0x7f4648067600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4654034000 tx=0x7f4654032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:58.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.380+0000 7f4662000640 1 -- 172.21.15.5:0/971187655 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f465c04fe90 con 0x7f466c0ad960 2024-08-17T02:46:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.564+0000 7f4671400640 1 -- 172.21.15.5:0/971187655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f466c063fb0 con 0x7f466c0ad960 2024-08-17T02:46:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.564+0000 7f4662000640 1 -- 172.21.15.5:0/971187655 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f465c018020 con 0x7f466c0ad960 2024-08-17T02:46:58.566 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:46:58.566 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:57.589977+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:55.543347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:56.571235+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.566+0000 7f4671400640 1 -- 172.21.15.5:0/971187655 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4648065150 msgr2=0x7f4648067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.566+0000 7f4671400640 1 --2- 172.21.15.5:0/971187655 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4648065150 0x7f4648067600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4654034000 tx=0x7f4654032000 comp rx=0 tx=0).stop 2024-08-17T02:46:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.566+0000 7f4671400640 1 -- 172.21.15.5:0/971187655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466c0ad960 msgr2=0x7f466c0c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.566+0000 7f4671400640 1 --2- 172.21.15.5:0/971187655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466c0ad960 0x7f466c0c8220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f465c001380 tx=0x7f465c001bd0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.567+0000 7f4671400640 1 -- 172.21.15.5:0/971187655 shutdown_connections 2024-08-17T02:46:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.567+0000 7f4671400640 1 --2- 172.21.15.5:0/971187655 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4648065150 0x7f4648067600 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.567+0000 7f4671400640 1 --2- 172.21.15.5:0/971187655 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f466c0ca050 0x7f466c0a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.567+0000 7f4671400640 1 --2- 172.21.15.5:0/971187655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f466c0add30 0x7f466c0a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.567+0000 7f4671400640 1 --2- 172.21.15.5:0/971187655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466c0ad960 0x7f466c0c8220 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.567+0000 7f4671400640 1 -- 172.21.15.5:0/971187655 >> 172.21.15.5:0/971187655 conn(0x7f466c066e60 msgr2=0x7f466c06d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.567+0000 7f4671400640 1 -- 172.21.15.5:0/971187655 shutdown_connections 2024-08-17T02:46:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.567+0000 7f4671400640 1 -- 172.21.15.5:0/971187655 wait complete. 2024-08-17T02:46:58.583 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.733+0000 7fa623200640 1 Processor -- start 2024-08-17T02:46:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.733+0000 7fa623200640 1 -- start start 2024-08-17T02:46:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.734+0000 7fa623200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa61c0cadc0 0x7fa61c0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.734+0000 7fa623200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c0cca40 0x7fa61c0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.734+0000 7fa623200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61c0cf600 con 0x7fa61c158c90 2024-08-17T02:46:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.734+0000 7fa623200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61c0ce890 con 0x7fa61c0cadc0 2024-08-17T02:46:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.734+0000 7fa623200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c0cea90 con 0x7fa61c0cca40 2024-08-17T02:46:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.734+0000 7fa621400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa61c0cadc0 0x7fa61c0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.734+0000 7fa621400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa61c0cadc0 0x7fa61c0cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59730/0 (socket says 172.21.15.5:59730) 2024-08-17T02:46:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.734+0000 7fa621400640 1 -- 172.21.15.5:0/3733462903 learned_addr learned my addr 172.21.15.5:0/3733462903 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.734+0000 7fa622800640 1 --2- 172.21.15.5:0/3733462903 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c0cca40 0x7fa61c0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.735+0000 7fa621400640 1 -- 172.21.15.5:0/3733462903 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c0cca40 msgr2=0x7fa61c0af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.735+0000 7fa621400640 1 --2- 172.21.15.5:0/3733462903 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c0cca40 0x7fa61c0af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.735+0000 7fa621400640 1 -- 172.21.15.5:0/3733462903 >> v1:172.21.15.107:6789/0 conn(0x7fa61c158c90 legacy=0x7fa61c0ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.735+0000 7fa621400640 1 -- 172.21.15.5:0/3733462903 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c0ced30 con 0x7fa61c0cadc0 2024-08-17T02:46:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.735+0000 7fa622800640 1 --2- 172.21.15.5:0/3733462903 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c0cca40 0x7fa61c0af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.736+0000 7fa621400640 1 --2- 172.21.15.5:0/3733462903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa61c0cadc0 0x7fa61c0cc500 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009910 tx=0x7fa60c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cfc34c4b015f3f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.736+0000 7fa620a00640 1 -- 172.21.15.5:0/3733462903 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c02ae40 con 0x7fa61c0cadc0 2024-08-17T02:46:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.736+0000 7fa620a00640 1 -- 172.21.15.5:0/3733462903 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60c032440 con 0x7fa61c0cadc0 2024-08-17T02:46:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.736+0000 7fa620a00640 1 -- 172.21.15.5:0/3733462903 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c032820 con 0x7fa61c0cadc0 2024-08-17T02:46:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.736+0000 7fa623200640 1 -- 172.21.15.5:0/3733462903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa61c0cadc0 msgr2=0x7fa61c0cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.736+0000 7fa623200640 1 --2- 172.21.15.5:0/3733462903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa61c0cadc0 0x7fa61c0cc500 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009910 tx=0x7fa60c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.737+0000 7fa623200640 1 -- 172.21.15.5:0/3733462903 shutdown_connections 2024-08-17T02:46:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.737+0000 7fa623200640 1 --2- 172.21.15.5:0/3733462903 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c0cca40 0x7fa61c0af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.737+0000 7fa623200640 1 --2- 172.21.15.5:0/3733462903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa61c0cadc0 0x7fa61c0cc500 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.737+0000 7fa623200640 1 -- 172.21.15.5:0/3733462903 >> 172.21.15.5:0/3733462903 conn(0x7fa61c087a80 msgr2=0x7fa61c06e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.737+0000 7fa623200640 1 -- 172.21.15.5:0/3733462903 shutdown_connections 2024-08-17T02:46:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.737+0000 7fa623200640 1 -- 172.21.15.5:0/3733462903 wait complete. 2024-08-17T02:46:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.738+0000 7fa623200640 1 Processor -- start 2024-08-17T02:46:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.738+0000 7fa623200640 1 -- start start 2024-08-17T02:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.739+0000 7fa623200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c0cadc0 0x7fa61c152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.739+0000 7fa623200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa61c0cca40 0x7fa61c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.739+0000 7fa623200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa61c158c90 0x7fa61c159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.739+0000 7fa623200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c0c7dd0 con 0x7fa61c0cca40 2024-08-17T02:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.739+0000 7fa623200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c0c71c0 con 0x7fa61c158c90 2024-08-17T02:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.739+0000 7fa623200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c0c74a0 con 0x7fa61c0cadc0 2024-08-17T02:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.739+0000 7fa621400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa61c0cca40 0x7fa61c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.739+0000 7fa621e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c0cadc0 0x7fa61c152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.739+0000 7fa621400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa61c0cca40 0x7fa61c0c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59734/0 (socket says 172.21.15.5:59734) 2024-08-17T02:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.739+0000 7fa621400640 1 -- 172.21.15.5:0/3082244260 learned_addr learned my addr 172.21.15.5:0/3082244260 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:58.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.739+0000 7fa622800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa61c158c90 0x7fa61c159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.740+0000 7fa621400640 1 -- 172.21.15.5:0/3082244260 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c0cadc0 msgr2=0x7fa61c152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.740+0000 7fa621400640 1 --2- 172.21.15.5:0/3082244260 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c0cadc0 0x7fa61c152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.740+0000 7fa621400640 1 -- 172.21.15.5:0/3082244260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa61c158c90 msgr2=0x7fa61c159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.740+0000 7fa621400640 1 --2- 172.21.15.5:0/3082244260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa61c158c90 0x7fa61c159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.740+0000 7fa621400640 1 -- 172.21.15.5:0/3082244260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c009450 con 0x7fa61c0cca40 2024-08-17T02:46:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.740+0000 7fa621400640 1 --2- 172.21.15.5:0/3082244260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa61c0cca40 0x7fa61c0c8260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa60c035040 tx=0x7fa60c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.740+0000 7fa615600640 1 -- 172.21.15.5:0/3082244260 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c000c90 con 0x7fa61c0cca40 2024-08-17T02:46:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.740+0000 7fa615600640 1 -- 172.21.15.5:0/3082244260 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60c031a40 con 0x7fa61c0cca40 2024-08-17T02:46:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.740+0000 7fa615600640 1 -- 172.21.15.5:0/3082244260 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c031e00 con 0x7fa61c0cca40 2024-08-17T02:46:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.740+0000 7fa623200640 1 -- 172.21.15.5:0/3082244260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61c0c7780 con 0x7fa61c0cca40 2024-08-17T02:46:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.741+0000 7fa623200640 1 -- 172.21.15.5:0/3082244260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61c1526c0 con 0x7fa61c0cca40 2024-08-17T02:46:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.742+0000 7fa623200640 1 -- 172.21.15.5:0/3082244260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61c070720 con 0x7fa61c0cca40 2024-08-17T02:46:58.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.742+0000 7fa615600640 1 -- 172.21.15.5:0/3082244260 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa60c039040 con 0x7fa61c0cca40 2024-08-17T02:46:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.743+0000 7fa615600640 1 --2- 172.21.15.5:0/3082244260 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa600065150 0x7fa600067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.744+0000 7fa615600640 1 -- 172.21.15.5:0/3082244260 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa60c02ae40 con 0x7fa61c0cca40 2024-08-17T02:46:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.744+0000 7fa621e00640 1 --2- 172.21.15.5:0/3082244260 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa600065150 0x7fa600067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.744+0000 7fa621e00640 1 --2- 172.21.15.5:0/3082244260 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa600065150 0x7fa600067600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa610007fd0 tx=0x7fa610007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:58.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.748+0000 7fa615600640 1 -- 172.21.15.5:0/3082244260 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa60c070170 con 0x7fa61c0cca40 2024-08-17T02:46:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.930+0000 7fa623200640 1 -- 172.21.15.5:0/3082244260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa61c0693e0 con 0x7fa61c0cca40 2024-08-17T02:46:58.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.931+0000 7fa615600640 1 -- 172.21.15.5:0/3082244260 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15315 (secure 0 0 0) 0x7fa60c037090 con 0x7fa61c0cca40 2024-08-17T02:46:58.933 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:46:58.933 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:57.589977+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:55.543347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:56.571235+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.933+0000 7fa623200640 1 -- 172.21.15.5:0/3082244260 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa600065150 msgr2=0x7fa600067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.933+0000 7fa623200640 1 --2- 172.21.15.5:0/3082244260 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa600065150 0x7fa600067600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa610007fd0 tx=0x7fa610007e30 comp rx=0 tx=0).stop 2024-08-17T02:46:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.933+0000 7fa623200640 1 -- 172.21.15.5:0/3082244260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa61c0cca40 msgr2=0x7fa61c0c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.933+0000 7fa623200640 1 --2- 172.21.15.5:0/3082244260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa61c0cca40 0x7fa61c0c8260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa60c035040 tx=0x7fa60c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.933+0000 7fa623200640 1 -- 172.21.15.5:0/3082244260 shutdown_connections 2024-08-17T02:46:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.933+0000 7fa623200640 1 --2- 172.21.15.5:0/3082244260 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa600065150 0x7fa600067600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.933+0000 7fa623200640 1 --2- 172.21.15.5:0/3082244260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa61c158c90 0x7fa61c159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.933+0000 7fa623200640 1 --2- 172.21.15.5:0/3082244260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa61c0cca40 0x7fa61c0c8260 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.933+0000 7fa623200640 1 --2- 172.21.15.5:0/3082244260 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa61c0cadc0 0x7fa61c152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.933+0000 7fa623200640 1 -- 172.21.15.5:0/3082244260 >> 172.21.15.5:0/3082244260 conn(0x7fa61c087a80 msgr2=0x7fa61c0c60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.933+0000 7fa623200640 1 -- 172.21.15.5:0/3082244260 shutdown_connections 2024-08-17T02:46:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:58.933+0000 7fa623200640 1 -- 172.21.15.5:0/3082244260 wait complete. 2024-08-17T02:46:58.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:46:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.103+0000 7f82d8a00640 1 Processor -- start 2024-08-17T02:46:59.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.103+0000 7f82d8a00640 1 -- start start 2024-08-17T02:46:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.104+0000 7f82d8a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82d4158d50 0x7f82d40ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.104+0000 7f82d8a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f82d40ac000 0x7f82d40aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.104+0000 7f82d8a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d40a96c0 con 0x7f82d4159120 2024-08-17T02:46:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.104+0000 7f82d8a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d40acf00 con 0x7f82d4158d50 2024-08-17T02:46:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.104+0000 7f82d8a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d40af7d0 con 0x7f82d40ac000 2024-08-17T02:46:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.104+0000 7f82d1e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82d4158d50 0x7f82d40ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.104+0000 7f82cbe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f82d4159120 0x7f82d40ab8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37032/0 (socket says 172.21.15.5:37032) 2024-08-17T02:46:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.104+0000 7f82cbe00640 1 -- 172.21.15.5:0/2631395831 learned_addr learned my addr 172.21.15.5:0/2631395831 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:46:59.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.104+0000 7f82d2800640 1 --2- 172.21.15.5:0/2631395831 >> v2:172.21.15.107:3300/0 conn(0x7f82d40ac000 0x7f82d40aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.105+0000 7f82d1e00640 1 -- 172.21.15.5:0/2631395831 >> v2:172.21.15.107:3300/0 conn(0x7f82d40ac000 msgr2=0x7f82d40aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.105+0000 7f82d1e00640 1 --2- 172.21.15.5:0/2631395831 >> v2:172.21.15.107:3300/0 conn(0x7f82d40ac000 0x7f82d40aa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.105+0000 7f82d1e00640 1 -- 172.21.15.5:0/2631395831 >> v1:172.21.15.5:6789/0 conn(0x7f82d4159120 legacy=0x7f82d40ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.105+0000 7f82d1e00640 1 -- 172.21.15.5:0/2631395831 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d40a98f0 con 0x7f82d4158d50 2024-08-17T02:46:59.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.105+0000 7f82d1400640 1 -- 172.21.15.5:0/2631395831 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250176523 0 0) 0x7f82d40a96c0 con 0x7f82d4159120 2024-08-17T02:46:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.106+0000 7f82d1e00640 1 --2- 172.21.15.5:0/2631395831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d4158d50 0x7f82d40ac4a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f82d415c9b0 tx=0x7f82c40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4c11c91b1ab335 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.106+0000 7f82d1400640 1 -- 172.21.15.5:0/2631395831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c402ad20 con 0x7f82d4158d50 2024-08-17T02:46:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.106+0000 7f82d1400640 1 -- 172.21.15.5:0/2631395831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c402ae80 con 0x7f82d4158d50 2024-08-17T02:46:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.106+0000 7f82d1400640 1 -- 172.21.15.5:0/2631395831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4032670 con 0x7f82d4158d50 2024-08-17T02:46:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.106+0000 7f82d8a00640 1 -- 172.21.15.5:0/2631395831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d4158d50 msgr2=0x7f82d40ac4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.106+0000 7f82d8a00640 1 --2- 172.21.15.5:0/2631395831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d4158d50 0x7f82d40ac4a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f82d415c9b0 tx=0x7f82c40090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.106+0000 7f82d8a00640 1 -- 172.21.15.5:0/2631395831 shutdown_connections 2024-08-17T02:46:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.106+0000 7f82d8a00640 1 --2- 172.21.15.5:0/2631395831 >> v2:172.21.15.107:3300/0 conn(0x7f82d40ac000 0x7f82d40aa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.106+0000 7f82d8a00640 1 --2- 172.21.15.5:0/2631395831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d4158d50 0x7f82d40ac4a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.106+0000 7f82d8a00640 1 -- 172.21.15.5:0/2631395831 >> 172.21.15.5:0/2631395831 conn(0x7f82d4095a70 msgr2=0x7f82d4095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.107+0000 7f82d8a00640 1 -- 172.21.15.5:0/2631395831 shutdown_connections 2024-08-17T02:46:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.107+0000 7f82d8a00640 1 -- 172.21.15.5:0/2631395831 wait complete. 2024-08-17T02:46:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.108+0000 7f82d8a00640 1 Processor -- start 2024-08-17T02:46:59.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.108+0000 7f82d8a00640 1 -- start start 2024-08-17T02:46:59.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.109+0000 7f82d8a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d40ac000 0x7f82d416a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.109+0000 7f82d8a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82d4158d50 0x7f82d416cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.109+0000 7f82d8a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82d4159120 0x7f82d415ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.109+0000 7f82d8a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d416dbe0 con 0x7f82d40ac000 2024-08-17T02:46:59.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.109+0000 7f82d8a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d416d130 con 0x7f82d4159120 2024-08-17T02:46:59.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.109+0000 7f82d8a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d406aed0 con 0x7f82d4158d50 2024-08-17T02:46:59.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.109+0000 7f82d1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d40ac000 0x7f82d416a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.109+0000 7f82d1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d40ac000 0x7f82d416a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59756/0 (socket says 172.21.15.5:59756) 2024-08-17T02:46:59.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.109+0000 7f82d1e00640 1 -- 172.21.15.5:0/845601024 learned_addr learned my addr 172.21.15.5:0/845601024 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:46:59.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.109+0000 7f82cbe00640 1 --2- 172.21.15.5:0/845601024 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82d4158d50 0x7f82d416cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.109+0000 7f82d2800640 1 --2- 172.21.15.5:0/845601024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82d4159120 0x7f82d415ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.110+0000 7f82d1e00640 1 -- 172.21.15.5:0/845601024 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82d4158d50 msgr2=0x7f82d416cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.110+0000 7f82d1e00640 1 --2- 172.21.15.5:0/845601024 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82d4158d50 0x7f82d416cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.110+0000 7f82d1e00640 1 -- 172.21.15.5:0/845601024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82d4159120 msgr2=0x7f82d415ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.110+0000 7f82d1e00640 1 --2- 172.21.15.5:0/845601024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82d4159120 0x7f82d415ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.110+0000 7f82d1e00640 1 -- 172.21.15.5:0/845601024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c4009390 con 0x7f82d40ac000 2024-08-17T02:46:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.110+0000 7f82d1e00640 1 --2- 172.21.15.5:0/845601024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d40ac000 0x7f82d416a190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009880 tx=0x7f82c4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.110+0000 7f82c9600640 1 -- 172.21.15.5:0/845601024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4031700 con 0x7f82d40ac000 2024-08-17T02:46:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.110+0000 7f82c9600640 1 -- 172.21.15.5:0/845601024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c4031860 con 0x7f82d40ac000 2024-08-17T02:46:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.110+0000 7f82c9600640 1 -- 172.21.15.5:0/845601024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4031c60 con 0x7f82d40ac000 2024-08-17T02:46:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.110+0000 7f82d8a00640 1 -- 172.21.15.5:0/845601024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d415b040 con 0x7f82d40ac000 2024-08-17T02:46:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.110+0000 7f82d8a00640 1 -- 172.21.15.5:0/845601024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d416d620 con 0x7f82d40ac000 2024-08-17T02:46:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.111+0000 7f82d8a00640 1 -- 172.21.15.5:0/845601024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d406aca0 con 0x7f82d40ac000 2024-08-17T02:46:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.112+0000 7f82c9600640 1 -- 172.21.15.5:0/845601024 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f82c4039050 con 0x7f82d40ac000 2024-08-17T02:46:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.113+0000 7f82c9600640 1 --2- 172.21.15.5:0/845601024 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f82b00651d0 0x7f82b0067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.113+0000 7f82c9600640 1 -- 172.21.15.5:0/845601024 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82c40a2bc0 con 0x7f82d40ac000 2024-08-17T02:46:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.113+0000 7f82cbe00640 1 --2- 172.21.15.5:0/845601024 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f82b00651d0 0x7f82b0067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.114+0000 7f82cbe00640 1 --2- 172.21.15.5:0/845601024 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f82b00651d0 0x7f82b0067680 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f82d40b08b0 tx=0x7f82bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:59.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.117+0000 7f82c9600640 1 -- 172.21.15.5:0/845601024 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f82d406aca0 con 0x7f82d40ac000 2024-08-17T02:46:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:46:59.343+0000 7f82d8a00640 1 -- 172.21.15.5:0/845601024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f82d406aca0 con 0x7f82d40ac000 2024-08-17T02:47:00.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.184+0000 7f82c9600640 1 -- 172.21.15.5:0/845601024 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f82d406aca0 con 0x7f82d40ac000 2024-08-17T02:47:00.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.187+0000 7f82d8a00640 1 -- 172.21.15.5:0/845601024 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f82b00651d0 msgr2=0x7f82b0067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.187+0000 7f82d8a00640 1 --2- 172.21.15.5:0/845601024 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f82b00651d0 0x7f82b0067680 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f82d40b08b0 tx=0x7f82bc009040 comp rx=0 tx=0).stop 2024-08-17T02:47:00.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.187+0000 7f82d8a00640 1 -- 172.21.15.5:0/845601024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d40ac000 msgr2=0x7f82d416a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.187+0000 7f82d8a00640 1 --2- 172.21.15.5:0/845601024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d40ac000 0x7f82d416a190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009880 tx=0x7f82c4032000 comp rx=0 tx=0).stop 2024-08-17T02:47:00.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.187+0000 7f82d8a00640 1 -- 172.21.15.5:0/845601024 shutdown_connections 2024-08-17T02:47:00.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.187+0000 7f82d8a00640 1 --2- 172.21.15.5:0/845601024 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f82b00651d0 0x7f82b0067680 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.187+0000 7f82d8a00640 1 --2- 172.21.15.5:0/845601024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82d4159120 0x7f82d415ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.187+0000 7f82d8a00640 1 --2- 172.21.15.5:0/845601024 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f82d4158d50 0x7f82d416cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.187+0000 7f82d8a00640 1 --2- 172.21.15.5:0/845601024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d40ac000 0x7f82d416a190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.187+0000 7f82d8a00640 1 -- 172.21.15.5:0/845601024 >> 172.21.15.5:0/845601024 conn(0x7f82d4095a70 msgr2=0x7f82d40aafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.187+0000 7f82d8a00640 1 -- 172.21.15.5:0/845601024 shutdown_connections 2024-08-17T02:47:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.187+0000 7f82d8a00640 1 -- 172.21.15.5:0/845601024 wait complete. 2024-08-17T02:47:00.206 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:47:00.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.363+0000 7f6922600640 1 Processor -- start 2024-08-17T02:47:00.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.364+0000 7f6922600640 1 -- start start 2024-08-17T02:47:00.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.365+0000 7f6922600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f691c0ab850 0x7f691c0a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.365+0000 7f6922600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f691c0a9c00 0x7f691c0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.365+0000 7f6922600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f691c0aa380 con 0x7f691c159f90 2024-08-17T02:47:00.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.365+0000 7f6922600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691c0aa660 con 0x7f691c0ab850 2024-08-17T02:47:00.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.365+0000 7f6922600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691c0aa940 con 0x7f691c0a9c00 2024-08-17T02:47:00.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.365+0000 7f6921200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f691c159f90 0x7f691c0ab140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37034/0 (socket says 172.21.15.5:37034) 2024-08-17T02:47:00.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.365+0000 7f6921200640 1 -- 172.21.15.5:0/3190705752 learned_addr learned my addr 172.21.15.5:0/3190705752 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:00.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.365+0000 7f691be00640 1 --2- 172.21.15.5:0/3190705752 >> v2:172.21.15.107:3300/0 conn(0x7f691c0ab850 0x7f691c0a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.365+0000 7f6921c00640 1 --2- 172.21.15.5:0/3190705752 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f691c0a9c00 0x7f691c0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.365+0000 7f691b400640 1 -- 172.21.15.5:0/3190705752 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062814043 0 0) 0x7f691c0aa380 con 0x7f691c159f90 2024-08-17T02:47:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.365+0000 7f691b400640 1 -- 172.21.15.5:0/3190705752 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69040034e0 con 0x7f691c159f90 2024-08-17T02:47:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691b400640 1 -- 172.21.15.5:0/3190705752 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3940340358 0 0) 0x7f69040034e0 con 0x7f691c159f90 2024-08-17T02:47:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691b400640 1 -- 172.21.15.5:0/3190705752 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f691c0a9c00 msgr2=0x7f691c0ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691b400640 1 --2- 172.21.15.5:0/3190705752 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f691c0a9c00 0x7f691c0ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691b400640 1 -- 172.21.15.5:0/3190705752 >> v2:172.21.15.107:3300/0 conn(0x7f691c0ab850 msgr2=0x7f691c0a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691b400640 1 --2- 172.21.15.5:0/3190705752 >> v2:172.21.15.107:3300/0 conn(0x7f691c0ab850 0x7f691c0a96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691b400640 1 -- 172.21.15.5:0/3190705752 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c0aac20 con 0x7f691c159f90 2024-08-17T02:47:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691b400640 1 -- 172.21.15.5:0/3190705752 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7f6910001470 con 0x7f691c159f90 2024-08-17T02:47:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691b400640 1 -- 172.21.15.5:0/3190705752 >> v1:172.21.15.5:6789/0 conn(0x7f691c159f90 legacy=0x7f691c0ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691b400640 1 --2- 172.21.15.5:0/3190705752 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f691c0a9c00 0x7f6904003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691b400640 1 --2- 172.21.15.5:0/3190705752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6904004020 0x7f6904004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691b400640 1 --2- 172.21.15.5:0/3190705752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6904004cc0 0x7f6904005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691b400640 1 -- 172.21.15.5:0/3190705752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c0aa660 con 0x7f6904004cc0 2024-08-17T02:47:00.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691b400640 1 -- 172.21.15.5:0/3190705752 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c0aa940 con 0x7f6904004020 2024-08-17T02:47:00.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691b400640 1 -- 172.21.15.5:0/3190705752 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690400bb60 con 0x7f691c0a9c00 2024-08-17T02:47:00.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f6921c00640 1 --2- 172.21.15.5:0/3190705752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6904004cc0 0x7f6904005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691be00640 1 --2- 172.21.15.5:0/3190705752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6904004020 0x7f6904004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f6921200640 1 --2- 172.21.15.5:0/3190705752 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f691c0a9c00 0x7f6904003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691be00640 1 -- 172.21.15.5:0/3190705752 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f691c0a9c00 msgr2=0x7f6904003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:00.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.366+0000 7f691be00640 1 --2- 172.21.15.5:0/3190705752 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f691c0a9c00 0x7f6904003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.367+0000 7f691be00640 1 -- 172.21.15.5:0/3190705752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6904004cc0 msgr2=0x7f6904005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:00.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.367+0000 7f691be00640 1 --2- 172.21.15.5:0/3190705752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6904004cc0 0x7f6904005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.367+0000 7f691be00640 1 -- 172.21.15.5:0/3190705752 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69040034e0 con 0x7f6904004020 2024-08-17T02:47:00.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.367+0000 7f6921c00640 1 --2- 172.21.15.5:0/3190705752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6904004cc0 0x7f6904005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.368+0000 7f691be00640 1 --2- 172.21.15.5:0/3190705752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6904004020 0x7f6904004780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f691c0abc50 tx=0x7f69080090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d7c04c4fc4b966f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.368+0000 7f691b400640 1 -- 172.21.15.5:0/3190705752 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908031400 con 0x7f6904004020 2024-08-17T02:47:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.368+0000 7f691b400640 1 -- 172.21.15.5:0/3190705752 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690802d050 con 0x7f6904004020 2024-08-17T02:47:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.368+0000 7f691b400640 1 -- 172.21.15.5:0/3190705752 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908031790 con 0x7f6904004020 2024-08-17T02:47:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.368+0000 7f6922600640 1 -- 172.21.15.5:0/3190705752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6904004020 msgr2=0x7f6904004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.368+0000 7f6922600640 1 --2- 172.21.15.5:0/3190705752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6904004020 0x7f6904004780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f691c0abc50 tx=0x7f69080090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.368+0000 7f6921c00640 1 -- 172.21.15.5:0/3190705752 reap_dead start 2024-08-17T02:47:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.368+0000 7f6922600640 1 -- 172.21.15.5:0/3190705752 shutdown_connections 2024-08-17T02:47:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.368+0000 7f6922600640 1 -- 172.21.15.5:0/3190705752 >> 172.21.15.5:0/3190705752 conn(0x7f691c095a70 msgr2=0x7f691c095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.368+0000 7f6922600640 1 -- 172.21.15.5:0/3190705752 shutdown_connections 2024-08-17T02:47:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.369+0000 7f6922600640 1 -- 172.21.15.5:0/3190705752 wait complete. 2024-08-17T02:47:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.370+0000 7f6922600640 1 Processor -- start 2024-08-17T02:47:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.370+0000 7f6922600640 1 -- start start 2024-08-17T02:47:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.371+0000 7f6922600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6904004020 0x7f691c0b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.371+0000 7f6922600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f691c169830 0x7f691c0cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.371+0000 7f6922600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f691c0cb8c0 0x7f691c148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.371+0000 7f6922600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c0cd630 con 0x7f6904004020 2024-08-17T02:47:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.371+0000 7f6922600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c0b0ae0 con 0x7f691c0cb8c0 2024-08-17T02:47:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.371+0000 7f6922600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691c0b0dc0 con 0x7f691c169830 2024-08-17T02:47:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.371+0000 7f6921200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6904004020 0x7f691c0b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.371+0000 7f6921200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6904004020 0x7f691c0b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59768/0 (socket says 172.21.15.5:59768) 2024-08-17T02:47:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.371+0000 7f6921200640 1 -- 172.21.15.5:0/1508053040 learned_addr learned my addr 172.21.15.5:0/1508053040 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.371+0000 7f6921c00640 1 --2- 172.21.15.5:0/1508053040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f691c0cb8c0 0x7f691c148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.371+0000 7f691be00640 1 --2- 172.21.15.5:0/1508053040 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f691c169830 0x7f691c0cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.371+0000 7f6921200640 1 -- 172.21.15.5:0/1508053040 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f691c169830 msgr2=0x7f691c0cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.371+0000 7f6921200640 1 --2- 172.21.15.5:0/1508053040 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f691c169830 0x7f691c0cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.371+0000 7f6921200640 1 -- 172.21.15.5:0/1508053040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f691c0cb8c0 msgr2=0x7f691c148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.372+0000 7f6921200640 1 --2- 172.21.15.5:0/1508053040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f691c0cb8c0 0x7f691c148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.372+0000 7f6921200640 1 -- 172.21.15.5:0/1508053040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c0b10a0 con 0x7f6904004020 2024-08-17T02:47:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.372+0000 7f6921c00640 1 --2- 172.21.15.5:0/1508053040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f691c0cb8c0 0x7f691c148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.372+0000 7f6921200640 1 --2- 172.21.15.5:0/1508053040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6904004020 0x7f691c0b1b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6910004ad0 tx=0x7f6910001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.372+0000 7f690fe00640 1 -- 172.21.15.5:0/1508053040 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69100014d0 con 0x7f6904004020 2024-08-17T02:47:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.372+0000 7f690fe00640 1 -- 172.21.15.5:0/1508053040 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691000f9c0 con 0x7f6904004020 2024-08-17T02:47:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.372+0000 7f690fe00640 1 -- 172.21.15.5:0/1508053040 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691000fd60 con 0x7f6904004020 2024-08-17T02:47:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.372+0000 7f6922600640 1 -- 172.21.15.5:0/1508053040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691c0b1380 con 0x7f6904004020 2024-08-17T02:47:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.372+0000 7f6922600640 1 -- 172.21.15.5:0/1508053040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691c169ca0 con 0x7f6904004020 2024-08-17T02:47:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.373+0000 7f6922600640 1 -- 172.21.15.5:0/1508053040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f691c0b20c0 con 0x7f6904004020 2024-08-17T02:47:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.374+0000 7f690fe00640 1 -- 172.21.15.5:0/1508053040 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6910013600 con 0x7f6904004020 2024-08-17T02:47:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.375+0000 7f690fe00640 1 --2- 172.21.15.5:0/1508053040 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f68fc065150 0x7f68fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.375+0000 7f690fe00640 1 -- 172.21.15.5:0/1508053040 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f69100826d0 con 0x7f6904004020 2024-08-17T02:47:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.375+0000 7f691be00640 1 --2- 172.21.15.5:0/1508053040 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f68fc065150 0x7f68fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:00.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.376+0000 7f691be00640 1 --2- 172.21.15.5:0/1508053040 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f68fc065150 0x7f68fc067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6908034000 tx=0x7f6908035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:00.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.379+0000 7f690fe00640 1 -- 172.21.15.5:0/1508053040 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f69100506f0 con 0x7f6904004020 2024-08-17T02:47:00.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:00.605+0000 7f6922600640 1 -- 172.21.15.5:0/1508053040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f691c070720 con 0x7f6904004020 2024-08-17T02:47:01.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.189+0000 7f690fe00640 1 -- 172.21.15.5:0/1508053040 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6910053d10 con 0x7f6904004020 2024-08-17T02:47:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.191+0000 7f6922600640 1 -- 172.21.15.5:0/1508053040 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f68fc065150 msgr2=0x7f68fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.191+0000 7f6922600640 1 --2- 172.21.15.5:0/1508053040 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f68fc065150 0x7f68fc067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6908034000 tx=0x7f6908035000 comp rx=0 tx=0).stop 2024-08-17T02:47:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.191+0000 7f6922600640 1 -- 172.21.15.5:0/1508053040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6904004020 msgr2=0x7f691c0b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.191+0000 7f6922600640 1 --2- 172.21.15.5:0/1508053040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6904004020 0x7f691c0b1b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6910004ad0 tx=0x7f6910001dc0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.192+0000 7f6922600640 1 -- 172.21.15.5:0/1508053040 shutdown_connections 2024-08-17T02:47:01.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.192+0000 7f6922600640 1 --2- 172.21.15.5:0/1508053040 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f68fc065150 0x7f68fc067600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.192+0000 7f6922600640 1 --2- 172.21.15.5:0/1508053040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f691c0cb8c0 0x7f691c148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.192+0000 7f6922600640 1 --2- 172.21.15.5:0/1508053040 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f691c169830 0x7f691c0cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.192+0000 7f6922600640 1 --2- 172.21.15.5:0/1508053040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6904004020 0x7f691c0b1b80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.192+0000 7f6922600640 1 -- 172.21.15.5:0/1508053040 >> 172.21.15.5:0/1508053040 conn(0x7f691c095a70 msgr2=0x7f691c0ad680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:01.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.192+0000 7f6922600640 1 -- 172.21.15.5:0/1508053040 shutdown_connections 2024-08-17T02:47:01.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.192+0000 7f6922600640 1 -- 172.21.15.5:0/1508053040 wait complete. 2024-08-17T02:47:01.209 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.360+0000 7efbfea00640 1 Processor -- start 2024-08-17T02:47:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.360+0000 7efbfea00640 1 -- start start 2024-08-17T02:47:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.361+0000 7efbfea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efbf80cadc0 0x7efbf80cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.361+0000 7efbfea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efbf80cca40 0x7efbf80af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.361+0000 7efbfea00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf80cf600 con 0x7efbf8158c90 2024-08-17T02:47:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.361+0000 7efbfea00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf80ce890 con 0x7efbf80cadc0 2024-08-17T02:47:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.361+0000 7efbfea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80cea90 con 0x7efbf80cca40 2024-08-17T02:47:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.361+0000 7efbfcc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efbf80cadc0 0x7efbf80cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.361+0000 7efbfcc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efbf80cadc0 0x7efbf80cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59770/0 (socket says 172.21.15.5:59770) 2024-08-17T02:47:01.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.361+0000 7efbfcc00640 1 -- 172.21.15.5:0/1458726264 learned_addr learned my addr 172.21.15.5:0/1458726264 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:01.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.361+0000 7efbfe000640 1 --2- 172.21.15.5:0/1458726264 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efbf80cca40 0x7efbf80af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.362+0000 7efbfcc00640 1 -- 172.21.15.5:0/1458726264 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efbf80cca40 msgr2=0x7efbf80af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:01.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.362+0000 7efbfcc00640 1 --2- 172.21.15.5:0/1458726264 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efbf80cca40 0x7efbf80af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.362+0000 7efbfcc00640 1 -- 172.21.15.5:0/1458726264 >> v1:172.21.15.107:6789/0 conn(0x7efbf8158c90 legacy=0x7efbf80ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.362+0000 7efbfcc00640 1 -- 172.21.15.5:0/1458726264 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf80ced30 con 0x7efbf80cadc0 2024-08-17T02:47:01.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.362+0000 7efbfe000640 1 --2- 172.21.15.5:0/1458726264 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efbf80cca40 0x7efbf80af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:01.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.363+0000 7efbfcc00640 1 --2- 172.21.15.5:0/1458726264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efbf80cadc0 0x7efbf80cc500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efbe4009910 tx=0x7efbe40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7adfca6e8948d5b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.363+0000 7efbf7e00640 1 -- 172.21.15.5:0/1458726264 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe402ae40 con 0x7efbf80cadc0 2024-08-17T02:47:01.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.363+0000 7efbf7e00640 1 -- 172.21.15.5:0/1458726264 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe4032440 con 0x7efbf80cadc0 2024-08-17T02:47:01.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.363+0000 7efbf7e00640 1 -- 172.21.15.5:0/1458726264 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe4032820 con 0x7efbf80cadc0 2024-08-17T02:47:01.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.363+0000 7efbfea00640 1 -- 172.21.15.5:0/1458726264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efbf80cadc0 msgr2=0x7efbf80cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.363+0000 7efbfea00640 1 --2- 172.21.15.5:0/1458726264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efbf80cadc0 0x7efbf80cc500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efbe4009910 tx=0x7efbe40091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.364+0000 7efbfea00640 1 -- 172.21.15.5:0/1458726264 shutdown_connections 2024-08-17T02:47:01.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.364+0000 7efbfea00640 1 --2- 172.21.15.5:0/1458726264 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efbf80cca40 0x7efbf80af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.364+0000 7efbfea00640 1 --2- 172.21.15.5:0/1458726264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efbf80cadc0 0x7efbf80cc500 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.364+0000 7efbfea00640 1 -- 172.21.15.5:0/1458726264 >> 172.21.15.5:0/1458726264 conn(0x7efbf8087a80 msgr2=0x7efbf806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:01.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.364+0000 7efbfea00640 1 -- 172.21.15.5:0/1458726264 shutdown_connections 2024-08-17T02:47:01.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.364+0000 7efbfea00640 1 -- 172.21.15.5:0/1458726264 wait complete. 2024-08-17T02:47:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.365+0000 7efbfea00640 1 Processor -- start 2024-08-17T02:47:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.365+0000 7efbfea00640 1 -- start start 2024-08-17T02:47:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.366+0000 7efbfea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efbf80cadc0 0x7efbf8152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.366+0000 7efbfea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efbf80cca40 0x7efbf80c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.366+0000 7efbfea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efbf8158c90 0x7efbf8159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.366+0000 7efbfea00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80c7dd0 con 0x7efbf8158c90 2024-08-17T02:47:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.366+0000 7efbfea00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80c71c0 con 0x7efbf80cadc0 2024-08-17T02:47:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.366+0000 7efbfea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80c74a0 con 0x7efbf80cca40 2024-08-17T02:47:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.366+0000 7efbfe000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efbf8158c90 0x7efbf8159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.366+0000 7efbfe000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efbf8158c90 0x7efbf8159300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59782/0 (socket says 172.21.15.5:59782) 2024-08-17T02:47:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.366+0000 7efbfe000640 1 -- 172.21.15.5:0/2942046728 learned_addr learned my addr 172.21.15.5:0/2942046728 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:01.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.366+0000 7efbfcc00640 1 --2- 172.21.15.5:0/2942046728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efbf80cca40 0x7efbf80c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.366+0000 7efbfd600640 1 --2- 172.21.15.5:0/2942046728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efbf80cadc0 0x7efbf8152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.366+0000 7efbfe000640 1 -- 172.21.15.5:0/2942046728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efbf80cca40 msgr2=0x7efbf80c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.366+0000 7efbfe000640 1 --2- 172.21.15.5:0/2942046728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efbf80cca40 0x7efbf80c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.367+0000 7efbfe000640 1 -- 172.21.15.5:0/2942046728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efbf80cadc0 msgr2=0x7efbf8152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.367+0000 7efbfe000640 1 --2- 172.21.15.5:0/2942046728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efbf80cadc0 0x7efbf8152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.367+0000 7efbfe000640 1 -- 172.21.15.5:0/2942046728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe4009450 con 0x7efbf8158c90 2024-08-17T02:47:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.367+0000 7efbfd600640 1 --2- 172.21.15.5:0/2942046728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efbf80cadc0 0x7efbf8152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.367+0000 7efbfe000640 1 --2- 172.21.15.5:0/2942046728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efbf8158c90 0x7efbf8159300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efbf000d180 tx=0x7efbf0009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.367+0000 7efbf4c00640 1 -- 172.21.15.5:0/2942046728 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0015440 con 0x7efbf8158c90 2024-08-17T02:47:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.367+0000 7efbf4c00640 1 -- 172.21.15.5:0/2942046728 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf000f040 con 0x7efbf8158c90 2024-08-17T02:47:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.367+0000 7efbf4c00640 1 -- 172.21.15.5:0/2942046728 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0015810 con 0x7efbf8158c90 2024-08-17T02:47:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.367+0000 7efbfea00640 1 -- 172.21.15.5:0/2942046728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf80c7780 con 0x7efbf8158c90 2024-08-17T02:47:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.367+0000 7efbfea00640 1 -- 172.21.15.5:0/2942046728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf81526c0 con 0x7efbf8158c90 2024-08-17T02:47:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.368+0000 7efbfea00640 1 -- 172.21.15.5:0/2942046728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf80c7f40 con 0x7efbf8158c90 2024-08-17T02:47:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.369+0000 7efbf4c00640 1 -- 172.21.15.5:0/2942046728 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efbf001e3b0 con 0x7efbf8158c90 2024-08-17T02:47:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.370+0000 7efbf4c00640 1 --2- 172.21.15.5:0/2942046728 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efbd8065150 0x7efbd8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.370+0000 7efbf4c00640 1 -- 172.21.15.5:0/2942046728 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efbf0082f00 con 0x7efbf8158c90 2024-08-17T02:47:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.370+0000 7efbfd600640 1 --2- 172.21.15.5:0/2942046728 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efbd8065150 0x7efbd8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.371+0000 7efbfd600640 1 --2- 172.21.15.5:0/2942046728 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efbd8065150 0x7efbd8067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efbec001780 tx=0x7efbec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.373+0000 7efbf4c00640 1 -- 172.21.15.5:0/2942046728 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efbf0050fd0 con 0x7efbf8158c90 2024-08-17T02:47:01.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.598+0000 7efbfea00640 1 -- 172.21.15.5:0/2942046728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efbf8070720 con 0x7efbf8158c90 2024-08-17T02:47:01.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.598+0000 7efbf4c00640 1 -- 172.21.15.5:0/2942046728 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4591 (secure 0 0 0) 0x7efbf00545f0 con 0x7efbf8158c90 2024-08-17T02:47:01.600 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:01.600 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/3624354828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3624354828},{"type":"v1","addr":"172.21.15.5:6836","nonce":3624354828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2614098803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2614098803},{"type":"v1","addr":"172.21.15.107:6835","nonce":2614098803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1090239725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1090239725},{"type":"v1","addr":"172.21.15.5:6837","nonce":1090239725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:57.590268+0000","modified":"2024-08-17T02:47:01.184380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6834/2631760450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2631760450},{"type":"v1","addr":"172.21.15.107:6834","nonce":2631760450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:47:01.600 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-08-17T02:47:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.601+0000 7efbfea00640 1 -- 172.21.15.5:0/2942046728 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efbd8065150 msgr2=0x7efbd8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.601+0000 7efbfea00640 1 --2- 172.21.15.5:0/2942046728 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efbd8065150 0x7efbd8067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efbec001780 tx=0x7efbec009040 comp rx=0 tx=0).stop 2024-08-17T02:47:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.601+0000 7efbfea00640 1 -- 172.21.15.5:0/2942046728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efbf8158c90 msgr2=0x7efbf8159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.601+0000 7efbfea00640 1 --2- 172.21.15.5:0/2942046728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efbf8158c90 0x7efbf8159300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efbf000d180 tx=0x7efbf0009a50 comp rx=0 tx=0).stop 2024-08-17T02:47:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.601+0000 7efbfea00640 1 -- 172.21.15.5:0/2942046728 shutdown_connections 2024-08-17T02:47:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.601+0000 7efbfea00640 1 --2- 172.21.15.5:0/2942046728 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efbd8065150 0x7efbd8067600 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.601+0000 7efbfea00640 1 --2- 172.21.15.5:0/2942046728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efbf8158c90 0x7efbf8159300 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.601+0000 7efbfea00640 1 --2- 172.21.15.5:0/2942046728 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efbf80cca40 0x7efbf80c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.601+0000 7efbfea00640 1 --2- 172.21.15.5:0/2942046728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efbf80cadc0 0x7efbf8152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.601+0000 7efbfea00640 1 -- 172.21.15.5:0/2942046728 >> 172.21.15.5:0/2942046728 conn(0x7efbf8087a80 msgr2=0x7efbf80c60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:01.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.601+0000 7efbfea00640 1 -- 172.21.15.5:0/2942046728 shutdown_connections 2024-08-17T02:47:01.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.601+0000 7efbfea00640 1 -- 172.21.15.5:0/2942046728 wait complete. 2024-08-17T02:47:01.617 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.768+0000 7fe2d7c00640 1 Processor -- start 2024-08-17T02:47:01.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.768+0000 7fe2d7c00640 1 -- start start 2024-08-17T02:47:01.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.769+0000 7fe2d7c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2d01590b0 0x7fe2d00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.769+0000 7fe2d7c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d00c92b0 con 0x7fe2d00afca0 2024-08-17T02:47:01.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.769+0000 7fe2d7c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d00ad480 con 0x7fe2d00acf10 2024-08-17T02:47:01.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.769+0000 7fe2d7c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d00b0980 con 0x7fe2d01590b0 2024-08-17T02:47:01.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.769+0000 7fe2cfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2d01590b0 0x7fe2d00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.769+0000 7fe2cfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2d01590b0 0x7fe2d00b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59786/0 (socket says 172.21.15.5:59786) 2024-08-17T02:47:01.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.769+0000 7fe2cfe00640 1 -- 172.21.15.5:0/1353312412 learned_addr learned my addr 172.21.15.5:0/1353312412 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:01.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.769+0000 7fe2d5200640 1 --1- 172.21.15.5:0/1353312412 >> v1:172.21.15.5:6789/0 conn(0x7fe2d00afca0 0x7fe2d01589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37038/0 (socket says 172.21.15.5:37038) 2024-08-17T02:47:01.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.770+0000 7fe2cfe00640 1 -- 172.21.15.5:0/1353312412 >> v1:172.21.15.107:6789/0 conn(0x7fe2d00acf10 legacy=0x7fe2d00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.770+0000 7fe2cfe00640 1 -- 172.21.15.5:0/1353312412 >> v1:172.21.15.5:6789/0 conn(0x7fe2d00afca0 legacy=0x7fe2d01589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.770+0000 7fe2cfe00640 1 -- 172.21.15.5:0/1353312412 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d00ad760 con 0x7fe2d01590b0 2024-08-17T02:47:01.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.771+0000 7fe2cfe00640 1 --2- 172.21.15.5:0/1353312412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d01590b0 0x7fe2d00b0070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc009910 tx=0x7fe2bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed1e27b8f92b62d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.771+0000 7fe2cf400640 1 -- 172.21.15.5:0/1353312412 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc032440 con 0x7fe2d01590b0 2024-08-17T02:47:01.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.771+0000 7fe2cf400640 1 -- 172.21.15.5:0/1353312412 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc0325a0 con 0x7fe2d01590b0 2024-08-17T02:47:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.771+0000 7fe2cf400640 1 -- 172.21.15.5:0/1353312412 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc032980 con 0x7fe2d01590b0 2024-08-17T02:47:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.771+0000 7fe2d7c00640 1 -- 172.21.15.5:0/1353312412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d01590b0 msgr2=0x7fe2d00b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.771+0000 7fe2d7c00640 1 --2- 172.21.15.5:0/1353312412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d01590b0 0x7fe2d00b0070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc009910 tx=0x7fe2bc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.772+0000 7fe2d7c00640 1 -- 172.21.15.5:0/1353312412 shutdown_connections 2024-08-17T02:47:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.772+0000 7fe2d7c00640 1 --2- 172.21.15.5:0/1353312412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d01590b0 0x7fe2d00b0070 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.772+0000 7fe2d7c00640 1 -- 172.21.15.5:0/1353312412 >> 172.21.15.5:0/1353312412 conn(0x7fe2d0066e60 msgr2=0x7fe2d0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.772+0000 7fe2d7c00640 1 -- 172.21.15.5:0/1353312412 shutdown_connections 2024-08-17T02:47:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.772+0000 7fe2d7c00640 1 -- 172.21.15.5:0/1353312412 wait complete. 2024-08-17T02:47:01.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.773+0000 7fe2d7c00640 1 Processor -- start 2024-08-17T02:47:01.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.773+0000 7fe2d7c00640 1 -- start start 2024-08-17T02:47:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.774+0000 7fe2d7c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d00acf10 0x7fe2d01550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.774+0000 7fe2d7c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2d00afca0 0x7fe2d0169020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.774+0000 7fe2d7c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2d01590b0 0x7fe2d01534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.774+0000 7fe2d7c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d01555f0 con 0x7fe2d00acf10 2024-08-17T02:47:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.774+0000 7fe2d7c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00c4d70 con 0x7fe2d00afca0 2024-08-17T02:47:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.774+0000 7fe2d7c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0155850 con 0x7fe2d01590b0 2024-08-17T02:47:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.774+0000 7fe2d5200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d00acf10 0x7fe2d01550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.774+0000 7fe2d5200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d00acf10 0x7fe2d01550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59796/0 (socket says 172.21.15.5:59796) 2024-08-17T02:47:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.774+0000 7fe2d5200640 1 -- 172.21.15.5:0/3315165714 learned_addr learned my addr 172.21.15.5:0/3315165714 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.774+0000 7fe2cfe00640 1 --2- 172.21.15.5:0/3315165714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2d00afca0 0x7fe2d0169020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.774+0000 7fe2d5c00640 1 --2- 172.21.15.5:0/3315165714 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2d01590b0 0x7fe2d01534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.775+0000 7fe2d5200640 1 -- 172.21.15.5:0/3315165714 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2d01590b0 msgr2=0x7fe2d01534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.775+0000 7fe2d5200640 1 --2- 172.21.15.5:0/3315165714 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2d01590b0 0x7fe2d01534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.775+0000 7fe2d5200640 1 -- 172.21.15.5:0/3315165714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2d00afca0 msgr2=0x7fe2d0169020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.775+0000 7fe2d5200640 1 --2- 172.21.15.5:0/3315165714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2d00afca0 0x7fe2d0169020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.775+0000 7fe2d5200640 1 -- 172.21.15.5:0/3315165714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc009450 con 0x7fe2d00acf10 2024-08-17T02:47:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.775+0000 7fe2d5200640 1 --2- 172.21.15.5:0/3315165714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d00acf10 0x7fe2d01550b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400c590 tx=0x7fe2c4007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.775+0000 7fe2c3e00640 1 -- 172.21.15.5:0/3315165714 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4007300 con 0x7fe2d00acf10 2024-08-17T02:47:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.775+0000 7fe2c3e00640 1 -- 172.21.15.5:0/3315165714 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c40074a0 con 0x7fe2d00acf10 2024-08-17T02:47:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.775+0000 7fe2c3e00640 1 -- 172.21.15.5:0/3315165714 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c40047a0 con 0x7fe2d00acf10 2024-08-17T02:47:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.775+0000 7fe2d7c00640 1 -- 172.21.15.5:0/3315165714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d0155b30 con 0x7fe2d00acf10 2024-08-17T02:47:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.775+0000 7fe2d7c00640 1 -- 172.21.15.5:0/3315165714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d0169560 con 0x7fe2d00acf10 2024-08-17T02:47:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.776+0000 7fe2d7c00640 1 -- 172.21.15.5:0/3315165714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d0063fb0 con 0x7fe2d00acf10 2024-08-17T02:47:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.777+0000 7fe2c3e00640 1 -- 172.21.15.5:0/3315165714 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe2c4004bd0 con 0x7fe2d00acf10 2024-08-17T02:47:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.778+0000 7fe2c3e00640 1 --2- 172.21.15.5:0/3315165714 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe2b0065150 0x7fe2b0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.778+0000 7fe2c3e00640 1 -- 172.21.15.5:0/3315165714 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2c4081430 con 0x7fe2d00acf10 2024-08-17T02:47:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.778+0000 7fe2cfe00640 1 --2- 172.21.15.5:0/3315165714 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe2b0065150 0x7fe2b0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.779+0000 7fe2cfe00640 1 --2- 172.21.15.5:0/3315165714 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe2b0065150 0x7fe2b0067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc034000 tx=0x7fe2bc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.782+0000 7fe2c3e00640 1 -- 172.21.15.5:0/3315165714 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe2c404be40 con 0x7fe2d00acf10 2024-08-17T02:47:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.965+0000 7fe2d7c00640 1 -- 172.21.15.5:0/3315165714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2d00c4ee0 con 0x7fe2d00acf10 2024-08-17T02:47:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.966+0000 7fe2c3e00640 1 -- 172.21.15.5:0/3315165714 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fe2c4053010 con 0x7fe2d00acf10 2024-08-17T02:47:01.969 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:01.969 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:59.170637+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:55.543347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:56.571235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.969+0000 7fe2d7c00640 1 -- 172.21.15.5:0/3315165714 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe2b0065150 msgr2=0x7fe2b0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.969+0000 7fe2d7c00640 1 --2- 172.21.15.5:0/3315165714 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe2b0065150 0x7fe2b0067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc034000 tx=0x7fe2bc032000 comp rx=0 tx=0).stop 2024-08-17T02:47:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.969+0000 7fe2d7c00640 1 -- 172.21.15.5:0/3315165714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d00acf10 msgr2=0x7fe2d01550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.969+0000 7fe2d7c00640 1 --2- 172.21.15.5:0/3315165714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d00acf10 0x7fe2d01550b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400c590 tx=0x7fe2c4007ee0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.969+0000 7fe2d7c00640 1 -- 172.21.15.5:0/3315165714 shutdown_connections 2024-08-17T02:47:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.969+0000 7fe2d7c00640 1 --2- 172.21.15.5:0/3315165714 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe2b0065150 0x7fe2b0067600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.969+0000 7fe2d7c00640 1 --2- 172.21.15.5:0/3315165714 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2d01590b0 0x7fe2d01534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.969+0000 7fe2d7c00640 1 --2- 172.21.15.5:0/3315165714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2d00afca0 0x7fe2d0169020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.969+0000 7fe2d7c00640 1 --2- 172.21.15.5:0/3315165714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d00acf10 0x7fe2d01550b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.969+0000 7fe2d7c00640 1 -- 172.21.15.5:0/3315165714 >> 172.21.15.5:0/3315165714 conn(0x7fe2d0066e60 msgr2=0x7fe2d00cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.969+0000 7fe2d7c00640 1 -- 172.21.15.5:0/3315165714 shutdown_connections 2024-08-17T02:47:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:01.969+0000 7fe2d7c00640 1 -- 172.21.15.5:0/3315165714 wait complete. 2024-08-17T02:47:01.986 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:47:01.986 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:47:02.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.136+0000 7efd5d200640 1 Processor -- start 2024-08-17T02:47:02.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.136+0000 7efd5d200640 1 -- start start 2024-08-17T02:47:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.137+0000 7efd5d200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd580cadc0 0x7efd580cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.137+0000 7efd5d200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efd580cca40 0x7efd580af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.137+0000 7efd5d200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd580cf600 con 0x7efd58158c90 2024-08-17T02:47:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.137+0000 7efd5d200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd580ce890 con 0x7efd580cca40 2024-08-17T02:47:02.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.137+0000 7efd5d200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd580cea90 con 0x7efd580cadc0 2024-08-17T02:47:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.137+0000 7efd57e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efd580cca40 0x7efd580af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.137+0000 7efd57e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efd580cca40 0x7efd580af8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59800/0 (socket says 172.21.15.5:59800) 2024-08-17T02:47:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.137+0000 7efd57e00640 1 -- 172.21.15.5:0/3733805373 learned_addr learned my addr 172.21.15.5:0/3733805373 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.137+0000 7efd4ea00640 1 --2- 172.21.15.5:0/3733805373 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd580cadc0 0x7efd580cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.138+0000 7efd57e00640 1 -- 172.21.15.5:0/3733805373 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd580cadc0 msgr2=0x7efd580cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.138+0000 7efd57e00640 1 --2- 172.21.15.5:0/3733805373 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd580cadc0 0x7efd580cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.138+0000 7efd57e00640 1 -- 172.21.15.5:0/3733805373 >> v1:172.21.15.107:6789/0 conn(0x7efd58158c90 legacy=0x7efd580ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.138+0000 7efd57e00640 1 -- 172.21.15.5:0/3733805373 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd580ced30 con 0x7efd580cca40 2024-08-17T02:47:02.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.139+0000 7efd57e00640 1 --2- 172.21.15.5:0/3733805373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd580cca40 0x7efd580af8d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efd50009f20 tx=0x7efd50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9cf26a7f6e5827 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.139+0000 7efd56a00640 1 -- 172.21.15.5:0/3733805373 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd50031400 con 0x7efd580cca40 2024-08-17T02:47:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.139+0000 7efd56a00640 1 -- 172.21.15.5:0/3733805373 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5002d050 con 0x7efd580cca40 2024-08-17T02:47:02.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.139+0000 7efd56a00640 1 -- 172.21.15.5:0/3733805373 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500317d0 con 0x7efd580cca40 2024-08-17T02:47:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.139+0000 7efd5d200640 1 -- 172.21.15.5:0/3733805373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd580cca40 msgr2=0x7efd580af8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.139+0000 7efd5d200640 1 --2- 172.21.15.5:0/3733805373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd580cca40 0x7efd580af8d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efd50009f20 tx=0x7efd50009840 comp rx=0 tx=0).stop 2024-08-17T02:47:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.139+0000 7efd5d200640 1 -- 172.21.15.5:0/3733805373 shutdown_connections 2024-08-17T02:47:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.139+0000 7efd5d200640 1 --2- 172.21.15.5:0/3733805373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd580cca40 0x7efd580af8d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.139+0000 7efd5d200640 1 --2- 172.21.15.5:0/3733805373 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd580cadc0 0x7efd580cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.139+0000 7efd5d200640 1 -- 172.21.15.5:0/3733805373 >> 172.21.15.5:0/3733805373 conn(0x7efd58087a80 msgr2=0x7efd5806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.140+0000 7efd5d200640 1 -- 172.21.15.5:0/3733805373 shutdown_connections 2024-08-17T02:47:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.140+0000 7efd5d200640 1 -- 172.21.15.5:0/3733805373 wait complete. 2024-08-17T02:47:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.141+0000 7efd5d200640 1 Processor -- start 2024-08-17T02:47:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.141+0000 7efd5d200640 1 -- start start 2024-08-17T02:47:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.142+0000 7efd5d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd580cadc0 0x7efd58159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.142+0000 7efd5d200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd580cca40 0x7efd5814ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.142+0000 7efd5d200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd58158c90 0x7efd580cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.142+0000 7efd5d200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd580b2940 con 0x7efd580cadc0 2024-08-17T02:47:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.142+0000 7efd5d200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd580c7640 con 0x7efd58158c90 2024-08-17T02:47:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.142+0000 7efd5d200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd580c84a0 con 0x7efd580cca40 2024-08-17T02:47:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.142+0000 7efd57400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd580cadc0 0x7efd58159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.142+0000 7efd57400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd580cadc0 0x7efd58159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59802/0 (socket says 172.21.15.5:59802) 2024-08-17T02:47:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.142+0000 7efd57400640 1 -- 172.21.15.5:0/3462592436 learned_addr learned my addr 172.21.15.5:0/3462592436 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.142+0000 7efd57e00640 1 --2- 172.21.15.5:0/3462592436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd58158c90 0x7efd580cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.142+0000 7efd4ea00640 1 --2- 172.21.15.5:0/3462592436 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd580cca40 0x7efd5814ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.143+0000 7efd57400640 1 -- 172.21.15.5:0/3462592436 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd580cca40 msgr2=0x7efd5814ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.143+0000 7efd57400640 1 --2- 172.21.15.5:0/3462592436 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd580cca40 0x7efd5814ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.143+0000 7efd57400640 1 -- 172.21.15.5:0/3462592436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd58158c90 msgr2=0x7efd580cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.143+0000 7efd57400640 1 --2- 172.21.15.5:0/3462592436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd58158c90 0x7efd580cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.143+0000 7efd57400640 1 -- 172.21.15.5:0/3462592436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd50009ae0 con 0x7efd580cadc0 2024-08-17T02:47:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.143+0000 7efd57400640 1 --2- 172.21.15.5:0/3462592436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd580cadc0 0x7efd58159ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd4800c4c0 tx=0x7efd48007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.143+0000 7efd4f400640 1 -- 172.21.15.5:0/3462592436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48011590 con 0x7efd580cadc0 2024-08-17T02:47:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.143+0000 7efd4f400640 1 -- 172.21.15.5:0/3462592436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd48011710 con 0x7efd580cadc0 2024-08-17T02:47:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.143+0000 7efd4f400640 1 -- 172.21.15.5:0/3462592436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48011ad0 con 0x7efd580cadc0 2024-08-17T02:47:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.143+0000 7efd5d200640 1 -- 172.21.15.5:0/3462592436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd580c7890 con 0x7efd580cadc0 2024-08-17T02:47:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.143+0000 7efd5d200640 1 -- 172.21.15.5:0/3462592436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd580c7e50 con 0x7efd580cadc0 2024-08-17T02:47:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.144+0000 7efd5d200640 1 -- 172.21.15.5:0/3462592436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd58070720 con 0x7efd580cadc0 2024-08-17T02:47:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.145+0000 7efd4f400640 1 -- 172.21.15.5:0/3462592436 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efd4801b3b0 con 0x7efd580cadc0 2024-08-17T02:47:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.146+0000 7efd4f400640 1 --2- 172.21.15.5:0/3462592436 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efd34065150 0x7efd34067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.146+0000 7efd4f400640 1 -- 172.21.15.5:0/3462592436 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd48081900 con 0x7efd580cadc0 2024-08-17T02:47:02.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.147+0000 7efd4ea00640 1 --2- 172.21.15.5:0/3462592436 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efd34065150 0x7efd34067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.147+0000 7efd4ea00640 1 --2- 172.21.15.5:0/3462592436 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efd34065150 0x7efd34067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd580aeef0 tx=0x7efd40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.150+0000 7efd4f400640 1 -- 172.21.15.5:0/3462592436 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efd4804f9d0 con 0x7efd580cadc0 2024-08-17T02:47:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.331+0000 7efd5d200640 1 -- 172.21.15.5:0/3462592436 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd581558e0 con 0x7efd34065150 2024-08-17T02:47:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.338+0000 7efd4f400640 1 -- 172.21.15.5:0/3462592436 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249859 (secure 0 0 0) 0x7efd581558e0 con 0x7efd34065150 2024-08-17T02:47:02.343 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:02.344 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:47:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.342+0000 7efd5d200640 1 -- 172.21.15.5:0/3462592436 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efd34065150 msgr2=0x7efd34067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.342+0000 7efd5d200640 1 --2- 172.21.15.5:0/3462592436 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efd34065150 0x7efd34067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd580aeef0 tx=0x7efd40008040 comp rx=0 tx=0).stop 2024-08-17T02:47:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.342+0000 7efd5d200640 1 -- 172.21.15.5:0/3462592436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd580cadc0 msgr2=0x7efd58159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.342+0000 7efd5d200640 1 --2- 172.21.15.5:0/3462592436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd580cadc0 0x7efd58159ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd4800c4c0 tx=0x7efd48007ef0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.342+0000 7efd5d200640 1 -- 172.21.15.5:0/3462592436 shutdown_connections 2024-08-17T02:47:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.342+0000 7efd5d200640 1 --2- 172.21.15.5:0/3462592436 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efd34065150 0x7efd34067600 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.342+0000 7efd5d200640 1 --2- 172.21.15.5:0/3462592436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd58158c90 0x7efd580cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.342+0000 7efd5d200640 1 --2- 172.21.15.5:0/3462592436 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd580cca40 0x7efd5814ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.342+0000 7efd5d200640 1 --2- 172.21.15.5:0/3462592436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd580cadc0 0x7efd58159ab0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.342+0000 7efd5d200640 1 -- 172.21.15.5:0/3462592436 >> 172.21.15.5:0/3462592436 conn(0x7efd58087a80 msgr2=0x7efd58154da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.342+0000 7efd5d200640 1 -- 172.21.15.5:0/3462592436 shutdown_connections 2024-08-17T02:47:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.343+0000 7efd5d200640 1 -- 172.21.15.5:0/3462592436 wait complete. 2024-08-17T02:47:02.359 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-08-17T02:47:01.054073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2398012,"kb_used_data":2376,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576708,"statfs":{"total":773094113280,"available":770638548992,"internally_reserved":0,"allocated":2433024,"data_stored":1545016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.910928"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-08-17T02:46:50.273678+0000","last_change":"2024-08-17T02:46:48.424689+0000","last_active":"2024-08-17T02:46:50.273678+0000","last_peered":"2024-08-17T02:46:50.273678+0000","last_clean":"2024-08-17T02:46:50.273678+0000","last_became_active":"2024-08-17T02:46:48.423437+0000","last_became_peered":"2024-08-17T02:46:48.423437+0000","last_unstale":"2024-08-17T02:46:50.273678+0000","last_undegraded":"2024-08-17T02:46:50.273678+0000","last_fullsized":"2024-08-17T02:46:50.273678+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.106569+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:50.533980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":749568,"data_stored":635903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297512,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297512,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297512,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301668,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070172,"statfs":{"total":96636764160,"available":96327856128,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301676,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070164,"statfs":{"total":96636764160,"available":96327847936,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301676,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070164,"statfs":{"total":96636764160,"available":96327847936,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302372,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069468,"statfs":{"total":96636764160,"available":96327135232,"internally_reserved":0,"allocated":749568,"data_stored":635903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:47:02.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:47:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.551+0000 7f01aa600640 1 Processor -- start 2024-08-17T02:47:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.551+0000 7f01aa600640 1 -- start start 2024-08-17T02:47:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.552+0000 7f01aa600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01a40aea20 0x7f01a40aee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.552+0000 7f01aa600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f01a40ca8e0 0x7f01a40cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.552+0000 7f01aa600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a40af370 con 0x7f01a4158b90 2024-08-17T02:47:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.552+0000 7f01aa600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a40afd20 con 0x7f01a40ca8e0 2024-08-17T02:47:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.552+0000 7f01aa600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40affe0 con 0x7f01a40aea20 2024-08-17T02:47:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.552+0000 7f01a3400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f01a4158b90 0x7f01a40b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37042/0 (socket says 172.21.15.5:37042) 2024-08-17T02:47:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.552+0000 7f01a3400640 1 -- 172.21.15.5:0/3077669613 learned_addr learned my addr 172.21.15.5:0/3077669613 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2a00640 1 --2- 172.21.15.5:0/3077669613 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01a40aea20 0x7f01a40aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2000640 1 -- 172.21.15.5:0/3077669613 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023573858 0 0) 0x7f01a40af370 con 0x7f01a4158b90 2024-08-17T02:47:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a3e00640 1 --2- 172.21.15.5:0/3077669613 >> v2:172.21.15.107:3300/0 conn(0x7f01a40ca8e0 0x7f01a40cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2000640 1 -- 172.21.15.5:0/3077669613 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01880034e0 con 0x7f01a4158b90 2024-08-17T02:47:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2000640 1 -- 172.21.15.5:0/3077669613 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2552371848 0 0) 0x7f01880034e0 con 0x7f01a4158b90 2024-08-17T02:47:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2000640 1 -- 172.21.15.5:0/3077669613 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01a40aea20 msgr2=0x7f01a40aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2000640 1 --2- 172.21.15.5:0/3077669613 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01a40aea20 0x7f01a40aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2000640 1 -- 172.21.15.5:0/3077669613 >> v2:172.21.15.107:3300/0 conn(0x7f01a40ca8e0 msgr2=0x7f01a40cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2000640 1 --2- 172.21.15.5:0/3077669613 >> v2:172.21.15.107:3300/0 conn(0x7f01a40ca8e0 0x7f01a40cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2000640 1 -- 172.21.15.5:0/3077669613 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a40b02c0 con 0x7f01a4158b90 2024-08-17T02:47:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2000640 1 -- 172.21.15.5:0/3077669613 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7f0194001470 con 0x7f01a4158b90 2024-08-17T02:47:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2000640 1 -- 172.21.15.5:0/3077669613 >> v1:172.21.15.5:6789/0 conn(0x7f01a4158b90 legacy=0x7f01a40b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2000640 1 --2- 172.21.15.5:0/3077669613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0188003a50 0x7f0188003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2000640 1 --2- 172.21.15.5:0/3077669613 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01a40aea20 0x7f0188004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2000640 1 --2- 172.21.15.5:0/3077669613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0188004cc0 0x7f0188005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2000640 1 -- 172.21.15.5:0/3077669613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40afd20 con 0x7f0188003a50 2024-08-17T02:47:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2000640 1 -- 172.21.15.5:0/3077669613 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40affe0 con 0x7f0188004cc0 2024-08-17T02:47:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a2000640 1 -- 172.21.15.5:0/3077669613 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018800bab0 con 0x7f01a40aea20 2024-08-17T02:47:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.553+0000 7f01a3400640 1 --2- 172.21.15.5:0/3077669613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0188003a50 0x7f0188003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.554+0000 7f01a2a00640 1 --2- 172.21.15.5:0/3077669613 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01a40aea20 0x7f0188004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.554+0000 7f01a3e00640 1 --2- 172.21.15.5:0/3077669613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0188004cc0 0x7f0188005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.554+0000 7f01a3400640 1 -- 172.21.15.5:0/3077669613 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01a40aea20 msgr2=0x7f0188004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.554+0000 7f01a3400640 1 --2- 172.21.15.5:0/3077669613 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01a40aea20 0x7f0188004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.554+0000 7f01a3400640 1 -- 172.21.15.5:0/3077669613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0188004cc0 msgr2=0x7f0188005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.554+0000 7f01a3400640 1 --2- 172.21.15.5:0/3077669613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0188004cc0 0x7f0188005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.554+0000 7f01a3400640 1 -- 172.21.15.5:0/3077669613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880034e0 con 0x7f0188003a50 2024-08-17T02:47:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.555+0000 7f01a3400640 1 --2- 172.21.15.5:0/3077669613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0188003a50 0x7f0188003e60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f019400c210 tx=0x7f0194001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ba6eefd6aa4403 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.555+0000 7f01a2000640 1 -- 172.21.15.5:0/3077669613 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194005890 con 0x7f0188003a50 2024-08-17T02:47:02.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.555+0000 7f01a2000640 1 -- 172.21.15.5:0/3077669613 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019402d070 con 0x7f0188003a50 2024-08-17T02:47:02.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.555+0000 7f01a2000640 1 -- 172.21.15.5:0/3077669613 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194005a50 con 0x7f0188003a50 2024-08-17T02:47:02.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.556+0000 7f01aa600640 1 -- 172.21.15.5:0/3077669613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0188003a50 msgr2=0x7f0188003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.556+0000 7f01aa600640 1 --2- 172.21.15.5:0/3077669613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0188003a50 0x7f0188003e60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f019400c210 tx=0x7f0194001dc0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.556+0000 7f01a3e00640 1 -- 172.21.15.5:0/3077669613 reap_dead start 2024-08-17T02:47:02.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.556+0000 7f01aa600640 1 -- 172.21.15.5:0/3077669613 shutdown_connections 2024-08-17T02:47:02.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.556+0000 7f01aa600640 1 -- 172.21.15.5:0/3077669613 >> 172.21.15.5:0/3077669613 conn(0x7f01a406e590 msgr2=0x7f01a406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:02.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.556+0000 7f01aa600640 1 -- 172.21.15.5:0/3077669613 shutdown_connections 2024-08-17T02:47:02.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.556+0000 7f01aa600640 1 -- 172.21.15.5:0/3077669613 wait complete. 2024-08-17T02:47:02.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.557+0000 7f01aa600640 1 Processor -- start 2024-08-17T02:47:02.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.557+0000 7f01aa600640 1 -- start start 2024-08-17T02:47:02.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.558+0000 7f01aa600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0188003a50 0x7f01a41583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.558+0000 7f01aa600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40c9340 0x7f01a40c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.558+0000 7f01aa600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01a415a9a0 0x7f01a415ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.558+0000 7f01aa600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40c8800 con 0x7f01a40c9340 2024-08-17T02:47:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.558+0000 7f01aa600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a4168cb0 con 0x7f01a415a9a0 2024-08-17T02:47:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.558+0000 7f01aa600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a41588f0 con 0x7f0188003a50 2024-08-17T02:47:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.558+0000 7f01a2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40c9340 0x7f01a40c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.559+0000 7f01a2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40c9340 0x7f01a40c76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59822/0 (socket says 172.21.15.5:59822) 2024-08-17T02:47:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.559+0000 7f01a2a00640 1 -- 172.21.15.5:0/1113055671 learned_addr learned my addr 172.21.15.5:0/1113055671 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.559+0000 7f01a3400640 1 --2- 172.21.15.5:0/1113055671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0188003a50 0x7f01a41583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.559+0000 7f01a3e00640 1 --2- 172.21.15.5:0/1113055671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01a415a9a0 0x7f01a415ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.559+0000 7f01a2a00640 1 -- 172.21.15.5:0/1113055671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0188003a50 msgr2=0x7f01a41583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.559+0000 7f01a2a00640 1 --2- 172.21.15.5:0/1113055671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0188003a50 0x7f01a41583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.559+0000 7f01a2a00640 1 -- 172.21.15.5:0/1113055671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01a415a9a0 msgr2=0x7f01a415ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.559+0000 7f01a2a00640 1 --2- 172.21.15.5:0/1113055671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01a415a9a0 0x7f01a415ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.559+0000 7f01a2a00640 1 -- 172.21.15.5:0/1113055671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a415b350 con 0x7f01a40c9340 2024-08-17T02:47:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.559+0000 7f01a3e00640 1 --2- 172.21.15.5:0/1113055671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01a415a9a0 0x7f01a415ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.559+0000 7f01a3400640 1 --2- 172.21.15.5:0/1113055671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0188003a50 0x7f01a41583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.559+0000 7f01a2a00640 1 --2- 172.21.15.5:0/1113055671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40c9340 0x7f01a40c76e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0190011b40 tx=0x7f01900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.559+0000 7f019aa00640 1 -- 172.21.15.5:0/1113055671 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000faa0 con 0x7f01a40c9340 2024-08-17T02:47:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.559+0000 7f019aa00640 1 -- 172.21.15.5:0/1113055671 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019000fc00 con 0x7f01a40c9340 2024-08-17T02:47:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.559+0000 7f01aa600640 1 -- 172.21.15.5:0/1113055671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a4168f30 con 0x7f01a40c9340 2024-08-17T02:47:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.559+0000 7f019aa00640 1 -- 172.21.15.5:0/1113055671 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190014440 con 0x7f01a40c9340 2024-08-17T02:47:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.560+0000 7f01aa600640 1 -- 172.21.15.5:0/1113055671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a40c8240 con 0x7f01a40c9340 2024-08-17T02:47:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.561+0000 7f01aa600640 1 -- 172.21.15.5:0/1113055671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a41690c0 con 0x7f01a40c9340 2024-08-17T02:47:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.561+0000 7f019aa00640 1 -- 172.21.15.5:0/1113055671 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f01900147f0 con 0x7f01a40c9340 2024-08-17T02:47:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.562+0000 7f019aa00640 1 --2- 172.21.15.5:0/1113055671 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0184065180 0x7f0184067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.562+0000 7f019aa00640 1 -- 172.21.15.5:0/1113055671 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0190018030 con 0x7f01a40c9340 2024-08-17T02:47:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.562+0000 7f01a3400640 1 --2- 172.21.15.5:0/1113055671 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0184065180 0x7f0184067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.563+0000 7f01a3400640 1 --2- 172.21.15.5:0/1113055671 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0184065180 0x7f0184067630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0194032000 tx=0x7f0194030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.566+0000 7f019aa00640 1 -- 172.21.15.5:0/1113055671 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0190054a10 con 0x7f01a40c9340 2024-08-17T02:47:02.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.747+0000 7f01aa600640 1 -- 172.21.15.5:0/1113055671 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01a4063fb0 con 0x7f0184065180 2024-08-17T02:47:02.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.754+0000 7f019aa00640 1 -- 172.21.15.5:0/1113055671 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249859 (secure 0 0 0) 0x7f01a4063fb0 con 0x7f0184065180 2024-08-17T02:47:02.758 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:02.759 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:47:02.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.758+0000 7f01aa600640 1 -- 172.21.15.5:0/1113055671 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0184065180 msgr2=0x7f0184067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.758+0000 7f01aa600640 1 --2- 172.21.15.5:0/1113055671 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0184065180 0x7f0184067630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0194032000 tx=0x7f0194030000 comp rx=0 tx=0).stop 2024-08-17T02:47:02.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.758+0000 7f01aa600640 1 -- 172.21.15.5:0/1113055671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40c9340 msgr2=0x7f01a40c76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.758+0000 7f01aa600640 1 --2- 172.21.15.5:0/1113055671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40c9340 0x7f01a40c76e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0190011b40 tx=0x7f01900090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.758+0000 7f01aa600640 1 -- 172.21.15.5:0/1113055671 shutdown_connections 2024-08-17T02:47:02.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.758+0000 7f01aa600640 1 --2- 172.21.15.5:0/1113055671 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0184065180 0x7f0184067630 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.758+0000 7f01aa600640 1 --2- 172.21.15.5:0/1113055671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01a415a9a0 0x7f01a415ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.758+0000 7f01aa600640 1 --2- 172.21.15.5:0/1113055671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01a40c9340 0x7f01a40c76e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.758+0000 7f01aa600640 1 --2- 172.21.15.5:0/1113055671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0188003a50 0x7f01a41583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.758+0000 7f01aa600640 1 -- 172.21.15.5:0/1113055671 >> 172.21.15.5:0/1113055671 conn(0x7f01a406e590 msgr2=0x7f01a40cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:02.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.758+0000 7f01aa600640 1 -- 172.21.15.5:0/1113055671 shutdown_connections 2024-08-17T02:47:02.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.758+0000 7f01aa600640 1 -- 172.21.15.5:0/1113055671 wait complete. 2024-08-17T02:47:02.774 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-08-17T02:47:01.054073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2398012,"kb_used_data":2376,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576708,"statfs":{"total":773094113280,"available":770638548992,"internally_reserved":0,"allocated":2433024,"data_stored":1545016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.910928"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-08-17T02:46:50.273678+0000","last_change":"2024-08-17T02:46:48.424689+0000","last_active":"2024-08-17T02:46:50.273678+0000","last_peered":"2024-08-17T02:46:50.273678+0000","last_clean":"2024-08-17T02:46:50.273678+0000","last_became_active":"2024-08-17T02:46:48.423437+0000","last_became_peered":"2024-08-17T02:46:48.423437+0000","last_unstale":"2024-08-17T02:46:50.273678+0000","last_undegraded":"2024-08-17T02:46:50.273678+0000","last_fullsized":"2024-08-17T02:46:50.273678+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.106569+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:50.533980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:57.149489+0000","last_change":"2024-08-17T02:46:57.149489+0000","last_active":"2024-08-17T02:46:57.149489+0000","last_peered":"2024-08-17T02:46:57.149489+0000","last_clean":"2024-08-17T02:46:57.149489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:57.149489+0000","last_undegraded":"2024-08-17T02:46:57.149489+0000","last_fullsized":"2024-08-17T02:46:57.149489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:46:56.139845+0000","last_change":"2024-08-17T02:46:56.139845+0000","last_active":"2024-08-17T02:46:56.139845+0000","last_peered":"2024-08-17T02:46:56.139845+0000","last_clean":"2024-08-17T02:46:56.139845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:46:56.139845+0000","last_undegraded":"2024-08-17T02:46:56.139845+0000","last_fullsized":"2024-08-17T02:46:56.139845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":749568,"data_stored":635903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297512,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297512,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297512,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301668,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070172,"statfs":{"total":96636764160,"available":96327856128,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301676,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070164,"statfs":{"total":96636764160,"available":96327847936,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301676,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070164,"statfs":{"total":96636764160,"available":96327847936,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302372,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069468,"statfs":{"total":96636764160,"available":96327135232,"internally_reserved":0,"allocated":749568,"data_stored":635903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:47:02.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:47:02.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.963+0000 7fafd8e00640 1 Processor -- start 2024-08-17T02:47:02.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.963+0000 7fafd8e00640 1 -- start start 2024-08-17T02:47:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.964+0000 7fafd8e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fafd41590b0 0x7fafd40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.964+0000 7fafd8e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fafd40acf10 0x7fafd4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.964+0000 7fafd8e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd415a4e0 con 0x7fafd40afca0 2024-08-17T02:47:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.964+0000 7fafd8e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd40b0980 con 0x7fafd41590b0 2024-08-17T02:47:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.964+0000 7fafd8e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd40c92b0 con 0x7fafd40acf10 2024-08-17T02:47:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.964+0000 7fafd1400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fafd41590b0 0x7fafd40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.965+0000 7fafd1400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fafd41590b0 0x7fafd40b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59830/0 (socket says 172.21.15.5:59830) 2024-08-17T02:47:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.964+0000 7fafd1e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fafd40afca0 0x7fafd41589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37058/0 (socket says 172.21.15.5:37058) 2024-08-17T02:47:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.965+0000 7fafd1400640 1 -- 172.21.15.5:0/3833404171 learned_addr learned my addr 172.21.15.5:0/3833404171 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.965+0000 7fafd2800640 1 --2- 172.21.15.5:0/3833404171 >> v2:172.21.15.107:3300/0 conn(0x7fafd40acf10 0x7fafd4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.965+0000 7fafd1400640 1 -- 172.21.15.5:0/3833404171 >> v2:172.21.15.107:3300/0 conn(0x7fafd40acf10 msgr2=0x7fafd4159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.965+0000 7fafd1400640 1 --2- 172.21.15.5:0/3833404171 >> v2:172.21.15.107:3300/0 conn(0x7fafd40acf10 0x7fafd4159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.965+0000 7fafd1400640 1 -- 172.21.15.5:0/3833404171 >> v1:172.21.15.5:6789/0 conn(0x7fafd40afca0 legacy=0x7fafd41589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.965+0000 7fafd1400640 1 -- 172.21.15.5:0/3833404171 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd40ad480 con 0x7fafd41590b0 2024-08-17T02:47:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.965+0000 7fafd0a00640 1 -- 172.21.15.5:0/3833404171 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872023869 0 0) 0x7fafc4001110 con 0x7fafd40afca0 2024-08-17T02:47:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.965+0000 7fafd2800640 1 --2- 172.21.15.5:0/3833404171 >> v2:172.21.15.107:3300/0 conn(0x7fafd40acf10 0x7fafd4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.966+0000 7fafd1400640 1 --2- 172.21.15.5:0/3833404171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd41590b0 0x7fafd40b0070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fafd40cb4a0 tx=0x7fafc00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e842762525aed612 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.966+0000 7fafd0a00640 1 -- 172.21.15.5:0/3833404171 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc002ae80 con 0x7fafd41590b0 2024-08-17T02:47:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.966+0000 7fafd0a00640 1 -- 172.21.15.5:0/3833404171 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc0032440 con 0x7fafd41590b0 2024-08-17T02:47:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.966+0000 7fafd0a00640 1 -- 172.21.15.5:0/3833404171 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00327c0 con 0x7fafd41590b0 2024-08-17T02:47:02.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.967+0000 7fafd8e00640 1 -- 172.21.15.5:0/3833404171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd41590b0 msgr2=0x7fafd40b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.967+0000 7fafd8e00640 1 --2- 172.21.15.5:0/3833404171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd41590b0 0x7fafd40b0070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fafd40cb4a0 tx=0x7fafc00091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.967+0000 7fafd8e00640 1 -- 172.21.15.5:0/3833404171 shutdown_connections 2024-08-17T02:47:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.967+0000 7fafd8e00640 1 --2- 172.21.15.5:0/3833404171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd41590b0 0x7fafd40b0070 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.967+0000 7fafd8e00640 1 --2- 172.21.15.5:0/3833404171 >> v2:172.21.15.107:3300/0 conn(0x7fafd40acf10 0x7fafd4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.967+0000 7fafd8e00640 1 -- 172.21.15.5:0/3833404171 >> 172.21.15.5:0/3833404171 conn(0x7fafd4066e60 msgr2=0x7fafd4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.967+0000 7fafd8e00640 1 -- 172.21.15.5:0/3833404171 shutdown_connections 2024-08-17T02:47:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.967+0000 7fafd8e00640 1 -- 172.21.15.5:0/3833404171 wait complete. 2024-08-17T02:47:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.968+0000 7fafd8e00640 1 Processor -- start 2024-08-17T02:47:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.968+0000 7fafd8e00640 1 -- start start 2024-08-17T02:47:02.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.969+0000 7fafd8e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafd40acf10 0x7fafd416bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.969+0000 7fafd8e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafd40afca0 0x7fafd4152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.969+0000 7fafd8e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd41590b0 0x7fafd41533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.969+0000 7fafd8e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd416c410 con 0x7fafd41590b0 2024-08-17T02:47:02.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.969+0000 7fafd8e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd40c16f0 con 0x7fafd40acf10 2024-08-17T02:47:02.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.969+0000 7fafd8e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd4157640 con 0x7fafd40afca0 2024-08-17T02:47:02.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.970+0000 7fafd2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd41590b0 0x7fafd41533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.970+0000 7fafd2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd41590b0 0x7fafd41533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59834/0 (socket says 172.21.15.5:59834) 2024-08-17T02:47:02.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.970+0000 7fafd2800640 1 -- 172.21.15.5:0/3146972550 learned_addr learned my addr 172.21.15.5:0/3146972550 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:02.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.970+0000 7fafd1e00640 1 --2- 172.21.15.5:0/3146972550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafd40acf10 0x7fafd416bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.970+0000 7fafd1400640 1 --2- 172.21.15.5:0/3146972550 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafd40afca0 0x7fafd4152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.970+0000 7fafd2800640 1 -- 172.21.15.5:0/3146972550 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafd40afca0 msgr2=0x7fafd4152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.970+0000 7fafd2800640 1 --2- 172.21.15.5:0/3146972550 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafd40afca0 0x7fafd4152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.970+0000 7fafd2800640 1 -- 172.21.15.5:0/3146972550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafd40acf10 msgr2=0x7fafd416bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.970+0000 7fafd2800640 1 --2- 172.21.15.5:0/3146972550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafd40acf10 0x7fafd416bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.970+0000 7fafd2800640 1 -- 172.21.15.5:0/3146972550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc0009450 con 0x7fafd41590b0 2024-08-17T02:47:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.970+0000 7fafd2800640 1 --2- 172.21.15.5:0/3146972550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd41590b0 0x7fafd41533a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00cef0 tx=0x7fafcc007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.970+0000 7fafc9600640 1 -- 172.21.15.5:0/3146972550 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc016420 con 0x7fafd41590b0 2024-08-17T02:47:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.971+0000 7fafc9600640 1 -- 172.21.15.5:0/3146972550 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc0165a0 con 0x7fafd41590b0 2024-08-17T02:47:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.971+0000 7fafc9600640 1 -- 172.21.15.5:0/3146972550 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc016960 con 0x7fafd41590b0 2024-08-17T02:47:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.971+0000 7fafd8e00640 1 -- 172.21.15.5:0/3146972550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd4157920 con 0x7fafd41590b0 2024-08-17T02:47:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.971+0000 7fafd8e00640 1 -- 172.21.15.5:0/3146972550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd4157300 con 0x7fafd41590b0 2024-08-17T02:47:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.972+0000 7fafd8e00640 1 -- 172.21.15.5:0/3146972550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd4063fb0 con 0x7fafd41590b0 2024-08-17T02:47:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.972+0000 7fafc9600640 1 -- 172.21.15.5:0/3146972550 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fafcc00e3f0 con 0x7fafd41590b0 2024-08-17T02:47:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.973+0000 7fafc9600640 1 --2- 172.21.15.5:0/3146972550 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fafb4065150 0x7fafb4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.973+0000 7fafc9600640 1 -- 172.21.15.5:0/3146972550 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fafcc012070 con 0x7fafd41590b0 2024-08-17T02:47:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.973+0000 7fafd1e00640 1 --2- 172.21.15.5:0/3146972550 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fafb4065150 0x7fafb4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.974+0000 7fafd1e00640 1 --2- 172.21.15.5:0/3146972550 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fafb4065150 0x7fafb4067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fafc4007fd0 tx=0x7fafc4007b00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:02.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:02.977+0000 7fafc9600640 1 -- 172.21.15.5:0/3146972550 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fafcc04ee40 con 0x7fafd41590b0 2024-08-17T02:47:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.157+0000 7fafd8e00640 1 -- 172.21.15.5:0/3146972550 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fafd4067b70 con 0x7fafb4065150 2024-08-17T02:47:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.164+0000 7fafc9600640 1 -- 172.21.15.5:0/3146972550 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264637 (secure 0 0 0) 0x7fafd4067b70 con 0x7fafb4065150 2024-08-17T02:47:03.169 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:47:03.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.168+0000 7fafd8e00640 1 -- 172.21.15.5:0/3146972550 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fafb4065150 msgr2=0x7fafb4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.168+0000 7fafd8e00640 1 --2- 172.21.15.5:0/3146972550 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fafb4065150 0x7fafb4067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fafc4007fd0 tx=0x7fafc4007b00 comp rx=0 tx=0).stop 2024-08-17T02:47:03.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.168+0000 7fafd8e00640 1 -- 172.21.15.5:0/3146972550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd41590b0 msgr2=0x7fafd41533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.168+0000 7fafd8e00640 1 --2- 172.21.15.5:0/3146972550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd41590b0 0x7fafd41533a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00cef0 tx=0x7fafcc007860 comp rx=0 tx=0).stop 2024-08-17T02:47:03.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.168+0000 7fafd8e00640 1 -- 172.21.15.5:0/3146972550 shutdown_connections 2024-08-17T02:47:03.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.168+0000 7fafd8e00640 1 --2- 172.21.15.5:0/3146972550 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fafb4065150 0x7fafb4067600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.168+0000 7fafd8e00640 1 --2- 172.21.15.5:0/3146972550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd41590b0 0x7fafd41533a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.168+0000 7fafd8e00640 1 --2- 172.21.15.5:0/3146972550 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fafd40afca0 0x7fafd4152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.168+0000 7fafd8e00640 1 --2- 172.21.15.5:0/3146972550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafd40acf10 0x7fafd416bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.168+0000 7fafd8e00640 1 -- 172.21.15.5:0/3146972550 >> 172.21.15.5:0/3146972550 conn(0x7fafd4066e60 msgr2=0x7fafd4151440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:03.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.168+0000 7fafd8e00640 1 -- 172.21.15.5:0/3146972550 shutdown_connections 2024-08-17T02:47:03.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.168+0000 7fafd8e00640 1 -- 172.21.15.5:0/3146972550 wait complete. 2024-08-17T02:47:03.185 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-17T02:47:03.054381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398352,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576368,"statfs":{"total":773094113280,"available":770638200832,"internally_reserved":0,"allocated":2891776,"data_stored":1750644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001128"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200708+0000","last_change":"2024-08-17T02:46:58.194762+0000","last_active":"2024-08-17T02:46:58.200708+0000","last_peered":"2024-08-17T02:46:58.200708+0000","last_clean":"2024-08-17T02:46:58.200708+0000","last_became_active":"2024-08-17T02:46:58.194202+0000","last_became_peered":"2024-08-17T02:46:58.194202+0000","last_unstale":"2024-08-17T02:46:58.200708+0000","last_undegraded":"2024-08-17T02:46:58.200708+0000","last_fullsized":"2024-08-17T02:46:58.200708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:32.670412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192679+0000","last_change":"2024-08-17T02:46:58.187726+0000","last_active":"2024-08-17T02:46:58.192679+0000","last_peered":"2024-08-17T02:46:58.192679+0000","last_clean":"2024-08-17T02:46:58.192679+0000","last_became_active":"2024-08-17T02:46:58.186807+0000","last_became_peered":"2024-08-17T02:46:58.186807+0000","last_unstale":"2024-08-17T02:46:58.192679+0000","last_undegraded":"2024-08-17T02:46:58.192679+0000","last_fullsized":"2024-08-17T02:46:58.192679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.186858+0000","last_change":"2024-08-17T02:46:58.185460+0000","last_active":"2024-08-17T02:46:58.186858+0000","last_peered":"2024-08-17T02:46:58.186858+0000","last_clean":"2024-08-17T02:46:58.186858+0000","last_became_active":"2024-08-17T02:46:58.185174+0000","last_became_peered":"2024-08-17T02:46:58.185174+0000","last_unstale":"2024-08-17T02:46:58.186858+0000","last_undegraded":"2024-08-17T02:46:58.186858+0000","last_fullsized":"2024-08-17T02:46:58.186858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:38.127688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204315+0000","last_change":"2024-08-17T02:46:58.199149+0000","last_active":"2024-08-17T02:46:58.204315+0000","last_peered":"2024-08-17T02:46:58.204315+0000","last_clean":"2024-08-17T02:46:58.204315+0000","last_became_active":"2024-08-17T02:46:58.198846+0000","last_became_peered":"2024-08-17T02:46:58.198846+0000","last_unstale":"2024-08-17T02:46:58.204315+0000","last_undegraded":"2024-08-17T02:46:58.204315+0000","last_fullsized":"2024-08-17T02:46:58.204315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:32.670412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205421+0000","last_change":"2024-08-17T02:46:58.202653+0000","last_active":"2024-08-17T02:46:58.205421+0000","last_peered":"2024-08-17T02:46:58.205421+0000","last_clean":"2024-08-17T02:46:58.205421+0000","last_became_active":"2024-08-17T02:46:58.202358+0000","last_became_peered":"2024-08-17T02:46:58.202358+0000","last_unstale":"2024-08-17T02:46:58.205421+0000","last_undegraded":"2024-08-17T02:46:58.205421+0000","last_fullsized":"2024-08-17T02:46:58.205421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199883+0000","last_change":"2024-08-17T02:46:58.181154+0000","last_active":"2024-08-17T02:46:58.199883+0000","last_peered":"2024-08-17T02:46:58.199883+0000","last_clean":"2024-08-17T02:46:58.199883+0000","last_became_active":"2024-08-17T02:46:58.180861+0000","last_became_peered":"2024-08-17T02:46:58.180861+0000","last_unstale":"2024-08-17T02:46:58.199883+0000","last_undegraded":"2024-08-17T02:46:58.199883+0000","last_fullsized":"2024-08-17T02:46:58.199883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:27:30.743267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193720+0000","last_change":"2024-08-17T02:46:58.190386+0000","last_active":"2024-08-17T02:46:58.193720+0000","last_peered":"2024-08-17T02:46:58.193720+0000","last_clean":"2024-08-17T02:46:58.193720+0000","last_became_active":"2024-08-17T02:46:58.189738+0000","last_became_peered":"2024-08-17T02:46:58.189738+0000","last_unstale":"2024-08-17T02:46:58.193720+0000","last_undegraded":"2024-08-17T02:46:58.193720+0000","last_fullsized":"2024-08-17T02:46:58.193720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:15.650114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190737+0000","last_change":"2024-08-17T02:46:58.182527+0000","last_active":"2024-08-17T02:46:58.190737+0000","last_peered":"2024-08-17T02:46:58.190737+0000","last_clean":"2024-08-17T02:46:58.190737+0000","last_became_active":"2024-08-17T02:46:58.182258+0000","last_became_peered":"2024-08-17T02:46:58.182258+0000","last_unstale":"2024-08-17T02:46:58.190737+0000","last_undegraded":"2024-08-17T02:46:58.190737+0000","last_fullsized":"2024-08-17T02:46:58.190737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:27:30.743267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205404+0000","last_change":"2024-08-17T02:46:58.201855+0000","last_active":"2024-08-17T02:46:58.205404+0000","last_peered":"2024-08-17T02:46:58.205404+0000","last_clean":"2024-08-17T02:46:58.205404+0000","last_became_active":"2024-08-17T02:46:58.201590+0000","last_became_peered":"2024-08-17T02:46:58.201590+0000","last_unstale":"2024-08-17T02:46:58.205404+0000","last_undegraded":"2024-08-17T02:46:58.205404+0000","last_fullsized":"2024-08-17T02:46:58.205404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:13:53.828518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199385+0000","last_change":"2024-08-17T02:46:58.193865+0000","last_active":"2024-08-17T02:46:58.199385+0000","last_peered":"2024-08-17T02:46:58.199385+0000","last_clean":"2024-08-17T02:46:58.199385+0000","last_became_active":"2024-08-17T02:46:58.190621+0000","last_became_peered":"2024-08-17T02:46:58.190621+0000","last_unstale":"2024-08-17T02:46:58.199385+0000","last_undegraded":"2024-08-17T02:46:58.199385+0000","last_fullsized":"2024-08-17T02:46:58.199385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:31.536609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190368+0000","last_change":"2024-08-17T02:46:58.185266+0000","last_active":"2024-08-17T02:46:58.190368+0000","last_peered":"2024-08-17T02:46:58.190368+0000","last_clean":"2024-08-17T02:46:58.190368+0000","last_became_active":"2024-08-17T02:46:58.182572+0000","last_became_peered":"2024-08-17T02:46:58.182572+0000","last_unstale":"2024-08-17T02:46:58.190368+0000","last_undegraded":"2024-08-17T02:46:58.190368+0000","last_fullsized":"2024-08-17T02:46:58.190368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195597+0000","last_change":"2024-08-17T02:46:58.187586+0000","last_active":"2024-08-17T02:46:58.195597+0000","last_peered":"2024-08-17T02:46:58.195597+0000","last_clean":"2024-08-17T02:46:58.195597+0000","last_became_active":"2024-08-17T02:46:58.187335+0000","last_became_peered":"2024-08-17T02:46:58.187335+0000","last_unstale":"2024-08-17T02:46:58.195597+0000","last_undegraded":"2024-08-17T02:46:58.195597+0000","last_fullsized":"2024-08-17T02:46:58.195597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:55.602794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193574+0000","last_change":"2024-08-17T02:46:58.191084+0000","last_active":"2024-08-17T02:46:58.193574+0000","last_peered":"2024-08-17T02:46:58.193574+0000","last_clean":"2024-08-17T02:46:58.193574+0000","last_became_active":"2024-08-17T02:46:58.190785+0000","last_became_peered":"2024-08-17T02:46:58.190785+0000","last_unstale":"2024-08-17T02:46:58.193574+0000","last_undegraded":"2024-08-17T02:46:58.193574+0000","last_fullsized":"2024-08-17T02:46:58.193574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.178552+0000","last_change":"2024-08-17T02:46:58.171881+0000","last_active":"2024-08-17T02:46:58.178552+0000","last_peered":"2024-08-17T02:46:58.178552+0000","last_clean":"2024-08-17T02:46:58.178552+0000","last_became_active":"2024-08-17T02:46:58.171501+0000","last_became_peered":"2024-08-17T02:46:58.171501+0000","last_unstale":"2024-08-17T02:46:58.178552+0000","last_undegraded":"2024-08-17T02:46:58.178552+0000","last_fullsized":"2024-08-17T02:46:58.178552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:33.640796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182891+0000","last_change":"2024-08-17T02:46:58.177768+0000","last_active":"2024-08-17T02:46:58.182891+0000","last_peered":"2024-08-17T02:46:58.182891+0000","last_clean":"2024-08-17T02:46:58.182891+0000","last_became_active":"2024-08-17T02:46:58.177477+0000","last_became_peered":"2024-08-17T02:46:58.177477+0000","last_unstale":"2024-08-17T02:46:58.182891+0000","last_undegraded":"2024-08-17T02:46:58.182891+0000","last_fullsized":"2024-08-17T02:46:58.182891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:31.536609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199278+0000","last_change":"2024-08-17T02:46:58.185626+0000","last_active":"2024-08-17T02:46:58.199278+0000","last_peered":"2024-08-17T02:46:58.199278+0000","last_clean":"2024-08-17T02:46:58.199278+0000","last_became_active":"2024-08-17T02:46:58.185229+0000","last_became_peered":"2024-08-17T02:46:58.185229+0000","last_unstale":"2024-08-17T02:46:58.199278+0000","last_undegraded":"2024-08-17T02:46:58.199278+0000","last_fullsized":"2024-08-17T02:46:58.199278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:05.343969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204193+0000","last_change":"2024-08-17T02:46:58.198656+0000","last_active":"2024-08-17T02:46:58.204193+0000","last_peered":"2024-08-17T02:46:58.204193+0000","last_clean":"2024-08-17T02:46:58.204193+0000","last_became_active":"2024-08-17T02:46:58.198359+0000","last_became_peered":"2024-08-17T02:46:58.198359+0000","last_unstale":"2024-08-17T02:46:58.204193+0000","last_undegraded":"2024-08-17T02:46:58.204193+0000","last_fullsized":"2024-08-17T02:46:58.204193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:11.578823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.201567+0000","last_change":"2024-08-17T02:46:58.199727+0000","last_active":"2024-08-17T02:46:58.201567+0000","last_peered":"2024-08-17T02:46:58.201567+0000","last_clean":"2024-08-17T02:46:58.201567+0000","last_became_active":"2024-08-17T02:46:58.197375+0000","last_became_peered":"2024-08-17T02:46:58.197375+0000","last_unstale":"2024-08-17T02:46:58.201567+0000","last_undegraded":"2024-08-17T02:46:58.201567+0000","last_fullsized":"2024-08-17T02:46:58.201567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:23.710551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205376+0000","last_change":"2024-08-17T02:46:58.201834+0000","last_active":"2024-08-17T02:46:58.205376+0000","last_peered":"2024-08-17T02:46:58.205376+0000","last_clean":"2024-08-17T02:46:58.205376+0000","last_became_active":"2024-08-17T02:46:58.201441+0000","last_became_peered":"2024-08-17T02:46:58.201441+0000","last_unstale":"2024-08-17T02:46:58.205376+0000","last_undegraded":"2024-08-17T02:46:58.205376+0000","last_fullsized":"2024-08-17T02:46:58.205376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:27:30.743267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.186476+0000","last_change":"2024-08-17T02:46:58.183993+0000","last_active":"2024-08-17T02:46:58.186476+0000","last_peered":"2024-08-17T02:46:58.186476+0000","last_clean":"2024-08-17T02:46:58.186476+0000","last_became_active":"2024-08-17T02:46:58.183062+0000","last_became_peered":"2024-08-17T02:46:58.183062+0000","last_unstale":"2024-08-17T02:46:58.186476+0000","last_undegraded":"2024-08-17T02:46:58.186476+0000","last_fullsized":"2024-08-17T02:46:58.186476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182024+0000","last_change":"2024-08-17T02:46:58.179197+0000","last_active":"2024-08-17T02:46:58.182024+0000","last_peered":"2024-08-17T02:46:58.182024+0000","last_clean":"2024-08-17T02:46:58.182024+0000","last_became_active":"2024-08-17T02:46:58.178943+0000","last_became_peered":"2024-08-17T02:46:58.178943+0000","last_unstale":"2024-08-17T02:46:58.182024+0000","last_undegraded":"2024-08-17T02:46:58.182024+0000","last_fullsized":"2024-08-17T02:46:58.182024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:28.627999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200146+0000","last_change":"2024-08-17T02:46:58.193621+0000","last_active":"2024-08-17T02:46:58.200146+0000","last_peered":"2024-08-17T02:46:58.200146+0000","last_clean":"2024-08-17T02:46:58.200146+0000","last_became_active":"2024-08-17T02:46:58.193367+0000","last_became_peered":"2024-08-17T02:46:58.193367+0000","last_unstale":"2024-08-17T02:46:58.200146+0000","last_undegraded":"2024-08-17T02:46:58.200146+0000","last_fullsized":"2024-08-17T02:46:58.200146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:15.650114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.197851+0000","last_change":"2024-08-17T02:46:58.196187+0000","last_active":"2024-08-17T02:46:58.197851+0000","last_peered":"2024-08-17T02:46:58.197851+0000","last_clean":"2024-08-17T02:46:58.197851+0000","last_became_active":"2024-08-17T02:46:58.195945+0000","last_became_peered":"2024-08-17T02:46:58.195945+0000","last_unstale":"2024-08-17T02:46:58.197851+0000","last_undegraded":"2024-08-17T02:46:58.197851+0000","last_fullsized":"2024-08-17T02:46:58.197851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:33.640796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199480+0000","last_change":"2024-08-17T02:46:58.186302+0000","last_active":"2024-08-17T02:46:58.199480+0000","last_peered":"2024-08-17T02:46:58.199480+0000","last_clean":"2024-08-17T02:46:58.199480+0000","last_became_active":"2024-08-17T02:46:58.185991+0000","last_became_peered":"2024-08-17T02:46:58.185991+0000","last_unstale":"2024-08-17T02:46:58.199480+0000","last_undegraded":"2024-08-17T02:46:58.199480+0000","last_fullsized":"2024-08-17T02:46:58.199480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:27.700709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190838+0000","last_change":"2024-08-17T02:46:58.182905+0000","last_active":"2024-08-17T02:46:58.190838+0000","last_peered":"2024-08-17T02:46:58.190838+0000","last_clean":"2024-08-17T02:46:58.190838+0000","last_became_active":"2024-08-17T02:46:58.180544+0000","last_became_peered":"2024-08-17T02:46:58.180544+0000","last_unstale":"2024-08-17T02:46:58.190838+0000","last_undegraded":"2024-08-17T02:46:58.190838+0000","last_fullsized":"2024-08-17T02:46:58.190838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:34.299927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199367+0000","last_change":"2024-08-17T02:46:58.192607+0000","last_active":"2024-08-17T02:46:58.199367+0000","last_peered":"2024-08-17T02:46:58.199367+0000","last_clean":"2024-08-17T02:46:58.199367+0000","last_became_active":"2024-08-17T02:46:58.192400+0000","last_became_peered":"2024-08-17T02:46:58.192400+0000","last_unstale":"2024-08-17T02:46:58.199367+0000","last_undegraded":"2024-08-17T02:46:58.199367+0000","last_fullsized":"2024-08-17T02:46:58.199367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196626+0000","last_change":"2024-08-17T02:46:58.180251+0000","last_active":"2024-08-17T02:46:58.196626+0000","last_peered":"2024-08-17T02:46:58.196626+0000","last_clean":"2024-08-17T02:46:58.196626+0000","last_became_active":"2024-08-17T02:46:58.179999+0000","last_became_peered":"2024-08-17T02:46:58.179999+0000","last_unstale":"2024-08-17T02:46:58.196626+0000","last_undegraded":"2024-08-17T02:46:58.196626+0000","last_fullsized":"2024-08-17T02:46:58.196626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191065+0000","last_change":"2024-08-17T02:46:58.187641+0000","last_active":"2024-08-17T02:46:58.191065+0000","last_peered":"2024-08-17T02:46:58.191065+0000","last_clean":"2024-08-17T02:46:58.191065+0000","last_became_active":"2024-08-17T02:46:58.183623+0000","last_became_peered":"2024-08-17T02:46:58.183623+0000","last_unstale":"2024-08-17T02:46:58.191065+0000","last_undegraded":"2024-08-17T02:46:58.191065+0000","last_fullsized":"2024-08-17T02:46:58.191065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182583+0000","last_change":"2024-08-17T02:46:58.179841+0000","last_active":"2024-08-17T02:46:58.182583+0000","last_peered":"2024-08-17T02:46:58.182583+0000","last_clean":"2024-08-17T02:46:58.182583+0000","last_became_active":"2024-08-17T02:46:58.179424+0000","last_became_peered":"2024-08-17T02:46:58.179424+0000","last_unstale":"2024-08-17T02:46:58.182583+0000","last_undegraded":"2024-08-17T02:46:58.182583+0000","last_fullsized":"2024-08-17T02:46:58.182583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205064+0000","last_change":"2024-08-17T02:46:58.199295+0000","last_active":"2024-08-17T02:46:58.205064+0000","last_peered":"2024-08-17T02:46:58.205064+0000","last_clean":"2024-08-17T02:46:58.205064+0000","last_became_active":"2024-08-17T02:46:58.198388+0000","last_became_peered":"2024-08-17T02:46:58.198388+0000","last_unstale":"2024-08-17T02:46:58.205064+0000","last_undegraded":"2024-08-17T02:46:58.205064+0000","last_fullsized":"2024-08-17T02:46:58.205064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:20.281407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.189531+0000","last_change":"2024-08-17T02:46:58.185183+0000","last_active":"2024-08-17T02:46:58.189531+0000","last_peered":"2024-08-17T02:46:58.189531+0000","last_clean":"2024-08-17T02:46:58.189531+0000","last_became_active":"2024-08-17T02:46:58.184850+0000","last_became_peered":"2024-08-17T02:46:58.184850+0000","last_unstale":"2024-08-17T02:46:58.189531+0000","last_undegraded":"2024-08-17T02:46:58.189531+0000","last_fullsized":"2024-08-17T02:46:58.189531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:52.596395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192369+0000","last_change":"2024-08-17T02:46:58.187380+0000","last_active":"2024-08-17T02:46:58.192369+0000","last_peered":"2024-08-17T02:46:58.192369+0000","last_clean":"2024-08-17T02:46:58.192369+0000","last_became_active":"2024-08-17T02:46:58.187091+0000","last_became_peered":"2024-08-17T02:46:58.187091+0000","last_unstale":"2024-08-17T02:46:58.192369+0000","last_undegraded":"2024-08-17T02:46:58.192369+0000","last_fullsized":"2024-08-17T02:46:58.192369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:28.627999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.179200+0000","last_change":"2024-08-17T02:46:58.174376+0000","last_active":"2024-08-17T02:46:58.179200+0000","last_peered":"2024-08-17T02:46:58.179200+0000","last_clean":"2024-08-17T02:46:58.179200+0000","last_became_active":"2024-08-17T02:46:58.173432+0000","last_became_peered":"2024-08-17T02:46:58.173432+0000","last_unstale":"2024-08-17T02:46:58.179200+0000","last_undegraded":"2024-08-17T02:46:58.179200+0000","last_fullsized":"2024-08-17T02:46:58.179200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:28.364147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193762+0000","last_change":"2024-08-17T02:46:57.189925+0000","last_active":"2024-08-17T02:46:58.193762+0000","last_peered":"2024-08-17T02:46:58.193762+0000","last_clean":"2024-08-17T02:46:58.193762+0000","last_became_active":"2024-08-17T02:46:57.189656+0000","last_became_peered":"2024-08-17T02:46:57.189656+0000","last_unstale":"2024-08-17T02:46:58.193762+0000","last_undegraded":"2024-08-17T02:46:58.193762+0000","last_fullsized":"2024-08-17T02:46:58.193762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182005+0000","last_change":"2024-08-17T02:46:58.178720+0000","last_active":"2024-08-17T02:46:58.182005+0000","last_peered":"2024-08-17T02:46:58.182005+0000","last_clean":"2024-08-17T02:46:58.182005+0000","last_became_active":"2024-08-17T02:46:58.177772+0000","last_became_peered":"2024-08-17T02:46:58.177772+0000","last_unstale":"2024-08-17T02:46:58.182005+0000","last_undegraded":"2024-08-17T02:46:58.182005+0000","last_fullsized":"2024-08-17T02:46:58.182005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:34.299927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.187850+0000","last_change":"2024-08-17T02:46:57.172726+0000","last_active":"2024-08-17T02:46:58.187850+0000","last_peered":"2024-08-17T02:46:58.187850+0000","last_clean":"2024-08-17T02:46:58.187850+0000","last_became_active":"2024-08-17T02:46:57.172399+0000","last_became_peered":"2024-08-17T02:46:57.172399+0000","last_unstale":"2024-08-17T02:46:58.187850+0000","last_undegraded":"2024-08-17T02:46:58.187850+0000","last_fullsized":"2024-08-17T02:46:58.187850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.171412+0000","last_change":"2024-08-17T02:46:57.183195+0000","last_active":"2024-08-17T02:46:58.171412+0000","last_peered":"2024-08-17T02:46:58.171412+0000","last_clean":"2024-08-17T02:46:58.171412+0000","last_became_active":"2024-08-17T02:46:57.182892+0000","last_became_peered":"2024-08-17T02:46:57.182892+0000","last_unstale":"2024-08-17T02:46:58.171412+0000","last_undegraded":"2024-08-17T02:46:58.171412+0000","last_fullsized":"2024-08-17T02:46:58.171412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:03.559127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190912+0000","last_change":"2024-08-17T02:46:58.186355+0000","last_active":"2024-08-17T02:46:58.190912+0000","last_peered":"2024-08-17T02:46:58.190912+0000","last_clean":"2024-08-17T02:46:58.190912+0000","last_became_active":"2024-08-17T02:46:58.184770+0000","last_became_peered":"2024-08-17T02:46:58.184770+0000","last_unstale":"2024-08-17T02:46:58.190912+0000","last_undegraded":"2024-08-17T02:46:58.190912+0000","last_fullsized":"2024-08-17T02:46:58.190912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.174256+0000","last_change":"2024-08-17T02:46:57.182999+0000","last_active":"2024-08-17T02:46:58.174256+0000","last_peered":"2024-08-17T02:46:58.174256+0000","last_clean":"2024-08-17T02:46:58.174256+0000","last_became_active":"2024-08-17T02:46:57.182704+0000","last_became_peered":"2024-08-17T02:46:57.182704+0000","last_unstale":"2024-08-17T02:46:58.174256+0000","last_undegraded":"2024-08-17T02:46:58.174256+0000","last_fullsized":"2024-08-17T02:46:58.174256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182901+0000","last_change":"2024-08-17T02:46:58.178469+0000","last_active":"2024-08-17T02:46:58.182901+0000","last_peered":"2024-08-17T02:46:58.182901+0000","last_clean":"2024-08-17T02:46:58.182901+0000","last_became_active":"2024-08-17T02:46:58.178131+0000","last_became_peered":"2024-08-17T02:46:58.178131+0000","last_unstale":"2024-08-17T02:46:58.182901+0000","last_undegraded":"2024-08-17T02:46:58.182901+0000","last_fullsized":"2024-08-17T02:46:58.182901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.164211+0000","last_change":"2024-08-17T02:46:57.186233+0000","last_active":"2024-08-17T02:46:58.164211+0000","last_peered":"2024-08-17T02:46:58.164211+0000","last_clean":"2024-08-17T02:46:58.164211+0000","last_became_active":"2024-08-17T02:46:57.185870+0000","last_became_peered":"2024-08-17T02:46:57.185870+0000","last_unstale":"2024-08-17T02:46:58.164211+0000","last_undegraded":"2024-08-17T02:46:58.164211+0000","last_fullsized":"2024-08-17T02:46:58.164211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200162+0000","last_change":"2024-08-17T02:46:58.193886+0000","last_active":"2024-08-17T02:46:58.200162+0000","last_peered":"2024-08-17T02:46:58.200162+0000","last_clean":"2024-08-17T02:46:58.200162+0000","last_became_active":"2024-08-17T02:46:58.193601+0000","last_became_peered":"2024-08-17T02:46:58.193601+0000","last_unstale":"2024-08-17T02:46:58.200162+0000","last_undegraded":"2024-08-17T02:46:58.200162+0000","last_fullsized":"2024-08-17T02:46:58.200162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:36.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.176488+0000","last_change":"2024-08-17T02:46:57.178427+0000","last_active":"2024-08-17T02:46:58.176488+0000","last_peered":"2024-08-17T02:46:58.176488+0000","last_clean":"2024-08-17T02:46:58.176488+0000","last_became_active":"2024-08-17T02:46:57.178055+0000","last_became_peered":"2024-08-17T02:46:57.178055+0000","last_unstale":"2024-08-17T02:46:58.176488+0000","last_undegraded":"2024-08-17T02:46:58.176488+0000","last_fullsized":"2024-08-17T02:46:58.176488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.186843+0000","last_change":"2024-08-17T02:46:58.185244+0000","last_active":"2024-08-17T02:46:58.186843+0000","last_peered":"2024-08-17T02:46:58.186843+0000","last_clean":"2024-08-17T02:46:58.186843+0000","last_became_active":"2024-08-17T02:46:58.184932+0000","last_became_peered":"2024-08-17T02:46:58.184932+0000","last_unstale":"2024-08-17T02:46:58.186843+0000","last_undegraded":"2024-08-17T02:46:58.186843+0000","last_fullsized":"2024-08-17T02:46:58.186843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200246+0000","last_change":"2024-08-17T02:46:57.185013+0000","last_active":"2024-08-17T02:46:58.200246+0000","last_peered":"2024-08-17T02:46:58.200246+0000","last_clean":"2024-08-17T02:46:58.200246+0000","last_became_active":"2024-08-17T02:46:57.184784+0000","last_became_peered":"2024-08-17T02:46:57.184784+0000","last_unstale":"2024-08-17T02:46:58.200246+0000","last_undegraded":"2024-08-17T02:46:58.200246+0000","last_fullsized":"2024-08-17T02:46:58.200246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:22.700908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200848+0000","last_change":"2024-08-17T02:46:58.195407+0000","last_active":"2024-08-17T02:46:58.200848+0000","last_peered":"2024-08-17T02:46:58.200848+0000","last_clean":"2024-08-17T02:46:58.200848+0000","last_became_active":"2024-08-17T02:46:58.195124+0000","last_became_peered":"2024-08-17T02:46:58.195124+0000","last_unstale":"2024-08-17T02:46:58.200848+0000","last_undegraded":"2024-08-17T02:46:58.200848+0000","last_fullsized":"2024-08-17T02:46:58.200848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:52.596395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.202448+0000","last_change":"2024-08-17T02:46:57.187357+0000","last_active":"2024-08-17T02:46:58.202448+0000","last_peered":"2024-08-17T02:46:58.202448+0000","last_clean":"2024-08-17T02:46:58.202448+0000","last_became_active":"2024-08-17T02:46:57.187009+0000","last_became_peered":"2024-08-17T02:46:57.187009+0000","last_unstale":"2024-08-17T02:46:58.202448+0000","last_undegraded":"2024-08-17T02:46:58.202448+0000","last_fullsized":"2024-08-17T02:46:58.202448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.197087+0000","last_change":"2024-08-17T02:46:58.192814+0000","last_active":"2024-08-17T02:46:58.197087+0000","last_peered":"2024-08-17T02:46:58.197087+0000","last_clean":"2024-08-17T02:46:58.197087+0000","last_became_active":"2024-08-17T02:46:58.192555+0000","last_became_peered":"2024-08-17T02:46:58.192555+0000","last_unstale":"2024-08-17T02:46:58.197087+0000","last_undegraded":"2024-08-17T02:46:58.197087+0000","last_fullsized":"2024-08-17T02:46:58.197087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:27.700709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195065+0000","last_change":"2024-08-17T02:46:57.173067+0000","last_active":"2024-08-17T02:46:58.195065+0000","last_peered":"2024-08-17T02:46:58.195065+0000","last_clean":"2024-08-17T02:46:58.195065+0000","last_became_active":"2024-08-17T02:46:57.172758+0000","last_became_peered":"2024-08-17T02:46:57.172758+0000","last_unstale":"2024-08-17T02:46:58.195065+0000","last_undegraded":"2024-08-17T02:46:58.195065+0000","last_fullsized":"2024-08-17T02:46:58.195065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:03.559127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195519+0000","last_change":"2024-08-17T02:46:58.193978+0000","last_active":"2024-08-17T02:46:58.195519+0000","last_peered":"2024-08-17T02:46:58.195519+0000","last_clean":"2024-08-17T02:46:58.195519+0000","last_became_active":"2024-08-17T02:46:58.193769+0000","last_became_peered":"2024-08-17T02:46:58.193769+0000","last_unstale":"2024-08-17T02:46:58.195519+0000","last_undegraded":"2024-08-17T02:46:58.195519+0000","last_fullsized":"2024-08-17T02:46:58.195519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.176328+0000","last_change":"2024-08-17T02:46:57.184989+0000","last_active":"2024-08-17T02:46:58.176328+0000","last_peered":"2024-08-17T02:46:58.176328+0000","last_clean":"2024-08-17T02:46:58.176328+0000","last_became_active":"2024-08-17T02:46:57.184687+0000","last_became_peered":"2024-08-17T02:46:57.184687+0000","last_unstale":"2024-08-17T02:46:58.176328+0000","last_undegraded":"2024-08-17T02:46:58.176328+0000","last_fullsized":"2024-08-17T02:46:58.176328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195058+0000","last_change":"2024-08-17T02:46:58.190873+0000","last_active":"2024-08-17T02:46:58.195058+0000","last_peered":"2024-08-17T02:46:58.195058+0000","last_clean":"2024-08-17T02:46:58.195058+0000","last_became_active":"2024-08-17T02:46:58.190322+0000","last_became_peered":"2024-08-17T02:46:58.190322+0000","last_unstale":"2024-08-17T02:46:58.195058+0000","last_undegraded":"2024-08-17T02:46:58.195058+0000","last_fullsized":"2024-08-17T02:46:58.195058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:05.343969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.164482+0000","last_change":"2024-08-17T02:46:57.180474+0000","last_active":"2024-08-17T02:46:58.164482+0000","last_peered":"2024-08-17T02:46:58.164482+0000","last_clean":"2024-08-17T02:46:58.164482+0000","last_became_active":"2024-08-17T02:46:57.180126+0000","last_became_peered":"2024-08-17T02:46:57.180126+0000","last_unstale":"2024-08-17T02:46:58.164482+0000","last_undegraded":"2024-08-17T02:46:58.164482+0000","last_fullsized":"2024-08-17T02:46:58.164482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192352+0000","last_change":"2024-08-17T02:46:58.187354+0000","last_active":"2024-08-17T02:46:58.192352+0000","last_peered":"2024-08-17T02:46:58.192352+0000","last_clean":"2024-08-17T02:46:58.192352+0000","last_became_active":"2024-08-17T02:46:58.187061+0000","last_became_peered":"2024-08-17T02:46:58.187061+0000","last_unstale":"2024-08-17T02:46:58.192352+0000","last_undegraded":"2024-08-17T02:46:58.192352+0000","last_fullsized":"2024-08-17T02:46:58.192352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:33.640796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204507+0000","last_change":"2024-08-17T02:46:57.173178+0000","last_active":"2024-08-17T02:46:58.204507+0000","last_peered":"2024-08-17T02:46:58.204507+0000","last_clean":"2024-08-17T02:46:58.204507+0000","last_became_active":"2024-08-17T02:46:57.171399+0000","last_became_peered":"2024-08-17T02:46:57.171399+0000","last_unstale":"2024-08-17T02:46:58.204507+0000","last_undegraded":"2024-08-17T02:46:58.204507+0000","last_fullsized":"2024-08-17T02:46:58.204507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200463+0000","last_change":"2024-08-17T02:46:58.195024+0000","last_active":"2024-08-17T02:46:58.200463+0000","last_peered":"2024-08-17T02:46:58.200463+0000","last_clean":"2024-08-17T02:46:58.200463+0000","last_became_active":"2024-08-17T02:46:58.194058+0000","last_became_peered":"2024-08-17T02:46:58.194058+0000","last_unstale":"2024-08-17T02:46:58.200463+0000","last_undegraded":"2024-08-17T02:46:58.200463+0000","last_fullsized":"2024-08-17T02:46:58.200463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:36.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193533+0000","last_change":"2024-08-17T02:46:57.179217+0000","last_active":"2024-08-17T02:46:58.193533+0000","last_peered":"2024-08-17T02:46:58.193533+0000","last_clean":"2024-08-17T02:46:58.193533+0000","last_became_active":"2024-08-17T02:46:57.178894+0000","last_became_peered":"2024-08-17T02:46:57.178894+0000","last_unstale":"2024-08-17T02:46:58.193533+0000","last_undegraded":"2024-08-17T02:46:58.193533+0000","last_fullsized":"2024-08-17T02:46:58.193533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:29:23.466288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200370+0000","last_change":"2024-08-17T02:46:58.195478+0000","last_active":"2024-08-17T02:46:58.200370+0000","last_peered":"2024-08-17T02:46:58.200370+0000","last_clean":"2024-08-17T02:46:58.200370+0000","last_became_active":"2024-08-17T02:46:58.195223+0000","last_became_peered":"2024-08-17T02:46:58.195223+0000","last_unstale":"2024-08-17T02:46:58.200370+0000","last_undegraded":"2024-08-17T02:46:58.200370+0000","last_fullsized":"2024-08-17T02:46:58.200370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:20.281407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.197709+0000","last_change":"2024-08-17T02:46:57.188113+0000","last_active":"2024-08-17T02:46:58.197709+0000","last_peered":"2024-08-17T02:46:58.197709+0000","last_clean":"2024-08-17T02:46:58.197709+0000","last_became_active":"2024-08-17T02:46:57.187801+0000","last_became_peered":"2024-08-17T02:46:57.187801+0000","last_unstale":"2024-08-17T02:46:58.197709+0000","last_undegraded":"2024-08-17T02:46:58.197709+0000","last_fullsized":"2024-08-17T02:46:58.197709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:21.241911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204810+0000","last_change":"2024-08-17T02:46:58.198647+0000","last_active":"2024-08-17T02:46:58.204810+0000","last_peered":"2024-08-17T02:46:58.204810+0000","last_clean":"2024-08-17T02:46:58.204810+0000","last_became_active":"2024-08-17T02:46:58.198406+0000","last_became_peered":"2024-08-17T02:46:58.198406+0000","last_unstale":"2024-08-17T02:46:58.204810+0000","last_undegraded":"2024-08-17T02:46:58.204810+0000","last_fullsized":"2024-08-17T02:46:58.204810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:49.067728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196700+0000","last_change":"2024-08-17T02:46:57.177253+0000","last_active":"2024-08-17T02:46:58.196700+0000","last_peered":"2024-08-17T02:46:58.196700+0000","last_clean":"2024-08-17T02:46:58.196700+0000","last_became_active":"2024-08-17T02:46:57.176994+0000","last_became_peered":"2024-08-17T02:46:57.176994+0000","last_unstale":"2024-08-17T02:46:58.196700+0000","last_undegraded":"2024-08-17T02:46:58.196700+0000","last_fullsized":"2024-08-17T02:46:58.196700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:51.586751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199394+0000","last_change":"2024-08-17T02:46:58.186086+0000","last_active":"2024-08-17T02:46:58.199394+0000","last_peered":"2024-08-17T02:46:58.199394+0000","last_clean":"2024-08-17T02:46:58.199394+0000","last_became_active":"2024-08-17T02:46:58.185889+0000","last_became_peered":"2024-08-17T02:46:58.185889+0000","last_unstale":"2024-08-17T02:46:58.199394+0000","last_undegraded":"2024-08-17T02:46:58.199394+0000","last_fullsized":"2024-08-17T02:46:58.199394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:49.067728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.175925+0000","last_change":"2024-08-17T02:46:57.181595+0000","last_active":"2024-08-17T02:46:58.175925+0000","last_peered":"2024-08-17T02:46:58.175925+0000","last_clean":"2024-08-17T02:46:58.175925+0000","last_became_active":"2024-08-17T02:46:57.181288+0000","last_became_peered":"2024-08-17T02:46:57.181288+0000","last_unstale":"2024-08-17T02:46:58.175925+0000","last_undegraded":"2024-08-17T02:46:58.175925+0000","last_fullsized":"2024-08-17T02:46:58.175925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:03.559127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205392+0000","last_change":"2024-08-17T02:46:58.202092+0000","last_active":"2024-08-17T02:46:58.205392+0000","last_peered":"2024-08-17T02:46:58.205392+0000","last_clean":"2024-08-17T02:46:58.205392+0000","last_became_active":"2024-08-17T02:46:58.201265+0000","last_became_peered":"2024-08-17T02:46:58.201265+0000","last_unstale":"2024-08-17T02:46:58.205392+0000","last_undegraded":"2024-08-17T02:46:58.205392+0000","last_fullsized":"2024-08-17T02:46:58.205392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:57.772457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.170897+0000","last_change":"2024-08-17T02:46:48.424689+0000","last_active":"2024-08-17T02:46:58.170897+0000","last_peered":"2024-08-17T02:46:58.170897+0000","last_clean":"2024-08-17T02:46:58.170897+0000","last_became_active":"2024-08-17T02:46:48.423437+0000","last_became_peered":"2024-08-17T02:46:48.423437+0000","last_unstale":"2024-08-17T02:46:58.170897+0000","last_undegraded":"2024-08-17T02:46:58.170897+0000","last_fullsized":"2024-08-17T02:46:58.170897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.106569+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:50.533980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.168621+0000","last_change":"2024-08-17T02:46:57.171177+0000","last_active":"2024-08-17T02:46:58.168621+0000","last_peered":"2024-08-17T02:46:58.168621+0000","last_clean":"2024-08-17T02:46:58.168621+0000","last_became_active":"2024-08-17T02:46:57.170458+0000","last_became_peered":"2024-08-17T02:46:57.170458+0000","last_unstale":"2024-08-17T02:46:58.168621+0000","last_undegraded":"2024-08-17T02:46:58.168621+0000","last_fullsized":"2024-08-17T02:46:58.168621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196422+0000","last_change":"2024-08-17T02:46:58.195312+0000","last_active":"2024-08-17T02:46:58.196422+0000","last_peered":"2024-08-17T02:46:58.196422+0000","last_clean":"2024-08-17T02:46:58.196422+0000","last_became_active":"2024-08-17T02:46:58.195014+0000","last_became_peered":"2024-08-17T02:46:58.195014+0000","last_unstale":"2024-08-17T02:46:58.196422+0000","last_undegraded":"2024-08-17T02:46:58.196422+0000","last_fullsized":"2024-08-17T02:46:58.196422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:08.556818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.170788+0000","last_change":"2024-08-17T02:46:57.184842+0000","last_active":"2024-08-17T02:46:58.170788+0000","last_peered":"2024-08-17T02:46:58.170788+0000","last_clean":"2024-08-17T02:46:58.170788+0000","last_became_active":"2024-08-17T02:46:57.184291+0000","last_became_peered":"2024-08-17T02:46:57.184291+0000","last_unstale":"2024-08-17T02:46:58.170788+0000","last_undegraded":"2024-08-17T02:46:58.170788+0000","last_fullsized":"2024-08-17T02:46:58.170788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.183117+0000","last_change":"2024-08-17T02:46:58.180783+0000","last_active":"2024-08-17T02:46:58.183117+0000","last_peered":"2024-08-17T02:46:58.183117+0000","last_clean":"2024-08-17T02:46:58.183117+0000","last_became_active":"2024-08-17T02:46:58.174973+0000","last_became_peered":"2024-08-17T02:46:58.174973+0000","last_unstale":"2024-08-17T02:46:58.183117+0000","last_undegraded":"2024-08-17T02:46:58.183117+0000","last_fullsized":"2024-08-17T02:46:58.183117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.176827+0000","last_change":"2024-08-17T02:46:57.184122+0000","last_active":"2024-08-17T02:46:58.176827+0000","last_peered":"2024-08-17T02:46:58.176827+0000","last_clean":"2024-08-17T02:46:58.176827+0000","last_became_active":"2024-08-17T02:46:57.183807+0000","last_became_peered":"2024-08-17T02:46:57.183807+0000","last_unstale":"2024-08-17T02:46:58.176827+0000","last_undegraded":"2024-08-17T02:46:58.176827+0000","last_fullsized":"2024-08-17T02:46:58.176827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.203872+0000","last_change":"2024-08-17T02:46:58.202695+0000","last_active":"2024-08-17T02:46:58.203872+0000","last_peered":"2024-08-17T02:46:58.203872+0000","last_clean":"2024-08-17T02:46:58.203872+0000","last_became_active":"2024-08-17T02:46:58.201153+0000","last_became_peered":"2024-08-17T02:46:58.201153+0000","last_unstale":"2024-08-17T02:46:58.203872+0000","last_undegraded":"2024-08-17T02:46:58.203872+0000","last_fullsized":"2024-08-17T02:46:58.203872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:34.299927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.175573+0000","last_change":"2024-08-17T02:46:57.172754+0000","last_active":"2024-08-17T02:46:58.175573+0000","last_peered":"2024-08-17T02:46:58.175573+0000","last_clean":"2024-08-17T02:46:58.175573+0000","last_became_active":"2024-08-17T02:46:57.172534+0000","last_became_peered":"2024-08-17T02:46:57.172534+0000","last_unstale":"2024-08-17T02:46:58.175573+0000","last_undegraded":"2024-08-17T02:46:58.175573+0000","last_fullsized":"2024-08-17T02:46:58.175573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192797+0000","last_change":"2024-08-17T02:46:58.184673+0000","last_active":"2024-08-17T02:46:58.192797+0000","last_peered":"2024-08-17T02:46:58.192797+0000","last_clean":"2024-08-17T02:46:58.192797+0000","last_became_active":"2024-08-17T02:46:58.184365+0000","last_became_peered":"2024-08-17T02:46:58.184365+0000","last_unstale":"2024-08-17T02:46:58.192797+0000","last_undegraded":"2024-08-17T02:46:58.192797+0000","last_fullsized":"2024-08-17T02:46:58.192797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:18.212612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.165816+0000","last_change":"2024-08-17T02:46:57.172721+0000","last_active":"2024-08-17T02:46:58.165816+0000","last_peered":"2024-08-17T02:46:58.165816+0000","last_clean":"2024-08-17T02:46:58.165816+0000","last_became_active":"2024-08-17T02:46:57.172414+0000","last_became_peered":"2024-08-17T02:46:57.172414+0000","last_unstale":"2024-08-17T02:46:58.165816+0000","last_undegraded":"2024-08-17T02:46:58.165816+0000","last_fullsized":"2024-08-17T02:46:58.165816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204268+0000","last_change":"2024-08-17T02:46:58.199050+0000","last_active":"2024-08-17T02:46:58.204268+0000","last_peered":"2024-08-17T02:46:58.204268+0000","last_clean":"2024-08-17T02:46:58.204268+0000","last_became_active":"2024-08-17T02:46:58.198795+0000","last_became_peered":"2024-08-17T02:46:58.198795+0000","last_unstale":"2024-08-17T02:46:58.204268+0000","last_undegraded":"2024-08-17T02:46:58.204268+0000","last_fullsized":"2024-08-17T02:46:58.204268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.181818+0000","last_change":"2024-08-17T02:46:57.186077+0000","last_active":"2024-08-17T02:46:58.181818+0000","last_peered":"2024-08-17T02:46:58.181818+0000","last_clean":"2024-08-17T02:46:58.181818+0000","last_became_active":"2024-08-17T02:46:57.185671+0000","last_became_peered":"2024-08-17T02:46:57.185671+0000","last_unstale":"2024-08-17T02:46:58.181818+0000","last_undegraded":"2024-08-17T02:46:58.181818+0000","last_fullsized":"2024-08-17T02:46:58.181818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:37.118045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.201382+0000","last_change":"2024-08-17T02:46:58.199398+0000","last_active":"2024-08-17T02:46:58.201382+0000","last_peered":"2024-08-17T02:46:58.201382+0000","last_clean":"2024-08-17T02:46:58.201382+0000","last_became_active":"2024-08-17T02:46:58.199075+0000","last_became_peered":"2024-08-17T02:46:58.199075+0000","last_unstale":"2024-08-17T02:46:58.201382+0000","last_undegraded":"2024-08-17T02:46:58.201382+0000","last_fullsized":"2024-08-17T02:46:58.201382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.166353+0000","last_change":"2024-08-17T02:46:57.175247+0000","last_active":"2024-08-17T02:46:58.166353+0000","last_peered":"2024-08-17T02:46:58.166353+0000","last_clean":"2024-08-17T02:46:58.166353+0000","last_became_active":"2024-08-17T02:46:57.174995+0000","last_became_peered":"2024-08-17T02:46:57.174995+0000","last_unstale":"2024-08-17T02:46:58.166353+0000","last_undegraded":"2024-08-17T02:46:58.166353+0000","last_fullsized":"2024-08-17T02:46:58.166353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195582+0000","last_change":"2024-08-17T02:46:58.194264+0000","last_active":"2024-08-17T02:46:58.195582+0000","last_peered":"2024-08-17T02:46:58.195582+0000","last_clean":"2024-08-17T02:46:58.195582+0000","last_became_active":"2024-08-17T02:46:58.193989+0000","last_became_peered":"2024-08-17T02:46:58.193989+0000","last_unstale":"2024-08-17T02:46:58.195582+0000","last_undegraded":"2024-08-17T02:46:58.195582+0000","last_fullsized":"2024-08-17T02:46:58.195582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:15.650114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193128+0000","last_change":"2024-08-17T02:46:57.183203+0000","last_active":"2024-08-17T02:46:58.193128+0000","last_peered":"2024-08-17T02:46:58.193128+0000","last_clean":"2024-08-17T02:46:58.193128+0000","last_became_active":"2024-08-17T02:46:57.182911+0000","last_became_peered":"2024-08-17T02:46:57.182911+0000","last_unstale":"2024-08-17T02:46:58.193128+0000","last_undegraded":"2024-08-17T02:46:58.193128+0000","last_fullsized":"2024-08-17T02:46:58.193128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.180870+0000","last_change":"2024-08-17T02:46:58.176398+0000","last_active":"2024-08-17T02:46:58.180870+0000","last_peered":"2024-08-17T02:46:58.180870+0000","last_clean":"2024-08-17T02:46:58.180870+0000","last_became_active":"2024-08-17T02:46:58.175994+0000","last_became_peered":"2024-08-17T02:46:58.175994+0000","last_unstale":"2024-08-17T02:46:58.180870+0000","last_undegraded":"2024-08-17T02:46:58.180870+0000","last_fullsized":"2024-08-17T02:46:58.180870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:38.320238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.170599+0000","last_change":"2024-08-17T02:46:57.186114+0000","last_active":"2024-08-17T02:46:58.170599+0000","last_peered":"2024-08-17T02:46:58.170599+0000","last_clean":"2024-08-17T02:46:58.170599+0000","last_became_active":"2024-08-17T02:46:57.185841+0000","last_became_peered":"2024-08-17T02:46:57.185841+0000","last_unstale":"2024-08-17T02:46:58.170599+0000","last_undegraded":"2024-08-17T02:46:58.170599+0000","last_fullsized":"2024-08-17T02:46:58.170599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193621+0000","last_change":"2024-08-17T02:46:58.184905+0000","last_active":"2024-08-17T02:46:58.193621+0000","last_peered":"2024-08-17T02:46:58.193621+0000","last_clean":"2024-08-17T02:46:58.193621+0000","last_became_active":"2024-08-17T02:46:58.184603+0000","last_became_peered":"2024-08-17T02:46:58.184603+0000","last_unstale":"2024-08-17T02:46:58.193621+0000","last_undegraded":"2024-08-17T02:46:58.193621+0000","last_fullsized":"2024-08-17T02:46:58.193621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:38.127688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.163704+0000","last_change":"2024-08-17T02:46:57.172885+0000","last_active":"2024-08-17T02:46:58.163704+0000","last_peered":"2024-08-17T02:46:58.163704+0000","last_clean":"2024-08-17T02:46:58.163704+0000","last_became_active":"2024-08-17T02:46:57.172559+0000","last_became_peered":"2024-08-17T02:46:57.172559+0000","last_unstale":"2024-08-17T02:46:58.163704+0000","last_undegraded":"2024-08-17T02:46:58.163704+0000","last_fullsized":"2024-08-17T02:46:58.163704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.188438+0000","last_change":"2024-08-17T02:46:58.179610+0000","last_active":"2024-08-17T02:46:58.188438+0000","last_peered":"2024-08-17T02:46:58.188438+0000","last_clean":"2024-08-17T02:46:58.188438+0000","last_became_active":"2024-08-17T02:46:58.179261+0000","last_became_peered":"2024-08-17T02:46:58.179261+0000","last_unstale":"2024-08-17T02:46:58.188438+0000","last_undegraded":"2024-08-17T02:46:58.188438+0000","last_fullsized":"2024-08-17T02:46:58.188438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.164164+0000","last_change":"2024-08-17T02:46:57.180623+0000","last_active":"2024-08-17T02:46:58.164164+0000","last_peered":"2024-08-17T02:46:58.164164+0000","last_clean":"2024-08-17T02:46:58.164164+0000","last_became_active":"2024-08-17T02:46:57.180314+0000","last_became_peered":"2024-08-17T02:46:57.180314+0000","last_unstale":"2024-08-17T02:46:58.164164+0000","last_undegraded":"2024-08-17T02:46:58.164164+0000","last_fullsized":"2024-08-17T02:46:58.164164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191197+0000","last_change":"2024-08-17T02:46:58.185876+0000","last_active":"2024-08-17T02:46:58.191197+0000","last_peered":"2024-08-17T02:46:58.191197+0000","last_clean":"2024-08-17T02:46:58.191197+0000","last_became_active":"2024-08-17T02:46:58.184142+0000","last_became_peered":"2024-08-17T02:46:58.184142+0000","last_unstale":"2024-08-17T02:46:58.191197+0000","last_undegraded":"2024-08-17T02:46:58.191197+0000","last_fullsized":"2024-08-17T02:46:58.191197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:28.627999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195140+0000","last_change":"2024-08-17T02:46:57.189083+0000","last_active":"2024-08-17T02:46:58.195140+0000","last_peered":"2024-08-17T02:46:58.195140+0000","last_clean":"2024-08-17T02:46:58.195140+0000","last_became_active":"2024-08-17T02:46:57.188780+0000","last_became_peered":"2024-08-17T02:46:57.188780+0000","last_unstale":"2024-08-17T02:46:58.195140+0000","last_undegraded":"2024-08-17T02:46:58.195140+0000","last_fullsized":"2024-08-17T02:46:58.195140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:51.586751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193431+0000","last_change":"2024-08-17T02:46:58.189014+0000","last_active":"2024-08-17T02:46:58.193431+0000","last_peered":"2024-08-17T02:46:58.193431+0000","last_clean":"2024-08-17T02:46:58.193431+0000","last_became_active":"2024-08-17T02:46:58.187210+0000","last_became_peered":"2024-08-17T02:46:58.187210+0000","last_unstale":"2024-08-17T02:46:58.193431+0000","last_undegraded":"2024-08-17T02:46:58.193431+0000","last_fullsized":"2024-08-17T02:46:58.193431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.198105+0000","last_change":"2024-08-17T02:46:58.184782+0000","last_active":"2024-08-17T02:46:58.198105+0000","last_peered":"2024-08-17T02:46:58.198105+0000","last_clean":"2024-08-17T02:46:58.198105+0000","last_became_active":"2024-08-17T02:46:58.184533+0000","last_became_peered":"2024-08-17T02:46:58.184533+0000","last_unstale":"2024-08-17T02:46:58.198105+0000","last_undegraded":"2024-08-17T02:46:58.198105+0000","last_fullsized":"2024-08-17T02:46:58.198105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.202042+0000","last_change":"2024-08-17T02:46:57.189298+0000","last_active":"2024-08-17T02:46:58.202042+0000","last_peered":"2024-08-17T02:46:58.202042+0000","last_clean":"2024-08-17T02:46:58.202042+0000","last_became_active":"2024-08-17T02:46:57.188971+0000","last_became_peered":"2024-08-17T02:46:57.188971+0000","last_unstale":"2024-08-17T02:46:58.202042+0000","last_undegraded":"2024-08-17T02:46:58.202042+0000","last_fullsized":"2024-08-17T02:46:58.202042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:22.700908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200097+0000","last_change":"2024-08-17T02:46:58.189815+0000","last_active":"2024-08-17T02:46:58.200097+0000","last_peered":"2024-08-17T02:46:58.200097+0000","last_clean":"2024-08-17T02:46:58.200097+0000","last_became_active":"2024-08-17T02:46:58.189556+0000","last_became_peered":"2024-08-17T02:46:58.189556+0000","last_unstale":"2024-08-17T02:46:58.200097+0000","last_undegraded":"2024-08-17T02:46:58.200097+0000","last_fullsized":"2024-08-17T02:46:58.200097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:08.556818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.194232+0000","last_change":"2024-08-17T02:46:57.188201+0000","last_active":"2024-08-17T02:46:58.194232+0000","last_peered":"2024-08-17T02:46:58.194232+0000","last_clean":"2024-08-17T02:46:58.194232+0000","last_became_active":"2024-08-17T02:46:57.187942+0000","last_became_peered":"2024-08-17T02:46:57.187942+0000","last_unstale":"2024-08-17T02:46:58.194232+0000","last_undegraded":"2024-08-17T02:46:58.194232+0000","last_fullsized":"2024-08-17T02:46:58.194232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191573+0000","last_change":"2024-08-17T02:46:58.185979+0000","last_active":"2024-08-17T02:46:58.191573+0000","last_peered":"2024-08-17T02:46:58.191573+0000","last_clean":"2024-08-17T02:46:58.191573+0000","last_became_active":"2024-08-17T02:46:58.185692+0000","last_became_peered":"2024-08-17T02:46:58.185692+0000","last_unstale":"2024-08-17T02:46:58.191573+0000","last_undegraded":"2024-08-17T02:46:58.191573+0000","last_fullsized":"2024-08-17T02:46:58.191573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:31.536609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196531+0000","last_change":"2024-08-17T02:46:57.181312+0000","last_active":"2024-08-17T02:46:58.196531+0000","last_peered":"2024-08-17T02:46:58.196531+0000","last_clean":"2024-08-17T02:46:58.196531+0000","last_became_active":"2024-08-17T02:46:57.181041+0000","last_became_peered":"2024-08-17T02:46:57.181041+0000","last_unstale":"2024-08-17T02:46:58.196531+0000","last_undegraded":"2024-08-17T02:46:58.196531+0000","last_fullsized":"2024-08-17T02:46:58.196531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:21.241911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191018+0000","last_change":"2024-08-17T02:46:58.187913+0000","last_active":"2024-08-17T02:46:58.191018+0000","last_peered":"2024-08-17T02:46:58.191018+0000","last_clean":"2024-08-17T02:46:58.191018+0000","last_became_active":"2024-08-17T02:46:58.187627+0000","last_became_peered":"2024-08-17T02:46:58.187627+0000","last_unstale":"2024-08-17T02:46:58.191018+0000","last_undegraded":"2024-08-17T02:46:58.191018+0000","last_fullsized":"2024-08-17T02:46:58.191018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:11.578823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.194605+0000","last_change":"2024-08-17T02:46:57.183697+0000","last_active":"2024-08-17T02:46:58.194605+0000","last_peered":"2024-08-17T02:46:58.194605+0000","last_clean":"2024-08-17T02:46:58.194605+0000","last_became_active":"2024-08-17T02:46:57.183438+0000","last_became_peered":"2024-08-17T02:46:57.183438+0000","last_unstale":"2024-08-17T02:46:58.194605+0000","last_undegraded":"2024-08-17T02:46:58.194605+0000","last_fullsized":"2024-08-17T02:46:58.194605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:01:09.175011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":802816,"data_stored":661592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301728,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070112,"statfs":{"total":96636764160,"available":96327794688,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301716,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070124,"statfs":{"total":96636764160,"available":96327806976,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301724,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070116,"statfs":{"total":96636764160,"available":96327798784,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302316,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069524,"statfs":{"total":96636764160,"available":96327192576,"internally_reserved":0,"allocated":811008,"data_stored":661648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:47:03.190 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-17T02:47:03.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.374+0000 7f73ffe00640 1 Processor -- start 2024-08-17T02:47:03.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.374+0000 7f73ffe00640 1 -- start start 2024-08-17T02:47:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.375+0000 7f73ffe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73f80cb0d0 0x7f73f8158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.375+0000 7f73ffe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73f80cda30 0x7f73f80cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.375+0000 7f73ffe00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f80af9a0 con 0x7f73f81589e0 2024-08-17T02:47:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.375+0000 7f73ffe00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f80af810 con 0x7f73f80cda30 2024-08-17T02:47:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.375+0000 7f73ffe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80ce740 con 0x7f73f80cb0d0 2024-08-17T02:47:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.375+0000 7f73fde00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73f80cda30 0x7f73f80cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.375+0000 7f73fde00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73f80cda30 0x7f73f80cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59838/0 (socket says 172.21.15.5:59838) 2024-08-17T02:47:03.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.375+0000 7f73fde00640 1 -- 172.21.15.5:0/2164488327 learned_addr learned my addr 172.21.15.5:0/2164488327 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:03.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.376+0000 7f73fca00640 1 --2- 172.21.15.5:0/2164488327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73f80cb0d0 0x7f73f8158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.376+0000 7f73fde00640 1 -- 172.21.15.5:0/2164488327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73f80cb0d0 msgr2=0x7f73f8158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:03.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.376+0000 7f73fde00640 1 --2- 172.21.15.5:0/2164488327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73f80cb0d0 0x7f73f8158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.376+0000 7f73fde00640 1 -- 172.21.15.5:0/2164488327 >> v1:172.21.15.107:6789/0 conn(0x7f73f81589e0 legacy=0x7f73f80ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.376+0000 7f73fde00640 1 -- 172.21.15.5:0/2164488327 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f80cea00 con 0x7f73f80cda30 2024-08-17T02:47:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.377+0000 7f73fde00640 1 --2- 172.21.15.5:0/2164488327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f80cda30 0x7f73f80cdeb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009f20 tx=0x7f73f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9298264dbb975e76 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.377+0000 7f73f7e00640 1 -- 172.21.15.5:0/2164488327 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0031400 con 0x7f73f80cda30 2024-08-17T02:47:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.377+0000 7f73f7e00640 1 -- 172.21.15.5:0/2164488327 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f002d050 con 0x7f73f80cda30 2024-08-17T02:47:03.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.377+0000 7f73f7e00640 1 -- 172.21.15.5:0/2164488327 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00317d0 con 0x7f73f80cda30 2024-08-17T02:47:03.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.378+0000 7f73ffe00640 1 -- 172.21.15.5:0/2164488327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f80cda30 msgr2=0x7f73f80cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.378+0000 7f73ffe00640 1 --2- 172.21.15.5:0/2164488327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f80cda30 0x7f73f80cdeb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009f20 tx=0x7f73f0009840 comp rx=0 tx=0).stop 2024-08-17T02:47:03.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.378+0000 7f73ffe00640 1 -- 172.21.15.5:0/2164488327 shutdown_connections 2024-08-17T02:47:03.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.378+0000 7f73ffe00640 1 --2- 172.21.15.5:0/2164488327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f80cda30 0x7f73f80cdeb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.378+0000 7f73ffe00640 1 --2- 172.21.15.5:0/2164488327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73f80cb0d0 0x7f73f8158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.378+0000 7f73ffe00640 1 -- 172.21.15.5:0/2164488327 >> 172.21.15.5:0/2164488327 conn(0x7f73f806e590 msgr2=0x7f73f806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:03.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.378+0000 7f73ffe00640 1 -- 172.21.15.5:0/2164488327 shutdown_connections 2024-08-17T02:47:03.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.378+0000 7f73ffe00640 1 -- 172.21.15.5:0/2164488327 wait complete. 2024-08-17T02:47:03.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.379+0000 7f73ffe00640 1 Processor -- start 2024-08-17T02:47:03.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.379+0000 7f73ffe00640 1 -- start start 2024-08-17T02:47:03.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.380+0000 7f73ffe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73f80cb0d0 0x7f73f814b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.380+0000 7f73ffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f80cda30 0x7f73f80b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.380+0000 7f73ffe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73f81589e0 0x7f73f8153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.380+0000 7f73ffe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f814b8b0 con 0x7f73f80cda30 2024-08-17T02:47:03.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.380+0000 7f73ffe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80b4c70 con 0x7f73f81589e0 2024-08-17T02:47:03.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.380+0000 7f73ffe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8159810 con 0x7f73f80cb0d0 2024-08-17T02:47:03.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.380+0000 7f73fca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f80cda30 0x7f73f80b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.380+0000 7f73fca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f80cda30 0x7f73f80b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59850/0 (socket says 172.21.15.5:59850) 2024-08-17T02:47:03.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.380+0000 7f73fca00640 1 -- 172.21.15.5:0/427376732 learned_addr learned my addr 172.21.15.5:0/427376732 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:03.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.380+0000 7f73fd400640 1 --2- 172.21.15.5:0/427376732 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73f80cb0d0 0x7f73f814b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.381+0000 7f73fde00640 1 --2- 172.21.15.5:0/427376732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73f81589e0 0x7f73f8153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.381+0000 7f73fca00640 1 -- 172.21.15.5:0/427376732 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73f80cb0d0 msgr2=0x7f73f814b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.381+0000 7f73fca00640 1 --2- 172.21.15.5:0/427376732 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73f80cb0d0 0x7f73f814b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.381+0000 7f73fca00640 1 -- 172.21.15.5:0/427376732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73f81589e0 msgr2=0x7f73f8153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.381+0000 7f73fca00640 1 --2- 172.21.15.5:0/427376732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73f81589e0 0x7f73f8153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.381+0000 7f73fca00640 1 -- 172.21.15.5:0/427376732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f0009ae0 con 0x7f73f80cda30 2024-08-17T02:47:03.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.381+0000 7f73fde00640 1 --2- 172.21.15.5:0/427376732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73f81589e0 0x7f73f8153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:03.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.381+0000 7f73fca00640 1 --2- 172.21.15.5:0/427376732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f80cda30 0x7f73f80b4210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f73e400d8c0 tx=0x7f73e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.381+0000 7f73f4c00640 1 -- 172.21.15.5:0/427376732 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e400de50 con 0x7f73f80cda30 2024-08-17T02:47:03.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.381+0000 7f73f4c00640 1 -- 172.21.15.5:0/427376732 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e40098b0 con 0x7f73f80cda30 2024-08-17T02:47:03.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.381+0000 7f73f4c00640 1 -- 172.21.15.5:0/427376732 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e4009c70 con 0x7f73f80cda30 2024-08-17T02:47:03.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.381+0000 7f73ffe00640 1 -- 172.21.15.5:0/427376732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f8158ee0 con 0x7f73f80cda30 2024-08-17T02:47:03.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.381+0000 7f73ffe00640 1 -- 172.21.15.5:0/427376732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f81594a0 con 0x7f73f80cda30 2024-08-17T02:47:03.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.383+0000 7f73ffe00640 1 -- 172.21.15.5:0/427376732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f8063fb0 con 0x7f73f80cda30 2024-08-17T02:47:03.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.383+0000 7f73f4c00640 1 -- 172.21.15.5:0/427376732 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f73e4014410 con 0x7f73f80cda30 2024-08-17T02:47:03.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.384+0000 7f73f4c00640 1 --2- 172.21.15.5:0/427376732 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f73d8065180 0x7f73d8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.384+0000 7f73f4c00640 1 -- 172.21.15.5:0/427376732 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f73e4082780 con 0x7f73f80cda30 2024-08-17T02:47:03.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.384+0000 7f73fd400640 1 --2- 172.21.15.5:0/427376732 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f73d8065180 0x7f73d8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.385+0000 7f73fd400640 1 --2- 172.21.15.5:0/427376732 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f73d8065180 0x7f73d8067630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0037c0 tx=0x7f73ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.388+0000 7f73f4c00640 1 -- 172.21.15.5:0/427376732 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f73e40507a0 con 0x7f73f80cda30 2024-08-17T02:47:03.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.636+0000 7f73ffe00640 1 -- 172.21.15.5:0/427376732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f73f8157090 con 0x7f73f80cda30 2024-08-17T02:47:03.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.637+0000 7f73f4c00640 1 -- 172.21.15.5:0/427376732 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1013 (secure 0 0 0) 0x7f73e4053dc0 con 0x7f73f80cda30 2024-08-17T02:47:03.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:03.638 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1723862805,"num_in_osds":8,"osd_in_since":1723862797,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592706,"bytes_used":2455912448,"bytes_avail":770638200832,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4291}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-08-17T02:46:34.358819+0000","services":{}},"progress_events":{}} 2024-08-17T02:47:03.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.639+0000 7f73ffe00640 1 -- 172.21.15.5:0/427376732 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f73d8065180 msgr2=0x7f73d8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.639+0000 7f73ffe00640 1 --2- 172.21.15.5:0/427376732 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f73d8065180 0x7f73d8067630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0037c0 tx=0x7f73ec009040 comp rx=0 tx=0).stop 2024-08-17T02:47:03.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.639+0000 7f73ffe00640 1 -- 172.21.15.5:0/427376732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f80cda30 msgr2=0x7f73f80b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.639+0000 7f73ffe00640 1 --2- 172.21.15.5:0/427376732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f80cda30 0x7f73f80b4210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f73e400d8c0 tx=0x7f73e4008040 comp rx=0 tx=0).stop 2024-08-17T02:47:03.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.639+0000 7f73ffe00640 1 -- 172.21.15.5:0/427376732 shutdown_connections 2024-08-17T02:47:03.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.639+0000 7f73ffe00640 1 --2- 172.21.15.5:0/427376732 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f73d8065180 0x7f73d8067630 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.639+0000 7f73ffe00640 1 --2- 172.21.15.5:0/427376732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73f81589e0 0x7f73f8153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.639+0000 7f73ffe00640 1 --2- 172.21.15.5:0/427376732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f80cda30 0x7f73f80b4210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.639+0000 7f73ffe00640 1 --2- 172.21.15.5:0/427376732 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f73f80cb0d0 0x7f73f814b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.639+0000 7f73ffe00640 1 -- 172.21.15.5:0/427376732 >> 172.21.15.5:0/427376732 conn(0x7f73f806e590 msgr2=0x7f73f80ca8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:03.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.640+0000 7f73ffe00640 1 -- 172.21.15.5:0/427376732 shutdown_connections 2024-08-17T02:47:03.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.640+0000 7f73ffe00640 1 -- 172.21.15.5:0/427376732 wait complete. 2024-08-17T02:47:03.655 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-08-17T02:47:03.656 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:47:03.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.805+0000 7fb046800640 1 Processor -- start 2024-08-17T02:47:03.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.805+0000 7fb046800640 1 -- start start 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.806+0000 7fb046800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb0400afca0 0x7fb0400b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.806+0000 7fb046800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb0400acf10 0x7fb040159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.806+0000 7fb046800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04015a4e0 con 0x7fb0401589a0 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.806+0000 7fb046800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0400b0980 con 0x7fb0400afca0 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.806+0000 7fb046800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0400c92b0 con 0x7fb0400acf10 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.806+0000 7fb03f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb0400afca0 0x7fb0400b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.807+0000 7fb03f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb0400afca0 0x7fb0400b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59860/0 (socket says 172.21.15.5:59860) 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.807+0000 7fb03f400640 1 -- 172.21.15.5:0/1201481089 learned_addr learned my addr 172.21.15.5:0/1201481089 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.807+0000 7fb03ea00640 1 --2- 172.21.15.5:0/1201481089 >> v2:172.21.15.107:3300/0 conn(0x7fb0400acf10 0x7fb040159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.807+0000 7fb03f400640 1 -- 172.21.15.5:0/1201481089 >> v2:172.21.15.107:3300/0 conn(0x7fb0400acf10 msgr2=0x7fb040159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.807+0000 7fb03f400640 1 --2- 172.21.15.5:0/1201481089 >> v2:172.21.15.107:3300/0 conn(0x7fb0400acf10 0x7fb040159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.807+0000 7fb03f400640 1 -- 172.21.15.5:0/1201481089 >> v1:172.21.15.107:6789/0 conn(0x7fb0401589a0 legacy=0x7fb040158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.807+0000 7fb03f400640 1 -- 172.21.15.5:0/1201481089 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0400ad480 con 0x7fb0400afca0 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.807+0000 7fb03ea00640 1 --2- 172.21.15.5:0/1201481089 >> v2:172.21.15.107:3300/0 conn(0x7fb0400acf10 0x7fb040159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.808+0000 7fb03f400640 1 --2- 172.21.15.5:0/1201481089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0400afca0 0x7fb0400b0070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb0400c83b0 tx=0x7fb03000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63151278ec8cae35 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.808+0000 7fb03e000640 1 -- 172.21.15.5:0/1201481089 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030031650 con 0x7fb0400afca0 2024-08-17T02:47:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.808+0000 7fb03e000640 1 -- 172.21.15.5:0/1201481089 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0300317b0 con 0x7fb0400afca0 2024-08-17T02:47:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.808+0000 7fb03e000640 1 -- 172.21.15.5:0/1201481089 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030031b90 con 0x7fb0400afca0 2024-08-17T02:47:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.809+0000 7fb046800640 1 -- 172.21.15.5:0/1201481089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0400afca0 msgr2=0x7fb0400b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.809+0000 7fb046800640 1 --2- 172.21.15.5:0/1201481089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0400afca0 0x7fb0400b0070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb0400c83b0 tx=0x7fb03000b460 comp rx=0 tx=0).stop 2024-08-17T02:47:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.809+0000 7fb046800640 1 -- 172.21.15.5:0/1201481089 shutdown_connections 2024-08-17T02:47:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.809+0000 7fb046800640 1 --2- 172.21.15.5:0/1201481089 >> v2:172.21.15.107:3300/0 conn(0x7fb0400acf10 0x7fb040159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.809+0000 7fb046800640 1 --2- 172.21.15.5:0/1201481089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0400afca0 0x7fb0400b0070 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.809+0000 7fb046800640 1 -- 172.21.15.5:0/1201481089 >> 172.21.15.5:0/1201481089 conn(0x7fb040066e60 msgr2=0x7fb040067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.809+0000 7fb046800640 1 -- 172.21.15.5:0/1201481089 shutdown_connections 2024-08-17T02:47:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.809+0000 7fb046800640 1 -- 172.21.15.5:0/1201481089 wait complete. 2024-08-17T02:47:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.811+0000 7fb046800640 1 Processor -- start 2024-08-17T02:47:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.811+0000 7fb046800640 1 -- start start 2024-08-17T02:47:03.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb046800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb0400acf10 0x7fb0400c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb046800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0400afca0 0x7fb0400c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb046800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0401589a0 0x7fb04015a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb046800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb040168d80 con 0x7fb0400afca0 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb046800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400c5260 con 0x7fb0401589a0 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb046800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400c5540 con 0x7fb0400acf10 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb03ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0400afca0 0x7fb0400c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb03ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0400afca0 0x7fb0400c6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59876/0 (socket says 172.21.15.5:59876) 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb03ea00640 1 -- 172.21.15.5:0/1706367924 learned_addr learned my addr 172.21.15.5:0/1706367924 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb03f400640 1 --2- 172.21.15.5:0/1706367924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb0400acf10 0x7fb0400c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb03fe00640 1 --2- 172.21.15.5:0/1706367924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0401589a0 0x7fb04015a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb03ea00640 1 -- 172.21.15.5:0/1706367924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb0400acf10 msgr2=0x7fb0400c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb03ea00640 1 --2- 172.21.15.5:0/1706367924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb0400acf10 0x7fb0400c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb03ea00640 1 -- 172.21.15.5:0/1706367924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0401589a0 msgr2=0x7fb04015a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb03ea00640 1 --2- 172.21.15.5:0/1706367924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0401589a0 0x7fb04015a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb03ea00640 1 -- 172.21.15.5:0/1706367924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03000b700 con 0x7fb0400afca0 2024-08-17T02:47:03.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.812+0000 7fb03fe00640 1 --2- 172.21.15.5:0/1706367924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0401589a0 0x7fb04015a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.813+0000 7fb03ea00640 1 --2- 172.21.15.5:0/1706367924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0400afca0 0x7fb0400c6dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00c880 tx=0x7fb02c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.813+0000 7fb036a00640 1 -- 172.21.15.5:0/1706367924 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00ce10 con 0x7fb0400afca0 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.813+0000 7fb036a00640 1 -- 172.21.15.5:0/1706367924 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02c007830 con 0x7fb0400afca0 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.813+0000 7fb036a00640 1 -- 172.21.15.5:0/1706367924 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c007c10 con 0x7fb0400afca0 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.813+0000 7fb046800640 1 -- 172.21.15.5:0/1706367924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0400c5820 con 0x7fb0400afca0 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.813+0000 7fb046800640 1 -- 172.21.15.5:0/1706367924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04015adf0 con 0x7fb0400afca0 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.814+0000 7fb046800640 1 -- 172.21.15.5:0/1706367924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04015b070 con 0x7fb0400afca0 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.815+0000 7fb036a00640 1 -- 172.21.15.5:0/1706367924 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb02c011600 con 0x7fb0400afca0 2024-08-17T02:47:03.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.816+0000 7fb036a00640 1 --2- 172.21.15.5:0/1706367924 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb020065150 0x7fb020067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.816+0000 7fb036a00640 1 -- 172.21.15.5:0/1706367924 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb02c082800 con 0x7fb0400afca0 2024-08-17T02:47:03.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.816+0000 7fb03f400640 1 --2- 172.21.15.5:0/1706367924 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb020065150 0x7fb020067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.816+0000 7fb03f400640 1 --2- 172.21.15.5:0/1706367924 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb020065150 0x7fb020067600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb030037000 tx=0x7fb03003a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:03.820+0000 7fb036a00640 1 -- 172.21.15.5:0/1706367924 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb02c050820 con 0x7fb0400afca0 2024-08-17T02:47:04.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:04.004+0000 7fb046800640 1 -- 172.21.15.5:0/1706367924 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb040063fb0 con 0x7fb020065150 2024-08-17T02:47:04.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:04.011+0000 7fb036a00640 1 -- 172.21.15.5:0/1706367924 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264637 (secure 0 0 0) 0x7fb040063fb0 con 0x7fb020065150 2024-08-17T02:47:04.015 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:04.016 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:47:04.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:04.014+0000 7fb046800640 1 -- 172.21.15.5:0/1706367924 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb020065150 msgr2=0x7fb020067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:04.014+0000 7fb046800640 1 --2- 172.21.15.5:0/1706367924 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb020065150 0x7fb020067600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb030037000 tx=0x7fb03003a000 comp rx=0 tx=0).stop 2024-08-17T02:47:04.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:04.014+0000 7fb046800640 1 -- 172.21.15.5:0/1706367924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0400afca0 msgr2=0x7fb0400c6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:04.014+0000 7fb046800640 1 --2- 172.21.15.5:0/1706367924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0400afca0 0x7fb0400c6dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00c880 tx=0x7fb02c008040 comp rx=0 tx=0).stop 2024-08-17T02:47:04.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:04.014+0000 7fb046800640 1 -- 172.21.15.5:0/1706367924 shutdown_connections 2024-08-17T02:47:04.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:04.014+0000 7fb046800640 1 --2- 172.21.15.5:0/1706367924 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb020065150 0x7fb020067600 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:04.014+0000 7fb046800640 1 --2- 172.21.15.5:0/1706367924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0401589a0 0x7fb04015a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:04.014+0000 7fb046800640 1 --2- 172.21.15.5:0/1706367924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0400afca0 0x7fb0400c6dd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:04.014+0000 7fb046800640 1 --2- 172.21.15.5:0/1706367924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb0400acf10 0x7fb0400c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:04.014+0000 7fb046800640 1 -- 172.21.15.5:0/1706367924 >> 172.21.15.5:0/1706367924 conn(0x7fb040066e60 msgr2=0x7fb040069830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:04.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:04.015+0000 7fb046800640 1 -- 172.21.15.5:0/1706367924 shutdown_connections 2024-08-17T02:47:04.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:04.015+0000 7fb046800640 1 -- 172.21.15.5:0/1706367924 wait complete. 2024-08-17T02:47:04.019 INFO:tasks.ceph.mds.b.smithi107.stderr:2024-08-17T02:47:04.014+0000 7f22f9e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:47:04.030 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-17T02:47:03.054381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398352,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576368,"statfs":{"total":773094113280,"available":770638200832,"internally_reserved":0,"allocated":2891776,"data_stored":1750644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001128"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200708+0000","last_change":"2024-08-17T02:46:58.194762+0000","last_active":"2024-08-17T02:46:58.200708+0000","last_peered":"2024-08-17T02:46:58.200708+0000","last_clean":"2024-08-17T02:46:58.200708+0000","last_became_active":"2024-08-17T02:46:58.194202+0000","last_became_peered":"2024-08-17T02:46:58.194202+0000","last_unstale":"2024-08-17T02:46:58.200708+0000","last_undegraded":"2024-08-17T02:46:58.200708+0000","last_fullsized":"2024-08-17T02:46:58.200708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:32.670412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192679+0000","last_change":"2024-08-17T02:46:58.187726+0000","last_active":"2024-08-17T02:46:58.192679+0000","last_peered":"2024-08-17T02:46:58.192679+0000","last_clean":"2024-08-17T02:46:58.192679+0000","last_became_active":"2024-08-17T02:46:58.186807+0000","last_became_peered":"2024-08-17T02:46:58.186807+0000","last_unstale":"2024-08-17T02:46:58.192679+0000","last_undegraded":"2024-08-17T02:46:58.192679+0000","last_fullsized":"2024-08-17T02:46:58.192679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.186858+0000","last_change":"2024-08-17T02:46:58.185460+0000","last_active":"2024-08-17T02:46:58.186858+0000","last_peered":"2024-08-17T02:46:58.186858+0000","last_clean":"2024-08-17T02:46:58.186858+0000","last_became_active":"2024-08-17T02:46:58.185174+0000","last_became_peered":"2024-08-17T02:46:58.185174+0000","last_unstale":"2024-08-17T02:46:58.186858+0000","last_undegraded":"2024-08-17T02:46:58.186858+0000","last_fullsized":"2024-08-17T02:46:58.186858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:38.127688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204315+0000","last_change":"2024-08-17T02:46:58.199149+0000","last_active":"2024-08-17T02:46:58.204315+0000","last_peered":"2024-08-17T02:46:58.204315+0000","last_clean":"2024-08-17T02:46:58.204315+0000","last_became_active":"2024-08-17T02:46:58.198846+0000","last_became_peered":"2024-08-17T02:46:58.198846+0000","last_unstale":"2024-08-17T02:46:58.204315+0000","last_undegraded":"2024-08-17T02:46:58.204315+0000","last_fullsized":"2024-08-17T02:46:58.204315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:32.670412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205421+0000","last_change":"2024-08-17T02:46:58.202653+0000","last_active":"2024-08-17T02:46:58.205421+0000","last_peered":"2024-08-17T02:46:58.205421+0000","last_clean":"2024-08-17T02:46:58.205421+0000","last_became_active":"2024-08-17T02:46:58.202358+0000","last_became_peered":"2024-08-17T02:46:58.202358+0000","last_unstale":"2024-08-17T02:46:58.205421+0000","last_undegraded":"2024-08-17T02:46:58.205421+0000","last_fullsized":"2024-08-17T02:46:58.205421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199883+0000","last_change":"2024-08-17T02:46:58.181154+0000","last_active":"2024-08-17T02:46:58.199883+0000","last_peered":"2024-08-17T02:46:58.199883+0000","last_clean":"2024-08-17T02:46:58.199883+0000","last_became_active":"2024-08-17T02:46:58.180861+0000","last_became_peered":"2024-08-17T02:46:58.180861+0000","last_unstale":"2024-08-17T02:46:58.199883+0000","last_undegraded":"2024-08-17T02:46:58.199883+0000","last_fullsized":"2024-08-17T02:46:58.199883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:27:30.743267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193720+0000","last_change":"2024-08-17T02:46:58.190386+0000","last_active":"2024-08-17T02:46:58.193720+0000","last_peered":"2024-08-17T02:46:58.193720+0000","last_clean":"2024-08-17T02:46:58.193720+0000","last_became_active":"2024-08-17T02:46:58.189738+0000","last_became_peered":"2024-08-17T02:46:58.189738+0000","last_unstale":"2024-08-17T02:46:58.193720+0000","last_undegraded":"2024-08-17T02:46:58.193720+0000","last_fullsized":"2024-08-17T02:46:58.193720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:15.650114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190737+0000","last_change":"2024-08-17T02:46:58.182527+0000","last_active":"2024-08-17T02:46:58.190737+0000","last_peered":"2024-08-17T02:46:58.190737+0000","last_clean":"2024-08-17T02:46:58.190737+0000","last_became_active":"2024-08-17T02:46:58.182258+0000","last_became_peered":"2024-08-17T02:46:58.182258+0000","last_unstale":"2024-08-17T02:46:58.190737+0000","last_undegraded":"2024-08-17T02:46:58.190737+0000","last_fullsized":"2024-08-17T02:46:58.190737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:27:30.743267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205404+0000","last_change":"2024-08-17T02:46:58.201855+0000","last_active":"2024-08-17T02:46:58.205404+0000","last_peered":"2024-08-17T02:46:58.205404+0000","last_clean":"2024-08-17T02:46:58.205404+0000","last_became_active":"2024-08-17T02:46:58.201590+0000","last_became_peered":"2024-08-17T02:46:58.201590+0000","last_unstale":"2024-08-17T02:46:58.205404+0000","last_undegraded":"2024-08-17T02:46:58.205404+0000","last_fullsized":"2024-08-17T02:46:58.205404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:13:53.828518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199385+0000","last_change":"2024-08-17T02:46:58.193865+0000","last_active":"2024-08-17T02:46:58.199385+0000","last_peered":"2024-08-17T02:46:58.199385+0000","last_clean":"2024-08-17T02:46:58.199385+0000","last_became_active":"2024-08-17T02:46:58.190621+0000","last_became_peered":"2024-08-17T02:46:58.190621+0000","last_unstale":"2024-08-17T02:46:58.199385+0000","last_undegraded":"2024-08-17T02:46:58.199385+0000","last_fullsized":"2024-08-17T02:46:58.199385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:31.536609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190368+0000","last_change":"2024-08-17T02:46:58.185266+0000","last_active":"2024-08-17T02:46:58.190368+0000","last_peered":"2024-08-17T02:46:58.190368+0000","last_clean":"2024-08-17T02:46:58.190368+0000","last_became_active":"2024-08-17T02:46:58.182572+0000","last_became_peered":"2024-08-17T02:46:58.182572+0000","last_unstale":"2024-08-17T02:46:58.190368+0000","last_undegraded":"2024-08-17T02:46:58.190368+0000","last_fullsized":"2024-08-17T02:46:58.190368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195597+0000","last_change":"2024-08-17T02:46:58.187586+0000","last_active":"2024-08-17T02:46:58.195597+0000","last_peered":"2024-08-17T02:46:58.195597+0000","last_clean":"2024-08-17T02:46:58.195597+0000","last_became_active":"2024-08-17T02:46:58.187335+0000","last_became_peered":"2024-08-17T02:46:58.187335+0000","last_unstale":"2024-08-17T02:46:58.195597+0000","last_undegraded":"2024-08-17T02:46:58.195597+0000","last_fullsized":"2024-08-17T02:46:58.195597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:55.602794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193574+0000","last_change":"2024-08-17T02:46:58.191084+0000","last_active":"2024-08-17T02:46:58.193574+0000","last_peered":"2024-08-17T02:46:58.193574+0000","last_clean":"2024-08-17T02:46:58.193574+0000","last_became_active":"2024-08-17T02:46:58.190785+0000","last_became_peered":"2024-08-17T02:46:58.190785+0000","last_unstale":"2024-08-17T02:46:58.193574+0000","last_undegraded":"2024-08-17T02:46:58.193574+0000","last_fullsized":"2024-08-17T02:46:58.193574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.178552+0000","last_change":"2024-08-17T02:46:58.171881+0000","last_active":"2024-08-17T02:46:58.178552+0000","last_peered":"2024-08-17T02:46:58.178552+0000","last_clean":"2024-08-17T02:46:58.178552+0000","last_became_active":"2024-08-17T02:46:58.171501+0000","last_became_peered":"2024-08-17T02:46:58.171501+0000","last_unstale":"2024-08-17T02:46:58.178552+0000","last_undegraded":"2024-08-17T02:46:58.178552+0000","last_fullsized":"2024-08-17T02:46:58.178552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:33.640796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182891+0000","last_change":"2024-08-17T02:46:58.177768+0000","last_active":"2024-08-17T02:46:58.182891+0000","last_peered":"2024-08-17T02:46:58.182891+0000","last_clean":"2024-08-17T02:46:58.182891+0000","last_became_active":"2024-08-17T02:46:58.177477+0000","last_became_peered":"2024-08-17T02:46:58.177477+0000","last_unstale":"2024-08-17T02:46:58.182891+0000","last_undegraded":"2024-08-17T02:46:58.182891+0000","last_fullsized":"2024-08-17T02:46:58.182891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:31.536609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199278+0000","last_change":"2024-08-17T02:46:58.185626+0000","last_active":"2024-08-17T02:46:58.199278+0000","last_peered":"2024-08-17T02:46:58.199278+0000","last_clean":"2024-08-17T02:46:58.199278+0000","last_became_active":"2024-08-17T02:46:58.185229+0000","last_became_peered":"2024-08-17T02:46:58.185229+0000","last_unstale":"2024-08-17T02:46:58.199278+0000","last_undegraded":"2024-08-17T02:46:58.199278+0000","last_fullsized":"2024-08-17T02:46:58.199278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:05.343969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204193+0000","last_change":"2024-08-17T02:46:58.198656+0000","last_active":"2024-08-17T02:46:58.204193+0000","last_peered":"2024-08-17T02:46:58.204193+0000","last_clean":"2024-08-17T02:46:58.204193+0000","last_became_active":"2024-08-17T02:46:58.198359+0000","last_became_peered":"2024-08-17T02:46:58.198359+0000","last_unstale":"2024-08-17T02:46:58.204193+0000","last_undegraded":"2024-08-17T02:46:58.204193+0000","last_fullsized":"2024-08-17T02:46:58.204193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:11.578823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.201567+0000","last_change":"2024-08-17T02:46:58.199727+0000","last_active":"2024-08-17T02:46:58.201567+0000","last_peered":"2024-08-17T02:46:58.201567+0000","last_clean":"2024-08-17T02:46:58.201567+0000","last_became_active":"2024-08-17T02:46:58.197375+0000","last_became_peered":"2024-08-17T02:46:58.197375+0000","last_unstale":"2024-08-17T02:46:58.201567+0000","last_undegraded":"2024-08-17T02:46:58.201567+0000","last_fullsized":"2024-08-17T02:46:58.201567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:23.710551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205376+0000","last_change":"2024-08-17T02:46:58.201834+0000","last_active":"2024-08-17T02:46:58.205376+0000","last_peered":"2024-08-17T02:46:58.205376+0000","last_clean":"2024-08-17T02:46:58.205376+0000","last_became_active":"2024-08-17T02:46:58.201441+0000","last_became_peered":"2024-08-17T02:46:58.201441+0000","last_unstale":"2024-08-17T02:46:58.205376+0000","last_undegraded":"2024-08-17T02:46:58.205376+0000","last_fullsized":"2024-08-17T02:46:58.205376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:27:30.743267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.186476+0000","last_change":"2024-08-17T02:46:58.183993+0000","last_active":"2024-08-17T02:46:58.186476+0000","last_peered":"2024-08-17T02:46:58.186476+0000","last_clean":"2024-08-17T02:46:58.186476+0000","last_became_active":"2024-08-17T02:46:58.183062+0000","last_became_peered":"2024-08-17T02:46:58.183062+0000","last_unstale":"2024-08-17T02:46:58.186476+0000","last_undegraded":"2024-08-17T02:46:58.186476+0000","last_fullsized":"2024-08-17T02:46:58.186476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182024+0000","last_change":"2024-08-17T02:46:58.179197+0000","last_active":"2024-08-17T02:46:58.182024+0000","last_peered":"2024-08-17T02:46:58.182024+0000","last_clean":"2024-08-17T02:46:58.182024+0000","last_became_active":"2024-08-17T02:46:58.178943+0000","last_became_peered":"2024-08-17T02:46:58.178943+0000","last_unstale":"2024-08-17T02:46:58.182024+0000","last_undegraded":"2024-08-17T02:46:58.182024+0000","last_fullsized":"2024-08-17T02:46:58.182024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:28.627999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200146+0000","last_change":"2024-08-17T02:46:58.193621+0000","last_active":"2024-08-17T02:46:58.200146+0000","last_peered":"2024-08-17T02:46:58.200146+0000","last_clean":"2024-08-17T02:46:58.200146+0000","last_became_active":"2024-08-17T02:46:58.193367+0000","last_became_peered":"2024-08-17T02:46:58.193367+0000","last_unstale":"2024-08-17T02:46:58.200146+0000","last_undegraded":"2024-08-17T02:46:58.200146+0000","last_fullsized":"2024-08-17T02:46:58.200146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:15.650114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.197851+0000","last_change":"2024-08-17T02:46:58.196187+0000","last_active":"2024-08-17T02:46:58.197851+0000","last_peered":"2024-08-17T02:46:58.197851+0000","last_clean":"2024-08-17T02:46:58.197851+0000","last_became_active":"2024-08-17T02:46:58.195945+0000","last_became_peered":"2024-08-17T02:46:58.195945+0000","last_unstale":"2024-08-17T02:46:58.197851+0000","last_undegraded":"2024-08-17T02:46:58.197851+0000","last_fullsized":"2024-08-17T02:46:58.197851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:33.640796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199480+0000","last_change":"2024-08-17T02:46:58.186302+0000","last_active":"2024-08-17T02:46:58.199480+0000","last_peered":"2024-08-17T02:46:58.199480+0000","last_clean":"2024-08-17T02:46:58.199480+0000","last_became_active":"2024-08-17T02:46:58.185991+0000","last_became_peered":"2024-08-17T02:46:58.185991+0000","last_unstale":"2024-08-17T02:46:58.199480+0000","last_undegraded":"2024-08-17T02:46:58.199480+0000","last_fullsized":"2024-08-17T02:46:58.199480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:27.700709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190838+0000","last_change":"2024-08-17T02:46:58.182905+0000","last_active":"2024-08-17T02:46:58.190838+0000","last_peered":"2024-08-17T02:46:58.190838+0000","last_clean":"2024-08-17T02:46:58.190838+0000","last_became_active":"2024-08-17T02:46:58.180544+0000","last_became_peered":"2024-08-17T02:46:58.180544+0000","last_unstale":"2024-08-17T02:46:58.190838+0000","last_undegraded":"2024-08-17T02:46:58.190838+0000","last_fullsized":"2024-08-17T02:46:58.190838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:34.299927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199367+0000","last_change":"2024-08-17T02:46:58.192607+0000","last_active":"2024-08-17T02:46:58.199367+0000","last_peered":"2024-08-17T02:46:58.199367+0000","last_clean":"2024-08-17T02:46:58.199367+0000","last_became_active":"2024-08-17T02:46:58.192400+0000","last_became_peered":"2024-08-17T02:46:58.192400+0000","last_unstale":"2024-08-17T02:46:58.199367+0000","last_undegraded":"2024-08-17T02:46:58.199367+0000","last_fullsized":"2024-08-17T02:46:58.199367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196626+0000","last_change":"2024-08-17T02:46:58.180251+0000","last_active":"2024-08-17T02:46:58.196626+0000","last_peered":"2024-08-17T02:46:58.196626+0000","last_clean":"2024-08-17T02:46:58.196626+0000","last_became_active":"2024-08-17T02:46:58.179999+0000","last_became_peered":"2024-08-17T02:46:58.179999+0000","last_unstale":"2024-08-17T02:46:58.196626+0000","last_undegraded":"2024-08-17T02:46:58.196626+0000","last_fullsized":"2024-08-17T02:46:58.196626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191065+0000","last_change":"2024-08-17T02:46:58.187641+0000","last_active":"2024-08-17T02:46:58.191065+0000","last_peered":"2024-08-17T02:46:58.191065+0000","last_clean":"2024-08-17T02:46:58.191065+0000","last_became_active":"2024-08-17T02:46:58.183623+0000","last_became_peered":"2024-08-17T02:46:58.183623+0000","last_unstale":"2024-08-17T02:46:58.191065+0000","last_undegraded":"2024-08-17T02:46:58.191065+0000","last_fullsized":"2024-08-17T02:46:58.191065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182583+0000","last_change":"2024-08-17T02:46:58.179841+0000","last_active":"2024-08-17T02:46:58.182583+0000","last_peered":"2024-08-17T02:46:58.182583+0000","last_clean":"2024-08-17T02:46:58.182583+0000","last_became_active":"2024-08-17T02:46:58.179424+0000","last_became_peered":"2024-08-17T02:46:58.179424+0000","last_unstale":"2024-08-17T02:46:58.182583+0000","last_undegraded":"2024-08-17T02:46:58.182583+0000","last_fullsized":"2024-08-17T02:46:58.182583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205064+0000","last_change":"2024-08-17T02:46:58.199295+0000","last_active":"2024-08-17T02:46:58.205064+0000","last_peered":"2024-08-17T02:46:58.205064+0000","last_clean":"2024-08-17T02:46:58.205064+0000","last_became_active":"2024-08-17T02:46:58.198388+0000","last_became_peered":"2024-08-17T02:46:58.198388+0000","last_unstale":"2024-08-17T02:46:58.205064+0000","last_undegraded":"2024-08-17T02:46:58.205064+0000","last_fullsized":"2024-08-17T02:46:58.205064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:20.281407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.189531+0000","last_change":"2024-08-17T02:46:58.185183+0000","last_active":"2024-08-17T02:46:58.189531+0000","last_peered":"2024-08-17T02:46:58.189531+0000","last_clean":"2024-08-17T02:46:58.189531+0000","last_became_active":"2024-08-17T02:46:58.184850+0000","last_became_peered":"2024-08-17T02:46:58.184850+0000","last_unstale":"2024-08-17T02:46:58.189531+0000","last_undegraded":"2024-08-17T02:46:58.189531+0000","last_fullsized":"2024-08-17T02:46:58.189531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:52.596395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192369+0000","last_change":"2024-08-17T02:46:58.187380+0000","last_active":"2024-08-17T02:46:58.192369+0000","last_peered":"2024-08-17T02:46:58.192369+0000","last_clean":"2024-08-17T02:46:58.192369+0000","last_became_active":"2024-08-17T02:46:58.187091+0000","last_became_peered":"2024-08-17T02:46:58.187091+0000","last_unstale":"2024-08-17T02:46:58.192369+0000","last_undegraded":"2024-08-17T02:46:58.192369+0000","last_fullsized":"2024-08-17T02:46:58.192369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:28.627999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.179200+0000","last_change":"2024-08-17T02:46:58.174376+0000","last_active":"2024-08-17T02:46:58.179200+0000","last_peered":"2024-08-17T02:46:58.179200+0000","last_clean":"2024-08-17T02:46:58.179200+0000","last_became_active":"2024-08-17T02:46:58.173432+0000","last_became_peered":"2024-08-17T02:46:58.173432+0000","last_unstale":"2024-08-17T02:46:58.179200+0000","last_undegraded":"2024-08-17T02:46:58.179200+0000","last_fullsized":"2024-08-17T02:46:58.179200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:28.364147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193762+0000","last_change":"2024-08-17T02:46:57.189925+0000","last_active":"2024-08-17T02:46:58.193762+0000","last_peered":"2024-08-17T02:46:58.193762+0000","last_clean":"2024-08-17T02:46:58.193762+0000","last_became_active":"2024-08-17T02:46:57.189656+0000","last_became_peered":"2024-08-17T02:46:57.189656+0000","last_unstale":"2024-08-17T02:46:58.193762+0000","last_undegraded":"2024-08-17T02:46:58.193762+0000","last_fullsized":"2024-08-17T02:46:58.193762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182005+0000","last_change":"2024-08-17T02:46:58.178720+0000","last_active":"2024-08-17T02:46:58.182005+0000","last_peered":"2024-08-17T02:46:58.182005+0000","last_clean":"2024-08-17T02:46:58.182005+0000","last_became_active":"2024-08-17T02:46:58.177772+0000","last_became_peered":"2024-08-17T02:46:58.177772+0000","last_unstale":"2024-08-17T02:46:58.182005+0000","last_undegraded":"2024-08-17T02:46:58.182005+0000","last_fullsized":"2024-08-17T02:46:58.182005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:34.299927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.187850+0000","last_change":"2024-08-17T02:46:57.172726+0000","last_active":"2024-08-17T02:46:58.187850+0000","last_peered":"2024-08-17T02:46:58.187850+0000","last_clean":"2024-08-17T02:46:58.187850+0000","last_became_active":"2024-08-17T02:46:57.172399+0000","last_became_peered":"2024-08-17T02:46:57.172399+0000","last_unstale":"2024-08-17T02:46:58.187850+0000","last_undegraded":"2024-08-17T02:46:58.187850+0000","last_fullsized":"2024-08-17T02:46:58.187850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.171412+0000","last_change":"2024-08-17T02:46:57.183195+0000","last_active":"2024-08-17T02:46:58.171412+0000","last_peered":"2024-08-17T02:46:58.171412+0000","last_clean":"2024-08-17T02:46:58.171412+0000","last_became_active":"2024-08-17T02:46:57.182892+0000","last_became_peered":"2024-08-17T02:46:57.182892+0000","last_unstale":"2024-08-17T02:46:58.171412+0000","last_undegraded":"2024-08-17T02:46:58.171412+0000","last_fullsized":"2024-08-17T02:46:58.171412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:03.559127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190912+0000","last_change":"2024-08-17T02:46:58.186355+0000","last_active":"2024-08-17T02:46:58.190912+0000","last_peered":"2024-08-17T02:46:58.190912+0000","last_clean":"2024-08-17T02:46:58.190912+0000","last_became_active":"2024-08-17T02:46:58.184770+0000","last_became_peered":"2024-08-17T02:46:58.184770+0000","last_unstale":"2024-08-17T02:46:58.190912+0000","last_undegraded":"2024-08-17T02:46:58.190912+0000","last_fullsized":"2024-08-17T02:46:58.190912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.174256+0000","last_change":"2024-08-17T02:46:57.182999+0000","last_active":"2024-08-17T02:46:58.174256+0000","last_peered":"2024-08-17T02:46:58.174256+0000","last_clean":"2024-08-17T02:46:58.174256+0000","last_became_active":"2024-08-17T02:46:57.182704+0000","last_became_peered":"2024-08-17T02:46:57.182704+0000","last_unstale":"2024-08-17T02:46:58.174256+0000","last_undegraded":"2024-08-17T02:46:58.174256+0000","last_fullsized":"2024-08-17T02:46:58.174256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182901+0000","last_change":"2024-08-17T02:46:58.178469+0000","last_active":"2024-08-17T02:46:58.182901+0000","last_peered":"2024-08-17T02:46:58.182901+0000","last_clean":"2024-08-17T02:46:58.182901+0000","last_became_active":"2024-08-17T02:46:58.178131+0000","last_became_peered":"2024-08-17T02:46:58.178131+0000","last_unstale":"2024-08-17T02:46:58.182901+0000","last_undegraded":"2024-08-17T02:46:58.182901+0000","last_fullsized":"2024-08-17T02:46:58.182901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.164211+0000","last_change":"2024-08-17T02:46:57.186233+0000","last_active":"2024-08-17T02:46:58.164211+0000","last_peered":"2024-08-17T02:46:58.164211+0000","last_clean":"2024-08-17T02:46:58.164211+0000","last_became_active":"2024-08-17T02:46:57.185870+0000","last_became_peered":"2024-08-17T02:46:57.185870+0000","last_unstale":"2024-08-17T02:46:58.164211+0000","last_undegraded":"2024-08-17T02:46:58.164211+0000","last_fullsized":"2024-08-17T02:46:58.164211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200162+0000","last_change":"2024-08-17T02:46:58.193886+0000","last_active":"2024-08-17T02:46:58.200162+0000","last_peered":"2024-08-17T02:46:58.200162+0000","last_clean":"2024-08-17T02:46:58.200162+0000","last_became_active":"2024-08-17T02:46:58.193601+0000","last_became_peered":"2024-08-17T02:46:58.193601+0000","last_unstale":"2024-08-17T02:46:58.200162+0000","last_undegraded":"2024-08-17T02:46:58.200162+0000","last_fullsized":"2024-08-17T02:46:58.200162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:36.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.176488+0000","last_change":"2024-08-17T02:46:57.178427+0000","last_active":"2024-08-17T02:46:58.176488+0000","last_peered":"2024-08-17T02:46:58.176488+0000","last_clean":"2024-08-17T02:46:58.176488+0000","last_became_active":"2024-08-17T02:46:57.178055+0000","last_became_peered":"2024-08-17T02:46:57.178055+0000","last_unstale":"2024-08-17T02:46:58.176488+0000","last_undegraded":"2024-08-17T02:46:58.176488+0000","last_fullsized":"2024-08-17T02:46:58.176488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.186843+0000","last_change":"2024-08-17T02:46:58.185244+0000","last_active":"2024-08-17T02:46:58.186843+0000","last_peered":"2024-08-17T02:46:58.186843+0000","last_clean":"2024-08-17T02:46:58.186843+0000","last_became_active":"2024-08-17T02:46:58.184932+0000","last_became_peered":"2024-08-17T02:46:58.184932+0000","last_unstale":"2024-08-17T02:46:58.186843+0000","last_undegraded":"2024-08-17T02:46:58.186843+0000","last_fullsized":"2024-08-17T02:46:58.186843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200246+0000","last_change":"2024-08-17T02:46:57.185013+0000","last_active":"2024-08-17T02:46:58.200246+0000","last_peered":"2024-08-17T02:46:58.200246+0000","last_clean":"2024-08-17T02:46:58.200246+0000","last_became_active":"2024-08-17T02:46:57.184784+0000","last_became_peered":"2024-08-17T02:46:57.184784+0000","last_unstale":"2024-08-17T02:46:58.200246+0000","last_undegraded":"2024-08-17T02:46:58.200246+0000","last_fullsized":"2024-08-17T02:46:58.200246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:22.700908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200848+0000","last_change":"2024-08-17T02:46:58.195407+0000","last_active":"2024-08-17T02:46:58.200848+0000","last_peered":"2024-08-17T02:46:58.200848+0000","last_clean":"2024-08-17T02:46:58.200848+0000","last_became_active":"2024-08-17T02:46:58.195124+0000","last_became_peered":"2024-08-17T02:46:58.195124+0000","last_unstale":"2024-08-17T02:46:58.200848+0000","last_undegraded":"2024-08-17T02:46:58.200848+0000","last_fullsized":"2024-08-17T02:46:58.200848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:52.596395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.202448+0000","last_change":"2024-08-17T02:46:57.187357+0000","last_active":"2024-08-17T02:46:58.202448+0000","last_peered":"2024-08-17T02:46:58.202448+0000","last_clean":"2024-08-17T02:46:58.202448+0000","last_became_active":"2024-08-17T02:46:57.187009+0000","last_became_peered":"2024-08-17T02:46:57.187009+0000","last_unstale":"2024-08-17T02:46:58.202448+0000","last_undegraded":"2024-08-17T02:46:58.202448+0000","last_fullsized":"2024-08-17T02:46:58.202448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.197087+0000","last_change":"2024-08-17T02:46:58.192814+0000","last_active":"2024-08-17T02:46:58.197087+0000","last_peered":"2024-08-17T02:46:58.197087+0000","last_clean":"2024-08-17T02:46:58.197087+0000","last_became_active":"2024-08-17T02:46:58.192555+0000","last_became_peered":"2024-08-17T02:46:58.192555+0000","last_unstale":"2024-08-17T02:46:58.197087+0000","last_undegraded":"2024-08-17T02:46:58.197087+0000","last_fullsized":"2024-08-17T02:46:58.197087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:27.700709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195065+0000","last_change":"2024-08-17T02:46:57.173067+0000","last_active":"2024-08-17T02:46:58.195065+0000","last_peered":"2024-08-17T02:46:58.195065+0000","last_clean":"2024-08-17T02:46:58.195065+0000","last_became_active":"2024-08-17T02:46:57.172758+0000","last_became_peered":"2024-08-17T02:46:57.172758+0000","last_unstale":"2024-08-17T02:46:58.195065+0000","last_undegraded":"2024-08-17T02:46:58.195065+0000","last_fullsized":"2024-08-17T02:46:58.195065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:03.559127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195519+0000","last_change":"2024-08-17T02:46:58.193978+0000","last_active":"2024-08-17T02:46:58.195519+0000","last_peered":"2024-08-17T02:46:58.195519+0000","last_clean":"2024-08-17T02:46:58.195519+0000","last_became_active":"2024-08-17T02:46:58.193769+0000","last_became_peered":"2024-08-17T02:46:58.193769+0000","last_unstale":"2024-08-17T02:46:58.195519+0000","last_undegraded":"2024-08-17T02:46:58.195519+0000","last_fullsized":"2024-08-17T02:46:58.195519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.176328+0000","last_change":"2024-08-17T02:46:57.184989+0000","last_active":"2024-08-17T02:46:58.176328+0000","last_peered":"2024-08-17T02:46:58.176328+0000","last_clean":"2024-08-17T02:46:58.176328+0000","last_became_active":"2024-08-17T02:46:57.184687+0000","last_became_peered":"2024-08-17T02:46:57.184687+0000","last_unstale":"2024-08-17T02:46:58.176328+0000","last_undegraded":"2024-08-17T02:46:58.176328+0000","last_fullsized":"2024-08-17T02:46:58.176328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195058+0000","last_change":"2024-08-17T02:46:58.190873+0000","last_active":"2024-08-17T02:46:58.195058+0000","last_peered":"2024-08-17T02:46:58.195058+0000","last_clean":"2024-08-17T02:46:58.195058+0000","last_became_active":"2024-08-17T02:46:58.190322+0000","last_became_peered":"2024-08-17T02:46:58.190322+0000","last_unstale":"2024-08-17T02:46:58.195058+0000","last_undegraded":"2024-08-17T02:46:58.195058+0000","last_fullsized":"2024-08-17T02:46:58.195058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:05.343969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.164482+0000","last_change":"2024-08-17T02:46:57.180474+0000","last_active":"2024-08-17T02:46:58.164482+0000","last_peered":"2024-08-17T02:46:58.164482+0000","last_clean":"2024-08-17T02:46:58.164482+0000","last_became_active":"2024-08-17T02:46:57.180126+0000","last_became_peered":"2024-08-17T02:46:57.180126+0000","last_unstale":"2024-08-17T02:46:58.164482+0000","last_undegraded":"2024-08-17T02:46:58.164482+0000","last_fullsized":"2024-08-17T02:46:58.164482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192352+0000","last_change":"2024-08-17T02:46:58.187354+0000","last_active":"2024-08-17T02:46:58.192352+0000","last_peered":"2024-08-17T02:46:58.192352+0000","last_clean":"2024-08-17T02:46:58.192352+0000","last_became_active":"2024-08-17T02:46:58.187061+0000","last_became_peered":"2024-08-17T02:46:58.187061+0000","last_unstale":"2024-08-17T02:46:58.192352+0000","last_undegraded":"2024-08-17T02:46:58.192352+0000","last_fullsized":"2024-08-17T02:46:58.192352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:33.640796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204507+0000","last_change":"2024-08-17T02:46:57.173178+0000","last_active":"2024-08-17T02:46:58.204507+0000","last_peered":"2024-08-17T02:46:58.204507+0000","last_clean":"2024-08-17T02:46:58.204507+0000","last_became_active":"2024-08-17T02:46:57.171399+0000","last_became_peered":"2024-08-17T02:46:57.171399+0000","last_unstale":"2024-08-17T02:46:58.204507+0000","last_undegraded":"2024-08-17T02:46:58.204507+0000","last_fullsized":"2024-08-17T02:46:58.204507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200463+0000","last_change":"2024-08-17T02:46:58.195024+0000","last_active":"2024-08-17T02:46:58.200463+0000","last_peered":"2024-08-17T02:46:58.200463+0000","last_clean":"2024-08-17T02:46:58.200463+0000","last_became_active":"2024-08-17T02:46:58.194058+0000","last_became_peered":"2024-08-17T02:46:58.194058+0000","last_unstale":"2024-08-17T02:46:58.200463+0000","last_undegraded":"2024-08-17T02:46:58.200463+0000","last_fullsized":"2024-08-17T02:46:58.200463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:36.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193533+0000","last_change":"2024-08-17T02:46:57.179217+0000","last_active":"2024-08-17T02:46:58.193533+0000","last_peered":"2024-08-17T02:46:58.193533+0000","last_clean":"2024-08-17T02:46:58.193533+0000","last_became_active":"2024-08-17T02:46:57.178894+0000","last_became_peered":"2024-08-17T02:46:57.178894+0000","last_unstale":"2024-08-17T02:46:58.193533+0000","last_undegraded":"2024-08-17T02:46:58.193533+0000","last_fullsized":"2024-08-17T02:46:58.193533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:29:23.466288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200370+0000","last_change":"2024-08-17T02:46:58.195478+0000","last_active":"2024-08-17T02:46:58.200370+0000","last_peered":"2024-08-17T02:46:58.200370+0000","last_clean":"2024-08-17T02:46:58.200370+0000","last_became_active":"2024-08-17T02:46:58.195223+0000","last_became_peered":"2024-08-17T02:46:58.195223+0000","last_unstale":"2024-08-17T02:46:58.200370+0000","last_undegraded":"2024-08-17T02:46:58.200370+0000","last_fullsized":"2024-08-17T02:46:58.200370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:20.281407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.197709+0000","last_change":"2024-08-17T02:46:57.188113+0000","last_active":"2024-08-17T02:46:58.197709+0000","last_peered":"2024-08-17T02:46:58.197709+0000","last_clean":"2024-08-17T02:46:58.197709+0000","last_became_active":"2024-08-17T02:46:57.187801+0000","last_became_peered":"2024-08-17T02:46:57.187801+0000","last_unstale":"2024-08-17T02:46:58.197709+0000","last_undegraded":"2024-08-17T02:46:58.197709+0000","last_fullsized":"2024-08-17T02:46:58.197709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:21.241911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204810+0000","last_change":"2024-08-17T02:46:58.198647+0000","last_active":"2024-08-17T02:46:58.204810+0000","last_peered":"2024-08-17T02:46:58.204810+0000","last_clean":"2024-08-17T02:46:58.204810+0000","last_became_active":"2024-08-17T02:46:58.198406+0000","last_became_peered":"2024-08-17T02:46:58.198406+0000","last_unstale":"2024-08-17T02:46:58.204810+0000","last_undegraded":"2024-08-17T02:46:58.204810+0000","last_fullsized":"2024-08-17T02:46:58.204810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:49.067728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196700+0000","last_change":"2024-08-17T02:46:57.177253+0000","last_active":"2024-08-17T02:46:58.196700+0000","last_peered":"2024-08-17T02:46:58.196700+0000","last_clean":"2024-08-17T02:46:58.196700+0000","last_became_active":"2024-08-17T02:46:57.176994+0000","last_became_peered":"2024-08-17T02:46:57.176994+0000","last_unstale":"2024-08-17T02:46:58.196700+0000","last_undegraded":"2024-08-17T02:46:58.196700+0000","last_fullsized":"2024-08-17T02:46:58.196700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:51.586751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199394+0000","last_change":"2024-08-17T02:46:58.186086+0000","last_active":"2024-08-17T02:46:58.199394+0000","last_peered":"2024-08-17T02:46:58.199394+0000","last_clean":"2024-08-17T02:46:58.199394+0000","last_became_active":"2024-08-17T02:46:58.185889+0000","last_became_peered":"2024-08-17T02:46:58.185889+0000","last_unstale":"2024-08-17T02:46:58.199394+0000","last_undegraded":"2024-08-17T02:46:58.199394+0000","last_fullsized":"2024-08-17T02:46:58.199394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:49.067728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.175925+0000","last_change":"2024-08-17T02:46:57.181595+0000","last_active":"2024-08-17T02:46:58.175925+0000","last_peered":"2024-08-17T02:46:58.175925+0000","last_clean":"2024-08-17T02:46:58.175925+0000","last_became_active":"2024-08-17T02:46:57.181288+0000","last_became_peered":"2024-08-17T02:46:57.181288+0000","last_unstale":"2024-08-17T02:46:58.175925+0000","last_undegraded":"2024-08-17T02:46:58.175925+0000","last_fullsized":"2024-08-17T02:46:58.175925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:03.559127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205392+0000","last_change":"2024-08-17T02:46:58.202092+0000","last_active":"2024-08-17T02:46:58.205392+0000","last_peered":"2024-08-17T02:46:58.205392+0000","last_clean":"2024-08-17T02:46:58.205392+0000","last_became_active":"2024-08-17T02:46:58.201265+0000","last_became_peered":"2024-08-17T02:46:58.201265+0000","last_unstale":"2024-08-17T02:46:58.205392+0000","last_undegraded":"2024-08-17T02:46:58.205392+0000","last_fullsized":"2024-08-17T02:46:58.205392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:57.772457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.170897+0000","last_change":"2024-08-17T02:46:48.424689+0000","last_active":"2024-08-17T02:46:58.170897+0000","last_peered":"2024-08-17T02:46:58.170897+0000","last_clean":"2024-08-17T02:46:58.170897+0000","last_became_active":"2024-08-17T02:46:48.423437+0000","last_became_peered":"2024-08-17T02:46:48.423437+0000","last_unstale":"2024-08-17T02:46:58.170897+0000","last_undegraded":"2024-08-17T02:46:58.170897+0000","last_fullsized":"2024-08-17T02:46:58.170897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.106569+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:50.533980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.168621+0000","last_change":"2024-08-17T02:46:57.171177+0000","last_active":"2024-08-17T02:46:58.168621+0000","last_peered":"2024-08-17T02:46:58.168621+0000","last_clean":"2024-08-17T02:46:58.168621+0000","last_became_active":"2024-08-17T02:46:57.170458+0000","last_became_peered":"2024-08-17T02:46:57.170458+0000","last_unstale":"2024-08-17T02:46:58.168621+0000","last_undegraded":"2024-08-17T02:46:58.168621+0000","last_fullsized":"2024-08-17T02:46:58.168621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196422+0000","last_change":"2024-08-17T02:46:58.195312+0000","last_active":"2024-08-17T02:46:58.196422+0000","last_peered":"2024-08-17T02:46:58.196422+0000","last_clean":"2024-08-17T02:46:58.196422+0000","last_became_active":"2024-08-17T02:46:58.195014+0000","last_became_peered":"2024-08-17T02:46:58.195014+0000","last_unstale":"2024-08-17T02:46:58.196422+0000","last_undegraded":"2024-08-17T02:46:58.196422+0000","last_fullsized":"2024-08-17T02:46:58.196422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:08.556818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.170788+0000","last_change":"2024-08-17T02:46:57.184842+0000","last_active":"2024-08-17T02:46:58.170788+0000","last_peered":"2024-08-17T02:46:58.170788+0000","last_clean":"2024-08-17T02:46:58.170788+0000","last_became_active":"2024-08-17T02:46:57.184291+0000","last_became_peered":"2024-08-17T02:46:57.184291+0000","last_unstale":"2024-08-17T02:46:58.170788+0000","last_undegraded":"2024-08-17T02:46:58.170788+0000","last_fullsized":"2024-08-17T02:46:58.170788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.183117+0000","last_change":"2024-08-17T02:46:58.180783+0000","last_active":"2024-08-17T02:46:58.183117+0000","last_peered":"2024-08-17T02:46:58.183117+0000","last_clean":"2024-08-17T02:46:58.183117+0000","last_became_active":"2024-08-17T02:46:58.174973+0000","last_became_peered":"2024-08-17T02:46:58.174973+0000","last_unstale":"2024-08-17T02:46:58.183117+0000","last_undegraded":"2024-08-17T02:46:58.183117+0000","last_fullsized":"2024-08-17T02:46:58.183117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.176827+0000","last_change":"2024-08-17T02:46:57.184122+0000","last_active":"2024-08-17T02:46:58.176827+0000","last_peered":"2024-08-17T02:46:58.176827+0000","last_clean":"2024-08-17T02:46:58.176827+0000","last_became_active":"2024-08-17T02:46:57.183807+0000","last_became_peered":"2024-08-17T02:46:57.183807+0000","last_unstale":"2024-08-17T02:46:58.176827+0000","last_undegraded":"2024-08-17T02:46:58.176827+0000","last_fullsized":"2024-08-17T02:46:58.176827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.203872+0000","last_change":"2024-08-17T02:46:58.202695+0000","last_active":"2024-08-17T02:46:58.203872+0000","last_peered":"2024-08-17T02:46:58.203872+0000","last_clean":"2024-08-17T02:46:58.203872+0000","last_became_active":"2024-08-17T02:46:58.201153+0000","last_became_peered":"2024-08-17T02:46:58.201153+0000","last_unstale":"2024-08-17T02:46:58.203872+0000","last_undegraded":"2024-08-17T02:46:58.203872+0000","last_fullsized":"2024-08-17T02:46:58.203872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:34.299927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.175573+0000","last_change":"2024-08-17T02:46:57.172754+0000","last_active":"2024-08-17T02:46:58.175573+0000","last_peered":"2024-08-17T02:46:58.175573+0000","last_clean":"2024-08-17T02:46:58.175573+0000","last_became_active":"2024-08-17T02:46:57.172534+0000","last_became_peered":"2024-08-17T02:46:57.172534+0000","last_unstale":"2024-08-17T02:46:58.175573+0000","last_undegraded":"2024-08-17T02:46:58.175573+0000","last_fullsized":"2024-08-17T02:46:58.175573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192797+0000","last_change":"2024-08-17T02:46:58.184673+0000","last_active":"2024-08-17T02:46:58.192797+0000","last_peered":"2024-08-17T02:46:58.192797+0000","last_clean":"2024-08-17T02:46:58.192797+0000","last_became_active":"2024-08-17T02:46:58.184365+0000","last_became_peered":"2024-08-17T02:46:58.184365+0000","last_unstale":"2024-08-17T02:46:58.192797+0000","last_undegraded":"2024-08-17T02:46:58.192797+0000","last_fullsized":"2024-08-17T02:46:58.192797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:18.212612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.165816+0000","last_change":"2024-08-17T02:46:57.172721+0000","last_active":"2024-08-17T02:46:58.165816+0000","last_peered":"2024-08-17T02:46:58.165816+0000","last_clean":"2024-08-17T02:46:58.165816+0000","last_became_active":"2024-08-17T02:46:57.172414+0000","last_became_peered":"2024-08-17T02:46:57.172414+0000","last_unstale":"2024-08-17T02:46:58.165816+0000","last_undegraded":"2024-08-17T02:46:58.165816+0000","last_fullsized":"2024-08-17T02:46:58.165816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204268+0000","last_change":"2024-08-17T02:46:58.199050+0000","last_active":"2024-08-17T02:46:58.204268+0000","last_peered":"2024-08-17T02:46:58.204268+0000","last_clean":"2024-08-17T02:46:58.204268+0000","last_became_active":"2024-08-17T02:46:58.198795+0000","last_became_peered":"2024-08-17T02:46:58.198795+0000","last_unstale":"2024-08-17T02:46:58.204268+0000","last_undegraded":"2024-08-17T02:46:58.204268+0000","last_fullsized":"2024-08-17T02:46:58.204268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.181818+0000","last_change":"2024-08-17T02:46:57.186077+0000","last_active":"2024-08-17T02:46:58.181818+0000","last_peered":"2024-08-17T02:46:58.181818+0000","last_clean":"2024-08-17T02:46:58.181818+0000","last_became_active":"2024-08-17T02:46:57.185671+0000","last_became_peered":"2024-08-17T02:46:57.185671+0000","last_unstale":"2024-08-17T02:46:58.181818+0000","last_undegraded":"2024-08-17T02:46:58.181818+0000","last_fullsized":"2024-08-17T02:46:58.181818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:37.118045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.201382+0000","last_change":"2024-08-17T02:46:58.199398+0000","last_active":"2024-08-17T02:46:58.201382+0000","last_peered":"2024-08-17T02:46:58.201382+0000","last_clean":"2024-08-17T02:46:58.201382+0000","last_became_active":"2024-08-17T02:46:58.199075+0000","last_became_peered":"2024-08-17T02:46:58.199075+0000","last_unstale":"2024-08-17T02:46:58.201382+0000","last_undegraded":"2024-08-17T02:46:58.201382+0000","last_fullsized":"2024-08-17T02:46:58.201382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.166353+0000","last_change":"2024-08-17T02:46:57.175247+0000","last_active":"2024-08-17T02:46:58.166353+0000","last_peered":"2024-08-17T02:46:58.166353+0000","last_clean":"2024-08-17T02:46:58.166353+0000","last_became_active":"2024-08-17T02:46:57.174995+0000","last_became_peered":"2024-08-17T02:46:57.174995+0000","last_unstale":"2024-08-17T02:46:58.166353+0000","last_undegraded":"2024-08-17T02:46:58.166353+0000","last_fullsized":"2024-08-17T02:46:58.166353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195582+0000","last_change":"2024-08-17T02:46:58.194264+0000","last_active":"2024-08-17T02:46:58.195582+0000","last_peered":"2024-08-17T02:46:58.195582+0000","last_clean":"2024-08-17T02:46:58.195582+0000","last_became_active":"2024-08-17T02:46:58.193989+0000","last_became_peered":"2024-08-17T02:46:58.193989+0000","last_unstale":"2024-08-17T02:46:58.195582+0000","last_undegraded":"2024-08-17T02:46:58.195582+0000","last_fullsized":"2024-08-17T02:46:58.195582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:15.650114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193128+0000","last_change":"2024-08-17T02:46:57.183203+0000","last_active":"2024-08-17T02:46:58.193128+0000","last_peered":"2024-08-17T02:46:58.193128+0000","last_clean":"2024-08-17T02:46:58.193128+0000","last_became_active":"2024-08-17T02:46:57.182911+0000","last_became_peered":"2024-08-17T02:46:57.182911+0000","last_unstale":"2024-08-17T02:46:58.193128+0000","last_undegraded":"2024-08-17T02:46:58.193128+0000","last_fullsized":"2024-08-17T02:46:58.193128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.180870+0000","last_change":"2024-08-17T02:46:58.176398+0000","last_active":"2024-08-17T02:46:58.180870+0000","last_peered":"2024-08-17T02:46:58.180870+0000","last_clean":"2024-08-17T02:46:58.180870+0000","last_became_active":"2024-08-17T02:46:58.175994+0000","last_became_peered":"2024-08-17T02:46:58.175994+0000","last_unstale":"2024-08-17T02:46:58.180870+0000","last_undegraded":"2024-08-17T02:46:58.180870+0000","last_fullsized":"2024-08-17T02:46:58.180870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:38.320238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.170599+0000","last_change":"2024-08-17T02:46:57.186114+0000","last_active":"2024-08-17T02:46:58.170599+0000","last_peered":"2024-08-17T02:46:58.170599+0000","last_clean":"2024-08-17T02:46:58.170599+0000","last_became_active":"2024-08-17T02:46:57.185841+0000","last_became_peered":"2024-08-17T02:46:57.185841+0000","last_unstale":"2024-08-17T02:46:58.170599+0000","last_undegraded":"2024-08-17T02:46:58.170599+0000","last_fullsized":"2024-08-17T02:46:58.170599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193621+0000","last_change":"2024-08-17T02:46:58.184905+0000","last_active":"2024-08-17T02:46:58.193621+0000","last_peered":"2024-08-17T02:46:58.193621+0000","last_clean":"2024-08-17T02:46:58.193621+0000","last_became_active":"2024-08-17T02:46:58.184603+0000","last_became_peered":"2024-08-17T02:46:58.184603+0000","last_unstale":"2024-08-17T02:46:58.193621+0000","last_undegraded":"2024-08-17T02:46:58.193621+0000","last_fullsized":"2024-08-17T02:46:58.193621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:38.127688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.163704+0000","last_change":"2024-08-17T02:46:57.172885+0000","last_active":"2024-08-17T02:46:58.163704+0000","last_peered":"2024-08-17T02:46:58.163704+0000","last_clean":"2024-08-17T02:46:58.163704+0000","last_became_active":"2024-08-17T02:46:57.172559+0000","last_became_peered":"2024-08-17T02:46:57.172559+0000","last_unstale":"2024-08-17T02:46:58.163704+0000","last_undegraded":"2024-08-17T02:46:58.163704+0000","last_fullsized":"2024-08-17T02:46:58.163704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.188438+0000","last_change":"2024-08-17T02:46:58.179610+0000","last_active":"2024-08-17T02:46:58.188438+0000","last_peered":"2024-08-17T02:46:58.188438+0000","last_clean":"2024-08-17T02:46:58.188438+0000","last_became_active":"2024-08-17T02:46:58.179261+0000","last_became_peered":"2024-08-17T02:46:58.179261+0000","last_unstale":"2024-08-17T02:46:58.188438+0000","last_undegraded":"2024-08-17T02:46:58.188438+0000","last_fullsized":"2024-08-17T02:46:58.188438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.164164+0000","last_change":"2024-08-17T02:46:57.180623+0000","last_active":"2024-08-17T02:46:58.164164+0000","last_peered":"2024-08-17T02:46:58.164164+0000","last_clean":"2024-08-17T02:46:58.164164+0000","last_became_active":"2024-08-17T02:46:57.180314+0000","last_became_peered":"2024-08-17T02:46:57.180314+0000","last_unstale":"2024-08-17T02:46:58.164164+0000","last_undegraded":"2024-08-17T02:46:58.164164+0000","last_fullsized":"2024-08-17T02:46:58.164164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191197+0000","last_change":"2024-08-17T02:46:58.185876+0000","last_active":"2024-08-17T02:46:58.191197+0000","last_peered":"2024-08-17T02:46:58.191197+0000","last_clean":"2024-08-17T02:46:58.191197+0000","last_became_active":"2024-08-17T02:46:58.184142+0000","last_became_peered":"2024-08-17T02:46:58.184142+0000","last_unstale":"2024-08-17T02:46:58.191197+0000","last_undegraded":"2024-08-17T02:46:58.191197+0000","last_fullsized":"2024-08-17T02:46:58.191197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:28.627999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195140+0000","last_change":"2024-08-17T02:46:57.189083+0000","last_active":"2024-08-17T02:46:58.195140+0000","last_peered":"2024-08-17T02:46:58.195140+0000","last_clean":"2024-08-17T02:46:58.195140+0000","last_became_active":"2024-08-17T02:46:57.188780+0000","last_became_peered":"2024-08-17T02:46:57.188780+0000","last_unstale":"2024-08-17T02:46:58.195140+0000","last_undegraded":"2024-08-17T02:46:58.195140+0000","last_fullsized":"2024-08-17T02:46:58.195140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:51.586751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193431+0000","last_change":"2024-08-17T02:46:58.189014+0000","last_active":"2024-08-17T02:46:58.193431+0000","last_peered":"2024-08-17T02:46:58.193431+0000","last_clean":"2024-08-17T02:46:58.193431+0000","last_became_active":"2024-08-17T02:46:58.187210+0000","last_became_peered":"2024-08-17T02:46:58.187210+0000","last_unstale":"2024-08-17T02:46:58.193431+0000","last_undegraded":"2024-08-17T02:46:58.193431+0000","last_fullsized":"2024-08-17T02:46:58.193431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.198105+0000","last_change":"2024-08-17T02:46:58.184782+0000","last_active":"2024-08-17T02:46:58.198105+0000","last_peered":"2024-08-17T02:46:58.198105+0000","last_clean":"2024-08-17T02:46:58.198105+0000","last_became_active":"2024-08-17T02:46:58.184533+0000","last_became_peered":"2024-08-17T02:46:58.184533+0000","last_unstale":"2024-08-17T02:46:58.198105+0000","last_undegraded":"2024-08-17T02:46:58.198105+0000","last_fullsized":"2024-08-17T02:46:58.198105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.202042+0000","last_change":"2024-08-17T02:46:57.189298+0000","last_active":"2024-08-17T02:46:58.202042+0000","last_peered":"2024-08-17T02:46:58.202042+0000","last_clean":"2024-08-17T02:46:58.202042+0000","last_became_active":"2024-08-17T02:46:57.188971+0000","last_became_peered":"2024-08-17T02:46:57.188971+0000","last_unstale":"2024-08-17T02:46:58.202042+0000","last_undegraded":"2024-08-17T02:46:58.202042+0000","last_fullsized":"2024-08-17T02:46:58.202042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:22.700908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200097+0000","last_change":"2024-08-17T02:46:58.189815+0000","last_active":"2024-08-17T02:46:58.200097+0000","last_peered":"2024-08-17T02:46:58.200097+0000","last_clean":"2024-08-17T02:46:58.200097+0000","last_became_active":"2024-08-17T02:46:58.189556+0000","last_became_peered":"2024-08-17T02:46:58.189556+0000","last_unstale":"2024-08-17T02:46:58.200097+0000","last_undegraded":"2024-08-17T02:46:58.200097+0000","last_fullsized":"2024-08-17T02:46:58.200097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:08.556818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.194232+0000","last_change":"2024-08-17T02:46:57.188201+0000","last_active":"2024-08-17T02:46:58.194232+0000","last_peered":"2024-08-17T02:46:58.194232+0000","last_clean":"2024-08-17T02:46:58.194232+0000","last_became_active":"2024-08-17T02:46:57.187942+0000","last_became_peered":"2024-08-17T02:46:57.187942+0000","last_unstale":"2024-08-17T02:46:58.194232+0000","last_undegraded":"2024-08-17T02:46:58.194232+0000","last_fullsized":"2024-08-17T02:46:58.194232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191573+0000","last_change":"2024-08-17T02:46:58.185979+0000","last_active":"2024-08-17T02:46:58.191573+0000","last_peered":"2024-08-17T02:46:58.191573+0000","last_clean":"2024-08-17T02:46:58.191573+0000","last_became_active":"2024-08-17T02:46:58.185692+0000","last_became_peered":"2024-08-17T02:46:58.185692+0000","last_unstale":"2024-08-17T02:46:58.191573+0000","last_undegraded":"2024-08-17T02:46:58.191573+0000","last_fullsized":"2024-08-17T02:46:58.191573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:31.536609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196531+0000","last_change":"2024-08-17T02:46:57.181312+0000","last_active":"2024-08-17T02:46:58.196531+0000","last_peered":"2024-08-17T02:46:58.196531+0000","last_clean":"2024-08-17T02:46:58.196531+0000","last_became_active":"2024-08-17T02:46:57.181041+0000","last_became_peered":"2024-08-17T02:46:57.181041+0000","last_unstale":"2024-08-17T02:46:58.196531+0000","last_undegraded":"2024-08-17T02:46:58.196531+0000","last_fullsized":"2024-08-17T02:46:58.196531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:21.241911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191018+0000","last_change":"2024-08-17T02:46:58.187913+0000","last_active":"2024-08-17T02:46:58.191018+0000","last_peered":"2024-08-17T02:46:58.191018+0000","last_clean":"2024-08-17T02:46:58.191018+0000","last_became_active":"2024-08-17T02:46:58.187627+0000","last_became_peered":"2024-08-17T02:46:58.187627+0000","last_unstale":"2024-08-17T02:46:58.191018+0000","last_undegraded":"2024-08-17T02:46:58.191018+0000","last_fullsized":"2024-08-17T02:46:58.191018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:11.578823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.194605+0000","last_change":"2024-08-17T02:46:57.183697+0000","last_active":"2024-08-17T02:46:58.194605+0000","last_peered":"2024-08-17T02:46:58.194605+0000","last_clean":"2024-08-17T02:46:58.194605+0000","last_became_active":"2024-08-17T02:46:57.183438+0000","last_became_peered":"2024-08-17T02:46:57.183438+0000","last_unstale":"2024-08-17T02:46:58.194605+0000","last_undegraded":"2024-08-17T02:46:58.194605+0000","last_fullsized":"2024-08-17T02:46:58.194605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:01:09.175011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":802816,"data_stored":661592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301728,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070112,"statfs":{"total":96636764160,"available":96327794688,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301716,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070124,"statfs":{"total":96636764160,"available":96327806976,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301724,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070116,"statfs":{"total":96636764160,"available":96327798784,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302316,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069524,"statfs":{"total":96636764160,"available":96327192576,"internally_reserved":0,"allocated":811008,"data_stored":661648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:47:07.036 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:47:07.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.197+0000 7efff3400640 1 Processor -- start 2024-08-17T02:47:07.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.197+0000 7efff3400640 1 -- start start 2024-08-17T02:47:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.198+0000 7efff3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effec158d50 0x7effec0ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.198+0000 7efff3400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7effec0ac000 0x7effec0aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.198+0000 7efff3400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec0a96c0 con 0x7effec159120 2024-08-17T02:47:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.198+0000 7efff3400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec0acf00 con 0x7effec158d50 2024-08-17T02:47:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.198+0000 7efff3400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec0af7d0 con 0x7effec0ac000 2024-08-17T02:47:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.199+0000 7efff0a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effec158d50 0x7effec0ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.199+0000 7efff0a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effec158d50 0x7effec0ac4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33284/0 (socket says 172.21.15.5:33284) 2024-08-17T02:47:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.199+0000 7efff0a00640 1 -- 172.21.15.5:0/3882970662 learned_addr learned my addr 172.21.15.5:0/3882970662 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.199+0000 7efff1400640 1 --2- 172.21.15.5:0/3882970662 >> v2:172.21.15.107:3300/0 conn(0x7effec0ac000 0x7effec0aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.199+0000 7efff0a00640 1 -- 172.21.15.5:0/3882970662 >> v2:172.21.15.107:3300/0 conn(0x7effec0ac000 msgr2=0x7effec0aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.199+0000 7efff0a00640 1 --2- 172.21.15.5:0/3882970662 >> v2:172.21.15.107:3300/0 conn(0x7effec0ac000 0x7effec0aa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.199+0000 7efff0a00640 1 -- 172.21.15.5:0/3882970662 >> v1:172.21.15.107:6789/0 conn(0x7effec159120 legacy=0x7effec0ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.199+0000 7efff0a00640 1 -- 172.21.15.5:0/3882970662 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec0a98f0 con 0x7effec158d50 2024-08-17T02:47:07.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.200+0000 7efff0a00640 1 --2- 172.21.15.5:0/3882970662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec158d50 0x7effec0ac4a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7effec15c9b0 tx=0x7effe00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b7ff6b18e4e511 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:07.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.200+0000 7effeb400640 1 -- 172.21.15.5:0/3882970662 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe002add0 con 0x7effec158d50 2024-08-17T02:47:07.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.201+0000 7effeb400640 1 -- 172.21.15.5:0/3882970662 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe0032440 con 0x7effec158d50 2024-08-17T02:47:07.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.201+0000 7effeb400640 1 -- 172.21.15.5:0/3882970662 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0032820 con 0x7effec158d50 2024-08-17T02:47:07.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.201+0000 7efff3400640 1 -- 172.21.15.5:0/3882970662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec158d50 msgr2=0x7effec0ac4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.201+0000 7efff3400640 1 --2- 172.21.15.5:0/3882970662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec158d50 0x7effec0ac4a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7effec15c9b0 tx=0x7effe00091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.201+0000 7efff3400640 1 -- 172.21.15.5:0/3882970662 shutdown_connections 2024-08-17T02:47:07.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.201+0000 7efff3400640 1 --2- 172.21.15.5:0/3882970662 >> v2:172.21.15.107:3300/0 conn(0x7effec0ac000 0x7effec0aa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.201+0000 7efff3400640 1 --2- 172.21.15.5:0/3882970662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec158d50 0x7effec0ac4a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.201+0000 7efff3400640 1 -- 172.21.15.5:0/3882970662 >> 172.21.15.5:0/3882970662 conn(0x7effec095a70 msgr2=0x7effec095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:07.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.201+0000 7efff3400640 1 -- 172.21.15.5:0/3882970662 shutdown_connections 2024-08-17T02:47:07.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.201+0000 7efff3400640 1 -- 172.21.15.5:0/3882970662 wait complete. 2024-08-17T02:47:07.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.203+0000 7efff3400640 1 Processor -- start 2024-08-17T02:47:07.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.203+0000 7efff3400640 1 -- start start 2024-08-17T02:47:07.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.204+0000 7efff3400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effec0ac000 0x7effec147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.204+0000 7efff3400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effec158d50 0x7effec148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.204+0000 7efff3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec159120 0x7effec148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.204+0000 7efff3400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec1465d0 con 0x7effec159120 2024-08-17T02:47:07.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.204+0000 7efff3400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec1468b0 con 0x7effec0ac000 2024-08-17T02:47:07.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.204+0000 7efff3400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec146b90 con 0x7effec158d50 2024-08-17T02:47:07.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.204+0000 7efff1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec159120 0x7effec148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.204+0000 7efff1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec159120 0x7effec148940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33290/0 (socket says 172.21.15.5:33290) 2024-08-17T02:47:07.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.204+0000 7efff1400640 1 -- 172.21.15.5:0/3866096852 learned_addr learned my addr 172.21.15.5:0/3866096852 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:07.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.204+0000 7effebe00640 1 --2- 172.21.15.5:0/3866096852 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effec158d50 0x7effec148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.204+0000 7efff0a00640 1 --2- 172.21.15.5:0/3866096852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effec0ac000 0x7effec147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.204+0000 7efff1400640 1 -- 172.21.15.5:0/3866096852 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effec158d50 msgr2=0x7effec148400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.204+0000 7efff1400640 1 --2- 172.21.15.5:0/3866096852 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effec158d50 0x7effec148400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.204+0000 7efff1400640 1 -- 172.21.15.5:0/3866096852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effec0ac000 msgr2=0x7effec147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.204+0000 7efff1400640 1 --2- 172.21.15.5:0/3866096852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effec0ac000 0x7effec147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.204+0000 7efff1400640 1 -- 172.21.15.5:0/3866096852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe0009450 con 0x7effec159120 2024-08-17T02:47:07.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.205+0000 7efff1400640 1 --2- 172.21.15.5:0/3866096852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec159120 0x7effec148940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7effe4009ef0 tx=0x7effe400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:07.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.205+0000 7effdfe00640 1 -- 172.21.15.5:0/3866096852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe400ce10 con 0x7effec159120 2024-08-17T02:47:07.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.205+0000 7effdfe00640 1 -- 172.21.15.5:0/3866096852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe400f040 con 0x7effec159120 2024-08-17T02:47:07.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.205+0000 7effdfe00640 1 -- 172.21.15.5:0/3866096852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe40146d0 con 0x7effec159120 2024-08-17T02:47:07.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.205+0000 7efff3400640 1 -- 172.21.15.5:0/3866096852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec146e70 con 0x7effec159120 2024-08-17T02:47:07.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.205+0000 7efff3400640 1 -- 172.21.15.5:0/3866096852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec169480 con 0x7effec159120 2024-08-17T02:47:07.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.206+0000 7efff3400640 1 -- 172.21.15.5:0/3866096852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec147370 con 0x7effec159120 2024-08-17T02:47:07.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.207+0000 7effdfe00640 1 -- 172.21.15.5:0/3866096852 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7effe4014a80 con 0x7effec159120 2024-08-17T02:47:07.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.208+0000 7effdfe00640 1 --2- 172.21.15.5:0/3866096852 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7effcc065150 0x7effcc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.208+0000 7effdfe00640 1 -- 172.21.15.5:0/3866096852 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7effe4083210 con 0x7effec159120 2024-08-17T02:47:07.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.208+0000 7efff0a00640 1 --2- 172.21.15.5:0/3866096852 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7effcc065150 0x7effcc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.209+0000 7efff0a00640 1 --2- 172.21.15.5:0/3866096852 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7effcc065150 0x7effcc067600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7effe0034000 tx=0x7effe0032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:07.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.213+0000 7effdfe00640 1 -- 172.21.15.5:0/3866096852 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7effe40512e0 con 0x7effec159120 2024-08-17T02:47:07.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.393+0000 7efff3400640 1 -- 172.21.15.5:0/3866096852 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7effec063fb0 con 0x7effcc065150 2024-08-17T02:47:07.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.399+0000 7effdfe00640 1 -- 172.21.15.5:0/3866096852 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264553 (secure 0 0 0) 0x7effec063fb0 con 0x7effcc065150 2024-08-17T02:47:07.403 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:07.404 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:47:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.403+0000 7efff3400640 1 -- 172.21.15.5:0/3866096852 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7effcc065150 msgr2=0x7effcc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.403+0000 7efff3400640 1 --2- 172.21.15.5:0/3866096852 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7effcc065150 0x7effcc067600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7effe0034000 tx=0x7effe0032000 comp rx=0 tx=0).stop 2024-08-17T02:47:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.403+0000 7efff3400640 1 -- 172.21.15.5:0/3866096852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec159120 msgr2=0x7effec148940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.403+0000 7efff3400640 1 --2- 172.21.15.5:0/3866096852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec159120 0x7effec148940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7effe4009ef0 tx=0x7effe400b040 comp rx=0 tx=0).stop 2024-08-17T02:47:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.403+0000 7efff3400640 1 -- 172.21.15.5:0/3866096852 shutdown_connections 2024-08-17T02:47:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.403+0000 7efff3400640 1 --2- 172.21.15.5:0/3866096852 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7effcc065150 0x7effcc067600 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.403+0000 7efff3400640 1 --2- 172.21.15.5:0/3866096852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec159120 0x7effec148940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.403+0000 7efff3400640 1 --2- 172.21.15.5:0/3866096852 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7effec158d50 0x7effec148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.403+0000 7efff3400640 1 --2- 172.21.15.5:0/3866096852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7effec0ac000 0x7effec147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.403+0000 7efff3400640 1 -- 172.21.15.5:0/3866096852 >> 172.21.15.5:0/3866096852 conn(0x7effec095a70 msgr2=0x7effec06fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.404+0000 7efff3400640 1 -- 172.21.15.5:0/3866096852 shutdown_connections 2024-08-17T02:47:07.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.404+0000 7efff3400640 1 -- 172.21.15.5:0/3866096852 wait complete. 2024-08-17T02:47:07.419 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-17T02:47:07.055223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398352,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576368,"statfs":{"total":773094113280,"available":770638200832,"internally_reserved":0,"allocated":2891776,"data_stored":1750644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.896887"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200708+0000","last_change":"2024-08-17T02:46:58.194762+0000","last_active":"2024-08-17T02:46:58.200708+0000","last_peered":"2024-08-17T02:46:58.200708+0000","last_clean":"2024-08-17T02:46:58.200708+0000","last_became_active":"2024-08-17T02:46:58.194202+0000","last_became_peered":"2024-08-17T02:46:58.194202+0000","last_unstale":"2024-08-17T02:46:58.200708+0000","last_undegraded":"2024-08-17T02:46:58.200708+0000","last_fullsized":"2024-08-17T02:46:58.200708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:32.670412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192679+0000","last_change":"2024-08-17T02:46:58.187726+0000","last_active":"2024-08-17T02:46:58.192679+0000","last_peered":"2024-08-17T02:46:58.192679+0000","last_clean":"2024-08-17T02:46:58.192679+0000","last_became_active":"2024-08-17T02:46:58.186807+0000","last_became_peered":"2024-08-17T02:46:58.186807+0000","last_unstale":"2024-08-17T02:46:58.192679+0000","last_undegraded":"2024-08-17T02:46:58.192679+0000","last_fullsized":"2024-08-17T02:46:58.192679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.186858+0000","last_change":"2024-08-17T02:46:58.185460+0000","last_active":"2024-08-17T02:46:58.186858+0000","last_peered":"2024-08-17T02:46:58.186858+0000","last_clean":"2024-08-17T02:46:58.186858+0000","last_became_active":"2024-08-17T02:46:58.185174+0000","last_became_peered":"2024-08-17T02:46:58.185174+0000","last_unstale":"2024-08-17T02:46:58.186858+0000","last_undegraded":"2024-08-17T02:46:58.186858+0000","last_fullsized":"2024-08-17T02:46:58.186858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:38.127688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204315+0000","last_change":"2024-08-17T02:46:58.199149+0000","last_active":"2024-08-17T02:46:58.204315+0000","last_peered":"2024-08-17T02:46:58.204315+0000","last_clean":"2024-08-17T02:46:58.204315+0000","last_became_active":"2024-08-17T02:46:58.198846+0000","last_became_peered":"2024-08-17T02:46:58.198846+0000","last_unstale":"2024-08-17T02:46:58.204315+0000","last_undegraded":"2024-08-17T02:46:58.204315+0000","last_fullsized":"2024-08-17T02:46:58.204315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:32.670412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205421+0000","last_change":"2024-08-17T02:46:58.202653+0000","last_active":"2024-08-17T02:46:58.205421+0000","last_peered":"2024-08-17T02:46:58.205421+0000","last_clean":"2024-08-17T02:46:58.205421+0000","last_became_active":"2024-08-17T02:46:58.202358+0000","last_became_peered":"2024-08-17T02:46:58.202358+0000","last_unstale":"2024-08-17T02:46:58.205421+0000","last_undegraded":"2024-08-17T02:46:58.205421+0000","last_fullsized":"2024-08-17T02:46:58.205421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199883+0000","last_change":"2024-08-17T02:46:58.181154+0000","last_active":"2024-08-17T02:46:58.199883+0000","last_peered":"2024-08-17T02:46:58.199883+0000","last_clean":"2024-08-17T02:46:58.199883+0000","last_became_active":"2024-08-17T02:46:58.180861+0000","last_became_peered":"2024-08-17T02:46:58.180861+0000","last_unstale":"2024-08-17T02:46:58.199883+0000","last_undegraded":"2024-08-17T02:46:58.199883+0000","last_fullsized":"2024-08-17T02:46:58.199883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:27:30.743267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193720+0000","last_change":"2024-08-17T02:46:58.190386+0000","last_active":"2024-08-17T02:46:58.193720+0000","last_peered":"2024-08-17T02:46:58.193720+0000","last_clean":"2024-08-17T02:46:58.193720+0000","last_became_active":"2024-08-17T02:46:58.189738+0000","last_became_peered":"2024-08-17T02:46:58.189738+0000","last_unstale":"2024-08-17T02:46:58.193720+0000","last_undegraded":"2024-08-17T02:46:58.193720+0000","last_fullsized":"2024-08-17T02:46:58.193720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:15.650114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190737+0000","last_change":"2024-08-17T02:46:58.182527+0000","last_active":"2024-08-17T02:46:58.190737+0000","last_peered":"2024-08-17T02:46:58.190737+0000","last_clean":"2024-08-17T02:46:58.190737+0000","last_became_active":"2024-08-17T02:46:58.182258+0000","last_became_peered":"2024-08-17T02:46:58.182258+0000","last_unstale":"2024-08-17T02:46:58.190737+0000","last_undegraded":"2024-08-17T02:46:58.190737+0000","last_fullsized":"2024-08-17T02:46:58.190737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:27:30.743267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205404+0000","last_change":"2024-08-17T02:46:58.201855+0000","last_active":"2024-08-17T02:46:58.205404+0000","last_peered":"2024-08-17T02:46:58.205404+0000","last_clean":"2024-08-17T02:46:58.205404+0000","last_became_active":"2024-08-17T02:46:58.201590+0000","last_became_peered":"2024-08-17T02:46:58.201590+0000","last_unstale":"2024-08-17T02:46:58.205404+0000","last_undegraded":"2024-08-17T02:46:58.205404+0000","last_fullsized":"2024-08-17T02:46:58.205404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:13:53.828518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199385+0000","last_change":"2024-08-17T02:46:58.193865+0000","last_active":"2024-08-17T02:46:58.199385+0000","last_peered":"2024-08-17T02:46:58.199385+0000","last_clean":"2024-08-17T02:46:58.199385+0000","last_became_active":"2024-08-17T02:46:58.190621+0000","last_became_peered":"2024-08-17T02:46:58.190621+0000","last_unstale":"2024-08-17T02:46:58.199385+0000","last_undegraded":"2024-08-17T02:46:58.199385+0000","last_fullsized":"2024-08-17T02:46:58.199385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:31.536609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190368+0000","last_change":"2024-08-17T02:46:58.185266+0000","last_active":"2024-08-17T02:46:58.190368+0000","last_peered":"2024-08-17T02:46:58.190368+0000","last_clean":"2024-08-17T02:46:58.190368+0000","last_became_active":"2024-08-17T02:46:58.182572+0000","last_became_peered":"2024-08-17T02:46:58.182572+0000","last_unstale":"2024-08-17T02:46:58.190368+0000","last_undegraded":"2024-08-17T02:46:58.190368+0000","last_fullsized":"2024-08-17T02:46:58.190368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195597+0000","last_change":"2024-08-17T02:46:58.187586+0000","last_active":"2024-08-17T02:46:58.195597+0000","last_peered":"2024-08-17T02:46:58.195597+0000","last_clean":"2024-08-17T02:46:58.195597+0000","last_became_active":"2024-08-17T02:46:58.187335+0000","last_became_peered":"2024-08-17T02:46:58.187335+0000","last_unstale":"2024-08-17T02:46:58.195597+0000","last_undegraded":"2024-08-17T02:46:58.195597+0000","last_fullsized":"2024-08-17T02:46:58.195597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:55.602794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193574+0000","last_change":"2024-08-17T02:46:58.191084+0000","last_active":"2024-08-17T02:46:58.193574+0000","last_peered":"2024-08-17T02:46:58.193574+0000","last_clean":"2024-08-17T02:46:58.193574+0000","last_became_active":"2024-08-17T02:46:58.190785+0000","last_became_peered":"2024-08-17T02:46:58.190785+0000","last_unstale":"2024-08-17T02:46:58.193574+0000","last_undegraded":"2024-08-17T02:46:58.193574+0000","last_fullsized":"2024-08-17T02:46:58.193574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.178552+0000","last_change":"2024-08-17T02:46:58.171881+0000","last_active":"2024-08-17T02:46:58.178552+0000","last_peered":"2024-08-17T02:46:58.178552+0000","last_clean":"2024-08-17T02:46:58.178552+0000","last_became_active":"2024-08-17T02:46:58.171501+0000","last_became_peered":"2024-08-17T02:46:58.171501+0000","last_unstale":"2024-08-17T02:46:58.178552+0000","last_undegraded":"2024-08-17T02:46:58.178552+0000","last_fullsized":"2024-08-17T02:46:58.178552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:33.640796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182891+0000","last_change":"2024-08-17T02:46:58.177768+0000","last_active":"2024-08-17T02:46:58.182891+0000","last_peered":"2024-08-17T02:46:58.182891+0000","last_clean":"2024-08-17T02:46:58.182891+0000","last_became_active":"2024-08-17T02:46:58.177477+0000","last_became_peered":"2024-08-17T02:46:58.177477+0000","last_unstale":"2024-08-17T02:46:58.182891+0000","last_undegraded":"2024-08-17T02:46:58.182891+0000","last_fullsized":"2024-08-17T02:46:58.182891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:31.536609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199278+0000","last_change":"2024-08-17T02:46:58.185626+0000","last_active":"2024-08-17T02:46:58.199278+0000","last_peered":"2024-08-17T02:46:58.199278+0000","last_clean":"2024-08-17T02:46:58.199278+0000","last_became_active":"2024-08-17T02:46:58.185229+0000","last_became_peered":"2024-08-17T02:46:58.185229+0000","last_unstale":"2024-08-17T02:46:58.199278+0000","last_undegraded":"2024-08-17T02:46:58.199278+0000","last_fullsized":"2024-08-17T02:46:58.199278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:05.343969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204193+0000","last_change":"2024-08-17T02:46:58.198656+0000","last_active":"2024-08-17T02:46:58.204193+0000","last_peered":"2024-08-17T02:46:58.204193+0000","last_clean":"2024-08-17T02:46:58.204193+0000","last_became_active":"2024-08-17T02:46:58.198359+0000","last_became_peered":"2024-08-17T02:46:58.198359+0000","last_unstale":"2024-08-17T02:46:58.204193+0000","last_undegraded":"2024-08-17T02:46:58.204193+0000","last_fullsized":"2024-08-17T02:46:58.204193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:11.578823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.201567+0000","last_change":"2024-08-17T02:46:58.199727+0000","last_active":"2024-08-17T02:46:58.201567+0000","last_peered":"2024-08-17T02:46:58.201567+0000","last_clean":"2024-08-17T02:46:58.201567+0000","last_became_active":"2024-08-17T02:46:58.197375+0000","last_became_peered":"2024-08-17T02:46:58.197375+0000","last_unstale":"2024-08-17T02:46:58.201567+0000","last_undegraded":"2024-08-17T02:46:58.201567+0000","last_fullsized":"2024-08-17T02:46:58.201567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:23.710551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205376+0000","last_change":"2024-08-17T02:46:58.201834+0000","last_active":"2024-08-17T02:46:58.205376+0000","last_peered":"2024-08-17T02:46:58.205376+0000","last_clean":"2024-08-17T02:46:58.205376+0000","last_became_active":"2024-08-17T02:46:58.201441+0000","last_became_peered":"2024-08-17T02:46:58.201441+0000","last_unstale":"2024-08-17T02:46:58.205376+0000","last_undegraded":"2024-08-17T02:46:58.205376+0000","last_fullsized":"2024-08-17T02:46:58.205376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:27:30.743267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.186476+0000","last_change":"2024-08-17T02:46:58.183993+0000","last_active":"2024-08-17T02:46:58.186476+0000","last_peered":"2024-08-17T02:46:58.186476+0000","last_clean":"2024-08-17T02:46:58.186476+0000","last_became_active":"2024-08-17T02:46:58.183062+0000","last_became_peered":"2024-08-17T02:46:58.183062+0000","last_unstale":"2024-08-17T02:46:58.186476+0000","last_undegraded":"2024-08-17T02:46:58.186476+0000","last_fullsized":"2024-08-17T02:46:58.186476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182024+0000","last_change":"2024-08-17T02:46:58.179197+0000","last_active":"2024-08-17T02:46:58.182024+0000","last_peered":"2024-08-17T02:46:58.182024+0000","last_clean":"2024-08-17T02:46:58.182024+0000","last_became_active":"2024-08-17T02:46:58.178943+0000","last_became_peered":"2024-08-17T02:46:58.178943+0000","last_unstale":"2024-08-17T02:46:58.182024+0000","last_undegraded":"2024-08-17T02:46:58.182024+0000","last_fullsized":"2024-08-17T02:46:58.182024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:28.627999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200146+0000","last_change":"2024-08-17T02:46:58.193621+0000","last_active":"2024-08-17T02:46:58.200146+0000","last_peered":"2024-08-17T02:46:58.200146+0000","last_clean":"2024-08-17T02:46:58.200146+0000","last_became_active":"2024-08-17T02:46:58.193367+0000","last_became_peered":"2024-08-17T02:46:58.193367+0000","last_unstale":"2024-08-17T02:46:58.200146+0000","last_undegraded":"2024-08-17T02:46:58.200146+0000","last_fullsized":"2024-08-17T02:46:58.200146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:15.650114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.197851+0000","last_change":"2024-08-17T02:46:58.196187+0000","last_active":"2024-08-17T02:46:58.197851+0000","last_peered":"2024-08-17T02:46:58.197851+0000","last_clean":"2024-08-17T02:46:58.197851+0000","last_became_active":"2024-08-17T02:46:58.195945+0000","last_became_peered":"2024-08-17T02:46:58.195945+0000","last_unstale":"2024-08-17T02:46:58.197851+0000","last_undegraded":"2024-08-17T02:46:58.197851+0000","last_fullsized":"2024-08-17T02:46:58.197851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:33.640796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199480+0000","last_change":"2024-08-17T02:46:58.186302+0000","last_active":"2024-08-17T02:46:58.199480+0000","last_peered":"2024-08-17T02:46:58.199480+0000","last_clean":"2024-08-17T02:46:58.199480+0000","last_became_active":"2024-08-17T02:46:58.185991+0000","last_became_peered":"2024-08-17T02:46:58.185991+0000","last_unstale":"2024-08-17T02:46:58.199480+0000","last_undegraded":"2024-08-17T02:46:58.199480+0000","last_fullsized":"2024-08-17T02:46:58.199480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:27.700709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190838+0000","last_change":"2024-08-17T02:46:58.182905+0000","last_active":"2024-08-17T02:46:58.190838+0000","last_peered":"2024-08-17T02:46:58.190838+0000","last_clean":"2024-08-17T02:46:58.190838+0000","last_became_active":"2024-08-17T02:46:58.180544+0000","last_became_peered":"2024-08-17T02:46:58.180544+0000","last_unstale":"2024-08-17T02:46:58.190838+0000","last_undegraded":"2024-08-17T02:46:58.190838+0000","last_fullsized":"2024-08-17T02:46:58.190838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:34.299927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199367+0000","last_change":"2024-08-17T02:46:58.192607+0000","last_active":"2024-08-17T02:46:58.199367+0000","last_peered":"2024-08-17T02:46:58.199367+0000","last_clean":"2024-08-17T02:46:58.199367+0000","last_became_active":"2024-08-17T02:46:58.192400+0000","last_became_peered":"2024-08-17T02:46:58.192400+0000","last_unstale":"2024-08-17T02:46:58.199367+0000","last_undegraded":"2024-08-17T02:46:58.199367+0000","last_fullsized":"2024-08-17T02:46:58.199367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196626+0000","last_change":"2024-08-17T02:46:58.180251+0000","last_active":"2024-08-17T02:46:58.196626+0000","last_peered":"2024-08-17T02:46:58.196626+0000","last_clean":"2024-08-17T02:46:58.196626+0000","last_became_active":"2024-08-17T02:46:58.179999+0000","last_became_peered":"2024-08-17T02:46:58.179999+0000","last_unstale":"2024-08-17T02:46:58.196626+0000","last_undegraded":"2024-08-17T02:46:58.196626+0000","last_fullsized":"2024-08-17T02:46:58.196626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191065+0000","last_change":"2024-08-17T02:46:58.187641+0000","last_active":"2024-08-17T02:46:58.191065+0000","last_peered":"2024-08-17T02:46:58.191065+0000","last_clean":"2024-08-17T02:46:58.191065+0000","last_became_active":"2024-08-17T02:46:58.183623+0000","last_became_peered":"2024-08-17T02:46:58.183623+0000","last_unstale":"2024-08-17T02:46:58.191065+0000","last_undegraded":"2024-08-17T02:46:58.191065+0000","last_fullsized":"2024-08-17T02:46:58.191065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182583+0000","last_change":"2024-08-17T02:46:58.179841+0000","last_active":"2024-08-17T02:46:58.182583+0000","last_peered":"2024-08-17T02:46:58.182583+0000","last_clean":"2024-08-17T02:46:58.182583+0000","last_became_active":"2024-08-17T02:46:58.179424+0000","last_became_peered":"2024-08-17T02:46:58.179424+0000","last_unstale":"2024-08-17T02:46:58.182583+0000","last_undegraded":"2024-08-17T02:46:58.182583+0000","last_fullsized":"2024-08-17T02:46:58.182583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205064+0000","last_change":"2024-08-17T02:46:58.199295+0000","last_active":"2024-08-17T02:46:58.205064+0000","last_peered":"2024-08-17T02:46:58.205064+0000","last_clean":"2024-08-17T02:46:58.205064+0000","last_became_active":"2024-08-17T02:46:58.198388+0000","last_became_peered":"2024-08-17T02:46:58.198388+0000","last_unstale":"2024-08-17T02:46:58.205064+0000","last_undegraded":"2024-08-17T02:46:58.205064+0000","last_fullsized":"2024-08-17T02:46:58.205064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:20.281407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.189531+0000","last_change":"2024-08-17T02:46:58.185183+0000","last_active":"2024-08-17T02:46:58.189531+0000","last_peered":"2024-08-17T02:46:58.189531+0000","last_clean":"2024-08-17T02:46:58.189531+0000","last_became_active":"2024-08-17T02:46:58.184850+0000","last_became_peered":"2024-08-17T02:46:58.184850+0000","last_unstale":"2024-08-17T02:46:58.189531+0000","last_undegraded":"2024-08-17T02:46:58.189531+0000","last_fullsized":"2024-08-17T02:46:58.189531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:52.596395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192369+0000","last_change":"2024-08-17T02:46:58.187380+0000","last_active":"2024-08-17T02:46:58.192369+0000","last_peered":"2024-08-17T02:46:58.192369+0000","last_clean":"2024-08-17T02:46:58.192369+0000","last_became_active":"2024-08-17T02:46:58.187091+0000","last_became_peered":"2024-08-17T02:46:58.187091+0000","last_unstale":"2024-08-17T02:46:58.192369+0000","last_undegraded":"2024-08-17T02:46:58.192369+0000","last_fullsized":"2024-08-17T02:46:58.192369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:28.627999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.179200+0000","last_change":"2024-08-17T02:46:58.174376+0000","last_active":"2024-08-17T02:46:58.179200+0000","last_peered":"2024-08-17T02:46:58.179200+0000","last_clean":"2024-08-17T02:46:58.179200+0000","last_became_active":"2024-08-17T02:46:58.173432+0000","last_became_peered":"2024-08-17T02:46:58.173432+0000","last_unstale":"2024-08-17T02:46:58.179200+0000","last_undegraded":"2024-08-17T02:46:58.179200+0000","last_fullsized":"2024-08-17T02:46:58.179200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:28.364147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193762+0000","last_change":"2024-08-17T02:46:57.189925+0000","last_active":"2024-08-17T02:46:58.193762+0000","last_peered":"2024-08-17T02:46:58.193762+0000","last_clean":"2024-08-17T02:46:58.193762+0000","last_became_active":"2024-08-17T02:46:57.189656+0000","last_became_peered":"2024-08-17T02:46:57.189656+0000","last_unstale":"2024-08-17T02:46:58.193762+0000","last_undegraded":"2024-08-17T02:46:58.193762+0000","last_fullsized":"2024-08-17T02:46:58.193762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182005+0000","last_change":"2024-08-17T02:46:58.178720+0000","last_active":"2024-08-17T02:46:58.182005+0000","last_peered":"2024-08-17T02:46:58.182005+0000","last_clean":"2024-08-17T02:46:58.182005+0000","last_became_active":"2024-08-17T02:46:58.177772+0000","last_became_peered":"2024-08-17T02:46:58.177772+0000","last_unstale":"2024-08-17T02:46:58.182005+0000","last_undegraded":"2024-08-17T02:46:58.182005+0000","last_fullsized":"2024-08-17T02:46:58.182005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:34.299927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.187850+0000","last_change":"2024-08-17T02:46:57.172726+0000","last_active":"2024-08-17T02:46:58.187850+0000","last_peered":"2024-08-17T02:46:58.187850+0000","last_clean":"2024-08-17T02:46:58.187850+0000","last_became_active":"2024-08-17T02:46:57.172399+0000","last_became_peered":"2024-08-17T02:46:57.172399+0000","last_unstale":"2024-08-17T02:46:58.187850+0000","last_undegraded":"2024-08-17T02:46:58.187850+0000","last_fullsized":"2024-08-17T02:46:58.187850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.171412+0000","last_change":"2024-08-17T02:46:57.183195+0000","last_active":"2024-08-17T02:46:58.171412+0000","last_peered":"2024-08-17T02:46:58.171412+0000","last_clean":"2024-08-17T02:46:58.171412+0000","last_became_active":"2024-08-17T02:46:57.182892+0000","last_became_peered":"2024-08-17T02:46:57.182892+0000","last_unstale":"2024-08-17T02:46:58.171412+0000","last_undegraded":"2024-08-17T02:46:58.171412+0000","last_fullsized":"2024-08-17T02:46:58.171412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:03.559127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190912+0000","last_change":"2024-08-17T02:46:58.186355+0000","last_active":"2024-08-17T02:46:58.190912+0000","last_peered":"2024-08-17T02:46:58.190912+0000","last_clean":"2024-08-17T02:46:58.190912+0000","last_became_active":"2024-08-17T02:46:58.184770+0000","last_became_peered":"2024-08-17T02:46:58.184770+0000","last_unstale":"2024-08-17T02:46:58.190912+0000","last_undegraded":"2024-08-17T02:46:58.190912+0000","last_fullsized":"2024-08-17T02:46:58.190912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.174256+0000","last_change":"2024-08-17T02:46:57.182999+0000","last_active":"2024-08-17T02:46:58.174256+0000","last_peered":"2024-08-17T02:46:58.174256+0000","last_clean":"2024-08-17T02:46:58.174256+0000","last_became_active":"2024-08-17T02:46:57.182704+0000","last_became_peered":"2024-08-17T02:46:57.182704+0000","last_unstale":"2024-08-17T02:46:58.174256+0000","last_undegraded":"2024-08-17T02:46:58.174256+0000","last_fullsized":"2024-08-17T02:46:58.174256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182901+0000","last_change":"2024-08-17T02:46:58.178469+0000","last_active":"2024-08-17T02:46:58.182901+0000","last_peered":"2024-08-17T02:46:58.182901+0000","last_clean":"2024-08-17T02:46:58.182901+0000","last_became_active":"2024-08-17T02:46:58.178131+0000","last_became_peered":"2024-08-17T02:46:58.178131+0000","last_unstale":"2024-08-17T02:46:58.182901+0000","last_undegraded":"2024-08-17T02:46:58.182901+0000","last_fullsized":"2024-08-17T02:46:58.182901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.164211+0000","last_change":"2024-08-17T02:46:57.186233+0000","last_active":"2024-08-17T02:46:58.164211+0000","last_peered":"2024-08-17T02:46:58.164211+0000","last_clean":"2024-08-17T02:46:58.164211+0000","last_became_active":"2024-08-17T02:46:57.185870+0000","last_became_peered":"2024-08-17T02:46:57.185870+0000","last_unstale":"2024-08-17T02:46:58.164211+0000","last_undegraded":"2024-08-17T02:46:58.164211+0000","last_fullsized":"2024-08-17T02:46:58.164211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200162+0000","last_change":"2024-08-17T02:46:58.193886+0000","last_active":"2024-08-17T02:46:58.200162+0000","last_peered":"2024-08-17T02:46:58.200162+0000","last_clean":"2024-08-17T02:46:58.200162+0000","last_became_active":"2024-08-17T02:46:58.193601+0000","last_became_peered":"2024-08-17T02:46:58.193601+0000","last_unstale":"2024-08-17T02:46:58.200162+0000","last_undegraded":"2024-08-17T02:46:58.200162+0000","last_fullsized":"2024-08-17T02:46:58.200162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:36.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.176488+0000","last_change":"2024-08-17T02:46:57.178427+0000","last_active":"2024-08-17T02:46:58.176488+0000","last_peered":"2024-08-17T02:46:58.176488+0000","last_clean":"2024-08-17T02:46:58.176488+0000","last_became_active":"2024-08-17T02:46:57.178055+0000","last_became_peered":"2024-08-17T02:46:57.178055+0000","last_unstale":"2024-08-17T02:46:58.176488+0000","last_undegraded":"2024-08-17T02:46:58.176488+0000","last_fullsized":"2024-08-17T02:46:58.176488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.186843+0000","last_change":"2024-08-17T02:46:58.185244+0000","last_active":"2024-08-17T02:46:58.186843+0000","last_peered":"2024-08-17T02:46:58.186843+0000","last_clean":"2024-08-17T02:46:58.186843+0000","last_became_active":"2024-08-17T02:46:58.184932+0000","last_became_peered":"2024-08-17T02:46:58.184932+0000","last_unstale":"2024-08-17T02:46:58.186843+0000","last_undegraded":"2024-08-17T02:46:58.186843+0000","last_fullsized":"2024-08-17T02:46:58.186843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200246+0000","last_change":"2024-08-17T02:46:57.185013+0000","last_active":"2024-08-17T02:46:58.200246+0000","last_peered":"2024-08-17T02:46:58.200246+0000","last_clean":"2024-08-17T02:46:58.200246+0000","last_became_active":"2024-08-17T02:46:57.184784+0000","last_became_peered":"2024-08-17T02:46:57.184784+0000","last_unstale":"2024-08-17T02:46:58.200246+0000","last_undegraded":"2024-08-17T02:46:58.200246+0000","last_fullsized":"2024-08-17T02:46:58.200246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:22.700908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200848+0000","last_change":"2024-08-17T02:46:58.195407+0000","last_active":"2024-08-17T02:46:58.200848+0000","last_peered":"2024-08-17T02:46:58.200848+0000","last_clean":"2024-08-17T02:46:58.200848+0000","last_became_active":"2024-08-17T02:46:58.195124+0000","last_became_peered":"2024-08-17T02:46:58.195124+0000","last_unstale":"2024-08-17T02:46:58.200848+0000","last_undegraded":"2024-08-17T02:46:58.200848+0000","last_fullsized":"2024-08-17T02:46:58.200848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:52.596395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.202448+0000","last_change":"2024-08-17T02:46:57.187357+0000","last_active":"2024-08-17T02:46:58.202448+0000","last_peered":"2024-08-17T02:46:58.202448+0000","last_clean":"2024-08-17T02:46:58.202448+0000","last_became_active":"2024-08-17T02:46:57.187009+0000","last_became_peered":"2024-08-17T02:46:57.187009+0000","last_unstale":"2024-08-17T02:46:58.202448+0000","last_undegraded":"2024-08-17T02:46:58.202448+0000","last_fullsized":"2024-08-17T02:46:58.202448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.197087+0000","last_change":"2024-08-17T02:46:58.192814+0000","last_active":"2024-08-17T02:46:58.197087+0000","last_peered":"2024-08-17T02:46:58.197087+0000","last_clean":"2024-08-17T02:46:58.197087+0000","last_became_active":"2024-08-17T02:46:58.192555+0000","last_became_peered":"2024-08-17T02:46:58.192555+0000","last_unstale":"2024-08-17T02:46:58.197087+0000","last_undegraded":"2024-08-17T02:46:58.197087+0000","last_fullsized":"2024-08-17T02:46:58.197087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:27.700709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195065+0000","last_change":"2024-08-17T02:46:57.173067+0000","last_active":"2024-08-17T02:46:58.195065+0000","last_peered":"2024-08-17T02:46:58.195065+0000","last_clean":"2024-08-17T02:46:58.195065+0000","last_became_active":"2024-08-17T02:46:57.172758+0000","last_became_peered":"2024-08-17T02:46:57.172758+0000","last_unstale":"2024-08-17T02:46:58.195065+0000","last_undegraded":"2024-08-17T02:46:58.195065+0000","last_fullsized":"2024-08-17T02:46:58.195065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:03.559127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195519+0000","last_change":"2024-08-17T02:46:58.193978+0000","last_active":"2024-08-17T02:46:58.195519+0000","last_peered":"2024-08-17T02:46:58.195519+0000","last_clean":"2024-08-17T02:46:58.195519+0000","last_became_active":"2024-08-17T02:46:58.193769+0000","last_became_peered":"2024-08-17T02:46:58.193769+0000","last_unstale":"2024-08-17T02:46:58.195519+0000","last_undegraded":"2024-08-17T02:46:58.195519+0000","last_fullsized":"2024-08-17T02:46:58.195519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.176328+0000","last_change":"2024-08-17T02:46:57.184989+0000","last_active":"2024-08-17T02:46:58.176328+0000","last_peered":"2024-08-17T02:46:58.176328+0000","last_clean":"2024-08-17T02:46:58.176328+0000","last_became_active":"2024-08-17T02:46:57.184687+0000","last_became_peered":"2024-08-17T02:46:57.184687+0000","last_unstale":"2024-08-17T02:46:58.176328+0000","last_undegraded":"2024-08-17T02:46:58.176328+0000","last_fullsized":"2024-08-17T02:46:58.176328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195058+0000","last_change":"2024-08-17T02:46:58.190873+0000","last_active":"2024-08-17T02:46:58.195058+0000","last_peered":"2024-08-17T02:46:58.195058+0000","last_clean":"2024-08-17T02:46:58.195058+0000","last_became_active":"2024-08-17T02:46:58.190322+0000","last_became_peered":"2024-08-17T02:46:58.190322+0000","last_unstale":"2024-08-17T02:46:58.195058+0000","last_undegraded":"2024-08-17T02:46:58.195058+0000","last_fullsized":"2024-08-17T02:46:58.195058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:05.343969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.164482+0000","last_change":"2024-08-17T02:46:57.180474+0000","last_active":"2024-08-17T02:46:58.164482+0000","last_peered":"2024-08-17T02:46:58.164482+0000","last_clean":"2024-08-17T02:46:58.164482+0000","last_became_active":"2024-08-17T02:46:57.180126+0000","last_became_peered":"2024-08-17T02:46:57.180126+0000","last_unstale":"2024-08-17T02:46:58.164482+0000","last_undegraded":"2024-08-17T02:46:58.164482+0000","last_fullsized":"2024-08-17T02:46:58.164482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192352+0000","last_change":"2024-08-17T02:46:58.187354+0000","last_active":"2024-08-17T02:46:58.192352+0000","last_peered":"2024-08-17T02:46:58.192352+0000","last_clean":"2024-08-17T02:46:58.192352+0000","last_became_active":"2024-08-17T02:46:58.187061+0000","last_became_peered":"2024-08-17T02:46:58.187061+0000","last_unstale":"2024-08-17T02:46:58.192352+0000","last_undegraded":"2024-08-17T02:46:58.192352+0000","last_fullsized":"2024-08-17T02:46:58.192352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:33.640796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204507+0000","last_change":"2024-08-17T02:46:57.173178+0000","last_active":"2024-08-17T02:46:58.204507+0000","last_peered":"2024-08-17T02:46:58.204507+0000","last_clean":"2024-08-17T02:46:58.204507+0000","last_became_active":"2024-08-17T02:46:57.171399+0000","last_became_peered":"2024-08-17T02:46:57.171399+0000","last_unstale":"2024-08-17T02:46:58.204507+0000","last_undegraded":"2024-08-17T02:46:58.204507+0000","last_fullsized":"2024-08-17T02:46:58.204507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200463+0000","last_change":"2024-08-17T02:46:58.195024+0000","last_active":"2024-08-17T02:46:58.200463+0000","last_peered":"2024-08-17T02:46:58.200463+0000","last_clean":"2024-08-17T02:46:58.200463+0000","last_became_active":"2024-08-17T02:46:58.194058+0000","last_became_peered":"2024-08-17T02:46:58.194058+0000","last_unstale":"2024-08-17T02:46:58.200463+0000","last_undegraded":"2024-08-17T02:46:58.200463+0000","last_fullsized":"2024-08-17T02:46:58.200463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:36.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193533+0000","last_change":"2024-08-17T02:46:57.179217+0000","last_active":"2024-08-17T02:46:58.193533+0000","last_peered":"2024-08-17T02:46:58.193533+0000","last_clean":"2024-08-17T02:46:58.193533+0000","last_became_active":"2024-08-17T02:46:57.178894+0000","last_became_peered":"2024-08-17T02:46:57.178894+0000","last_unstale":"2024-08-17T02:46:58.193533+0000","last_undegraded":"2024-08-17T02:46:58.193533+0000","last_fullsized":"2024-08-17T02:46:58.193533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:29:23.466288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200370+0000","last_change":"2024-08-17T02:46:58.195478+0000","last_active":"2024-08-17T02:46:58.200370+0000","last_peered":"2024-08-17T02:46:58.200370+0000","last_clean":"2024-08-17T02:46:58.200370+0000","last_became_active":"2024-08-17T02:46:58.195223+0000","last_became_peered":"2024-08-17T02:46:58.195223+0000","last_unstale":"2024-08-17T02:46:58.200370+0000","last_undegraded":"2024-08-17T02:46:58.200370+0000","last_fullsized":"2024-08-17T02:46:58.200370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:20.281407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.197709+0000","last_change":"2024-08-17T02:46:57.188113+0000","last_active":"2024-08-17T02:46:58.197709+0000","last_peered":"2024-08-17T02:46:58.197709+0000","last_clean":"2024-08-17T02:46:58.197709+0000","last_became_active":"2024-08-17T02:46:57.187801+0000","last_became_peered":"2024-08-17T02:46:57.187801+0000","last_unstale":"2024-08-17T02:46:58.197709+0000","last_undegraded":"2024-08-17T02:46:58.197709+0000","last_fullsized":"2024-08-17T02:46:58.197709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:21.241911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204810+0000","last_change":"2024-08-17T02:46:58.198647+0000","last_active":"2024-08-17T02:46:58.204810+0000","last_peered":"2024-08-17T02:46:58.204810+0000","last_clean":"2024-08-17T02:46:58.204810+0000","last_became_active":"2024-08-17T02:46:58.198406+0000","last_became_peered":"2024-08-17T02:46:58.198406+0000","last_unstale":"2024-08-17T02:46:58.204810+0000","last_undegraded":"2024-08-17T02:46:58.204810+0000","last_fullsized":"2024-08-17T02:46:58.204810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:49.067728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196700+0000","last_change":"2024-08-17T02:46:57.177253+0000","last_active":"2024-08-17T02:46:58.196700+0000","last_peered":"2024-08-17T02:46:58.196700+0000","last_clean":"2024-08-17T02:46:58.196700+0000","last_became_active":"2024-08-17T02:46:57.176994+0000","last_became_peered":"2024-08-17T02:46:57.176994+0000","last_unstale":"2024-08-17T02:46:58.196700+0000","last_undegraded":"2024-08-17T02:46:58.196700+0000","last_fullsized":"2024-08-17T02:46:58.196700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:51.586751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199394+0000","last_change":"2024-08-17T02:46:58.186086+0000","last_active":"2024-08-17T02:46:58.199394+0000","last_peered":"2024-08-17T02:46:58.199394+0000","last_clean":"2024-08-17T02:46:58.199394+0000","last_became_active":"2024-08-17T02:46:58.185889+0000","last_became_peered":"2024-08-17T02:46:58.185889+0000","last_unstale":"2024-08-17T02:46:58.199394+0000","last_undegraded":"2024-08-17T02:46:58.199394+0000","last_fullsized":"2024-08-17T02:46:58.199394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:49.067728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.175925+0000","last_change":"2024-08-17T02:46:57.181595+0000","last_active":"2024-08-17T02:46:58.175925+0000","last_peered":"2024-08-17T02:46:58.175925+0000","last_clean":"2024-08-17T02:46:58.175925+0000","last_became_active":"2024-08-17T02:46:57.181288+0000","last_became_peered":"2024-08-17T02:46:57.181288+0000","last_unstale":"2024-08-17T02:46:58.175925+0000","last_undegraded":"2024-08-17T02:46:58.175925+0000","last_fullsized":"2024-08-17T02:46:58.175925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:03.559127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205392+0000","last_change":"2024-08-17T02:46:58.202092+0000","last_active":"2024-08-17T02:46:58.205392+0000","last_peered":"2024-08-17T02:46:58.205392+0000","last_clean":"2024-08-17T02:46:58.205392+0000","last_became_active":"2024-08-17T02:46:58.201265+0000","last_became_peered":"2024-08-17T02:46:58.201265+0000","last_unstale":"2024-08-17T02:46:58.205392+0000","last_undegraded":"2024-08-17T02:46:58.205392+0000","last_fullsized":"2024-08-17T02:46:58.205392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:57.772457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.170897+0000","last_change":"2024-08-17T02:46:48.424689+0000","last_active":"2024-08-17T02:46:58.170897+0000","last_peered":"2024-08-17T02:46:58.170897+0000","last_clean":"2024-08-17T02:46:58.170897+0000","last_became_active":"2024-08-17T02:46:48.423437+0000","last_became_peered":"2024-08-17T02:46:48.423437+0000","last_unstale":"2024-08-17T02:46:58.170897+0000","last_undegraded":"2024-08-17T02:46:58.170897+0000","last_fullsized":"2024-08-17T02:46:58.170897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.106569+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:50.533980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.168621+0000","last_change":"2024-08-17T02:46:57.171177+0000","last_active":"2024-08-17T02:46:58.168621+0000","last_peered":"2024-08-17T02:46:58.168621+0000","last_clean":"2024-08-17T02:46:58.168621+0000","last_became_active":"2024-08-17T02:46:57.170458+0000","last_became_peered":"2024-08-17T02:46:57.170458+0000","last_unstale":"2024-08-17T02:46:58.168621+0000","last_undegraded":"2024-08-17T02:46:58.168621+0000","last_fullsized":"2024-08-17T02:46:58.168621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196422+0000","last_change":"2024-08-17T02:46:58.195312+0000","last_active":"2024-08-17T02:46:58.196422+0000","last_peered":"2024-08-17T02:46:58.196422+0000","last_clean":"2024-08-17T02:46:58.196422+0000","last_became_active":"2024-08-17T02:46:58.195014+0000","last_became_peered":"2024-08-17T02:46:58.195014+0000","last_unstale":"2024-08-17T02:46:58.196422+0000","last_undegraded":"2024-08-17T02:46:58.196422+0000","last_fullsized":"2024-08-17T02:46:58.196422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:08.556818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.170788+0000","last_change":"2024-08-17T02:46:57.184842+0000","last_active":"2024-08-17T02:46:58.170788+0000","last_peered":"2024-08-17T02:46:58.170788+0000","last_clean":"2024-08-17T02:46:58.170788+0000","last_became_active":"2024-08-17T02:46:57.184291+0000","last_became_peered":"2024-08-17T02:46:57.184291+0000","last_unstale":"2024-08-17T02:46:58.170788+0000","last_undegraded":"2024-08-17T02:46:58.170788+0000","last_fullsized":"2024-08-17T02:46:58.170788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.183117+0000","last_change":"2024-08-17T02:46:58.180783+0000","last_active":"2024-08-17T02:46:58.183117+0000","last_peered":"2024-08-17T02:46:58.183117+0000","last_clean":"2024-08-17T02:46:58.183117+0000","last_became_active":"2024-08-17T02:46:58.174973+0000","last_became_peered":"2024-08-17T02:46:58.174973+0000","last_unstale":"2024-08-17T02:46:58.183117+0000","last_undegraded":"2024-08-17T02:46:58.183117+0000","last_fullsized":"2024-08-17T02:46:58.183117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.176827+0000","last_change":"2024-08-17T02:46:57.184122+0000","last_active":"2024-08-17T02:46:58.176827+0000","last_peered":"2024-08-17T02:46:58.176827+0000","last_clean":"2024-08-17T02:46:58.176827+0000","last_became_active":"2024-08-17T02:46:57.183807+0000","last_became_peered":"2024-08-17T02:46:57.183807+0000","last_unstale":"2024-08-17T02:46:58.176827+0000","last_undegraded":"2024-08-17T02:46:58.176827+0000","last_fullsized":"2024-08-17T02:46:58.176827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.203872+0000","last_change":"2024-08-17T02:46:58.202695+0000","last_active":"2024-08-17T02:46:58.203872+0000","last_peered":"2024-08-17T02:46:58.203872+0000","last_clean":"2024-08-17T02:46:58.203872+0000","last_became_active":"2024-08-17T02:46:58.201153+0000","last_became_peered":"2024-08-17T02:46:58.201153+0000","last_unstale":"2024-08-17T02:46:58.203872+0000","last_undegraded":"2024-08-17T02:46:58.203872+0000","last_fullsized":"2024-08-17T02:46:58.203872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:34.299927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.175573+0000","last_change":"2024-08-17T02:46:57.172754+0000","last_active":"2024-08-17T02:46:58.175573+0000","last_peered":"2024-08-17T02:46:58.175573+0000","last_clean":"2024-08-17T02:46:58.175573+0000","last_became_active":"2024-08-17T02:46:57.172534+0000","last_became_peered":"2024-08-17T02:46:57.172534+0000","last_unstale":"2024-08-17T02:46:58.175573+0000","last_undegraded":"2024-08-17T02:46:58.175573+0000","last_fullsized":"2024-08-17T02:46:58.175573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192797+0000","last_change":"2024-08-17T02:46:58.184673+0000","last_active":"2024-08-17T02:46:58.192797+0000","last_peered":"2024-08-17T02:46:58.192797+0000","last_clean":"2024-08-17T02:46:58.192797+0000","last_became_active":"2024-08-17T02:46:58.184365+0000","last_became_peered":"2024-08-17T02:46:58.184365+0000","last_unstale":"2024-08-17T02:46:58.192797+0000","last_undegraded":"2024-08-17T02:46:58.192797+0000","last_fullsized":"2024-08-17T02:46:58.192797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:18.212612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.165816+0000","last_change":"2024-08-17T02:46:57.172721+0000","last_active":"2024-08-17T02:46:58.165816+0000","last_peered":"2024-08-17T02:46:58.165816+0000","last_clean":"2024-08-17T02:46:58.165816+0000","last_became_active":"2024-08-17T02:46:57.172414+0000","last_became_peered":"2024-08-17T02:46:57.172414+0000","last_unstale":"2024-08-17T02:46:58.165816+0000","last_undegraded":"2024-08-17T02:46:58.165816+0000","last_fullsized":"2024-08-17T02:46:58.165816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204268+0000","last_change":"2024-08-17T02:46:58.199050+0000","last_active":"2024-08-17T02:46:58.204268+0000","last_peered":"2024-08-17T02:46:58.204268+0000","last_clean":"2024-08-17T02:46:58.204268+0000","last_became_active":"2024-08-17T02:46:58.198795+0000","last_became_peered":"2024-08-17T02:46:58.198795+0000","last_unstale":"2024-08-17T02:46:58.204268+0000","last_undegraded":"2024-08-17T02:46:58.204268+0000","last_fullsized":"2024-08-17T02:46:58.204268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.181818+0000","last_change":"2024-08-17T02:46:57.186077+0000","last_active":"2024-08-17T02:46:58.181818+0000","last_peered":"2024-08-17T02:46:58.181818+0000","last_clean":"2024-08-17T02:46:58.181818+0000","last_became_active":"2024-08-17T02:46:57.185671+0000","last_became_peered":"2024-08-17T02:46:57.185671+0000","last_unstale":"2024-08-17T02:46:58.181818+0000","last_undegraded":"2024-08-17T02:46:58.181818+0000","last_fullsized":"2024-08-17T02:46:58.181818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:37.118045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.201382+0000","last_change":"2024-08-17T02:46:58.199398+0000","last_active":"2024-08-17T02:46:58.201382+0000","last_peered":"2024-08-17T02:46:58.201382+0000","last_clean":"2024-08-17T02:46:58.201382+0000","last_became_active":"2024-08-17T02:46:58.199075+0000","last_became_peered":"2024-08-17T02:46:58.199075+0000","last_unstale":"2024-08-17T02:46:58.201382+0000","last_undegraded":"2024-08-17T02:46:58.201382+0000","last_fullsized":"2024-08-17T02:46:58.201382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:59.180451+0000","last_change":"2024-08-17T02:46:57.175247+0000","last_active":"2024-08-17T02:46:59.180451+0000","last_peered":"2024-08-17T02:46:59.180451+0000","last_clean":"2024-08-17T02:46:59.180451+0000","last_became_active":"2024-08-17T02:46:57.174995+0000","last_became_peered":"2024-08-17T02:46:57.174995+0000","last_unstale":"2024-08-17T02:46:59.180451+0000","last_undegraded":"2024-08-17T02:46:59.180451+0000","last_fullsized":"2024-08-17T02:46:59.180451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195582+0000","last_change":"2024-08-17T02:46:58.194264+0000","last_active":"2024-08-17T02:46:58.195582+0000","last_peered":"2024-08-17T02:46:58.195582+0000","last_clean":"2024-08-17T02:46:58.195582+0000","last_became_active":"2024-08-17T02:46:58.193989+0000","last_became_peered":"2024-08-17T02:46:58.193989+0000","last_unstale":"2024-08-17T02:46:58.195582+0000","last_undegraded":"2024-08-17T02:46:58.195582+0000","last_fullsized":"2024-08-17T02:46:58.195582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:15.650114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193128+0000","last_change":"2024-08-17T02:46:57.183203+0000","last_active":"2024-08-17T02:46:58.193128+0000","last_peered":"2024-08-17T02:46:58.193128+0000","last_clean":"2024-08-17T02:46:58.193128+0000","last_became_active":"2024-08-17T02:46:57.182911+0000","last_became_peered":"2024-08-17T02:46:57.182911+0000","last_unstale":"2024-08-17T02:46:58.193128+0000","last_undegraded":"2024-08-17T02:46:58.193128+0000","last_fullsized":"2024-08-17T02:46:58.193128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.180870+0000","last_change":"2024-08-17T02:46:58.176398+0000","last_active":"2024-08-17T02:46:58.180870+0000","last_peered":"2024-08-17T02:46:58.180870+0000","last_clean":"2024-08-17T02:46:58.180870+0000","last_became_active":"2024-08-17T02:46:58.175994+0000","last_became_peered":"2024-08-17T02:46:58.175994+0000","last_unstale":"2024-08-17T02:46:58.180870+0000","last_undegraded":"2024-08-17T02:46:58.180870+0000","last_fullsized":"2024-08-17T02:46:58.180870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:38.320238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.170599+0000","last_change":"2024-08-17T02:46:57.186114+0000","last_active":"2024-08-17T02:46:58.170599+0000","last_peered":"2024-08-17T02:46:58.170599+0000","last_clean":"2024-08-17T02:46:58.170599+0000","last_became_active":"2024-08-17T02:46:57.185841+0000","last_became_peered":"2024-08-17T02:46:57.185841+0000","last_unstale":"2024-08-17T02:46:58.170599+0000","last_undegraded":"2024-08-17T02:46:58.170599+0000","last_fullsized":"2024-08-17T02:46:58.170599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193621+0000","last_change":"2024-08-17T02:46:58.184905+0000","last_active":"2024-08-17T02:46:58.193621+0000","last_peered":"2024-08-17T02:46:58.193621+0000","last_clean":"2024-08-17T02:46:58.193621+0000","last_became_active":"2024-08-17T02:46:58.184603+0000","last_became_peered":"2024-08-17T02:46:58.184603+0000","last_unstale":"2024-08-17T02:46:58.193621+0000","last_undegraded":"2024-08-17T02:46:58.193621+0000","last_fullsized":"2024-08-17T02:46:58.193621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:38.127688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.163704+0000","last_change":"2024-08-17T02:46:57.172885+0000","last_active":"2024-08-17T02:46:58.163704+0000","last_peered":"2024-08-17T02:46:58.163704+0000","last_clean":"2024-08-17T02:46:58.163704+0000","last_became_active":"2024-08-17T02:46:57.172559+0000","last_became_peered":"2024-08-17T02:46:57.172559+0000","last_unstale":"2024-08-17T02:46:58.163704+0000","last_undegraded":"2024-08-17T02:46:58.163704+0000","last_fullsized":"2024-08-17T02:46:58.163704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.188438+0000","last_change":"2024-08-17T02:46:58.179610+0000","last_active":"2024-08-17T02:46:58.188438+0000","last_peered":"2024-08-17T02:46:58.188438+0000","last_clean":"2024-08-17T02:46:58.188438+0000","last_became_active":"2024-08-17T02:46:58.179261+0000","last_became_peered":"2024-08-17T02:46:58.179261+0000","last_unstale":"2024-08-17T02:46:58.188438+0000","last_undegraded":"2024-08-17T02:46:58.188438+0000","last_fullsized":"2024-08-17T02:46:58.188438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.164164+0000","last_change":"2024-08-17T02:46:57.180623+0000","last_active":"2024-08-17T02:46:58.164164+0000","last_peered":"2024-08-17T02:46:58.164164+0000","last_clean":"2024-08-17T02:46:58.164164+0000","last_became_active":"2024-08-17T02:46:57.180314+0000","last_became_peered":"2024-08-17T02:46:57.180314+0000","last_unstale":"2024-08-17T02:46:58.164164+0000","last_undegraded":"2024-08-17T02:46:58.164164+0000","last_fullsized":"2024-08-17T02:46:58.164164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191197+0000","last_change":"2024-08-17T02:46:58.185876+0000","last_active":"2024-08-17T02:46:58.191197+0000","last_peered":"2024-08-17T02:46:58.191197+0000","last_clean":"2024-08-17T02:46:58.191197+0000","last_became_active":"2024-08-17T02:46:58.184142+0000","last_became_peered":"2024-08-17T02:46:58.184142+0000","last_unstale":"2024-08-17T02:46:58.191197+0000","last_undegraded":"2024-08-17T02:46:58.191197+0000","last_fullsized":"2024-08-17T02:46:58.191197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:28.627999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195140+0000","last_change":"2024-08-17T02:46:57.189083+0000","last_active":"2024-08-17T02:46:58.195140+0000","last_peered":"2024-08-17T02:46:58.195140+0000","last_clean":"2024-08-17T02:46:58.195140+0000","last_became_active":"2024-08-17T02:46:57.188780+0000","last_became_peered":"2024-08-17T02:46:57.188780+0000","last_unstale":"2024-08-17T02:46:58.195140+0000","last_undegraded":"2024-08-17T02:46:58.195140+0000","last_fullsized":"2024-08-17T02:46:58.195140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:51.586751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193431+0000","last_change":"2024-08-17T02:46:58.189014+0000","last_active":"2024-08-17T02:46:58.193431+0000","last_peered":"2024-08-17T02:46:58.193431+0000","last_clean":"2024-08-17T02:46:58.193431+0000","last_became_active":"2024-08-17T02:46:58.187210+0000","last_became_peered":"2024-08-17T02:46:58.187210+0000","last_unstale":"2024-08-17T02:46:58.193431+0000","last_undegraded":"2024-08-17T02:46:58.193431+0000","last_fullsized":"2024-08-17T02:46:58.193431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.198105+0000","last_change":"2024-08-17T02:46:58.184782+0000","last_active":"2024-08-17T02:46:58.198105+0000","last_peered":"2024-08-17T02:46:58.198105+0000","last_clean":"2024-08-17T02:46:58.198105+0000","last_became_active":"2024-08-17T02:46:58.184533+0000","last_became_peered":"2024-08-17T02:46:58.184533+0000","last_unstale":"2024-08-17T02:46:58.198105+0000","last_undegraded":"2024-08-17T02:46:58.198105+0000","last_fullsized":"2024-08-17T02:46:58.198105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.202042+0000","last_change":"2024-08-17T02:46:57.189298+0000","last_active":"2024-08-17T02:46:58.202042+0000","last_peered":"2024-08-17T02:46:58.202042+0000","last_clean":"2024-08-17T02:46:58.202042+0000","last_became_active":"2024-08-17T02:46:57.188971+0000","last_became_peered":"2024-08-17T02:46:57.188971+0000","last_unstale":"2024-08-17T02:46:58.202042+0000","last_undegraded":"2024-08-17T02:46:58.202042+0000","last_fullsized":"2024-08-17T02:46:58.202042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:22.700908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200097+0000","last_change":"2024-08-17T02:46:58.189815+0000","last_active":"2024-08-17T02:46:58.200097+0000","last_peered":"2024-08-17T02:46:58.200097+0000","last_clean":"2024-08-17T02:46:58.200097+0000","last_became_active":"2024-08-17T02:46:58.189556+0000","last_became_peered":"2024-08-17T02:46:58.189556+0000","last_unstale":"2024-08-17T02:46:58.200097+0000","last_undegraded":"2024-08-17T02:46:58.200097+0000","last_fullsized":"2024-08-17T02:46:58.200097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:08.556818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.194232+0000","last_change":"2024-08-17T02:46:57.188201+0000","last_active":"2024-08-17T02:46:58.194232+0000","last_peered":"2024-08-17T02:46:58.194232+0000","last_clean":"2024-08-17T02:46:58.194232+0000","last_became_active":"2024-08-17T02:46:57.187942+0000","last_became_peered":"2024-08-17T02:46:57.187942+0000","last_unstale":"2024-08-17T02:46:58.194232+0000","last_undegraded":"2024-08-17T02:46:58.194232+0000","last_fullsized":"2024-08-17T02:46:58.194232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191573+0000","last_change":"2024-08-17T02:46:58.185979+0000","last_active":"2024-08-17T02:46:58.191573+0000","last_peered":"2024-08-17T02:46:58.191573+0000","last_clean":"2024-08-17T02:46:58.191573+0000","last_became_active":"2024-08-17T02:46:58.185692+0000","last_became_peered":"2024-08-17T02:46:58.185692+0000","last_unstale":"2024-08-17T02:46:58.191573+0000","last_undegraded":"2024-08-17T02:46:58.191573+0000","last_fullsized":"2024-08-17T02:46:58.191573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:31.536609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196531+0000","last_change":"2024-08-17T02:46:57.181312+0000","last_active":"2024-08-17T02:46:58.196531+0000","last_peered":"2024-08-17T02:46:58.196531+0000","last_clean":"2024-08-17T02:46:58.196531+0000","last_became_active":"2024-08-17T02:46:57.181041+0000","last_became_peered":"2024-08-17T02:46:57.181041+0000","last_unstale":"2024-08-17T02:46:58.196531+0000","last_undegraded":"2024-08-17T02:46:58.196531+0000","last_fullsized":"2024-08-17T02:46:58.196531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:21.241911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191018+0000","last_change":"2024-08-17T02:46:58.187913+0000","last_active":"2024-08-17T02:46:58.191018+0000","last_peered":"2024-08-17T02:46:58.191018+0000","last_clean":"2024-08-17T02:46:58.191018+0000","last_became_active":"2024-08-17T02:46:58.187627+0000","last_became_peered":"2024-08-17T02:46:58.187627+0000","last_unstale":"2024-08-17T02:46:58.191018+0000","last_undegraded":"2024-08-17T02:46:58.191018+0000","last_fullsized":"2024-08-17T02:46:58.191018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:11.578823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.194605+0000","last_change":"2024-08-17T02:46:57.183697+0000","last_active":"2024-08-17T02:46:58.194605+0000","last_peered":"2024-08-17T02:46:58.194605+0000","last_clean":"2024-08-17T02:46:58.194605+0000","last_became_active":"2024-08-17T02:46:57.183438+0000","last_became_peered":"2024-08-17T02:46:57.183438+0000","last_unstale":"2024-08-17T02:46:58.194605+0000","last_undegraded":"2024-08-17T02:46:58.194605+0000","last_fullsized":"2024-08-17T02:46:58.194605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:01:09.175011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":802816,"data_stored":661592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301728,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070112,"statfs":{"total":96636764160,"available":96327794688,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.704}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301716,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070124,"statfs":{"total":96636764160,"available":96327806976,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301724,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070116,"statfs":{"total":96636764160,"available":96327798784,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302316,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069524,"statfs":{"total":96636764160,"available":96327192576,"internally_reserved":0,"allocated":811008,"data_stored":661648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:47:07.423 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:47:07.424 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:47:07.424 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:47:07.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:47:07.424 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:47:07.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.610+0000 7f1e4f200640 1 Processor -- start 2024-08-17T02:47:07.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.611+0000 7f1e4f200640 1 -- start start 2024-08-17T02:47:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.612+0000 7f1e4f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e50156f90 0x7f1e500b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.612+0000 7f1e4f200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1e5015a590 0x7f1e5013fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.612+0000 7f1e4f200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5006d7c0 con 0x7f1e500b0e30 2024-08-17T02:47:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.612+0000 7f1e4f200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e5015ab30 con 0x7f1e5015a590 2024-08-17T02:47:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.612+0000 7f1e4f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5015ae10 con 0x7f1e50156f90 2024-08-17T02:47:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.612+0000 7f1e47e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e50156f90 0x7f1e500b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.612+0000 7f1e47e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e50156f90 0x7f1e500b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:59062/0 (socket says 172.21.15.5:59062) 2024-08-17T02:47:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.612+0000 7f1e47e00640 1 -- 172.21.15.5:0/3823846717 learned_addr learned my addr 172.21.15.5:0/3823846717 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.612+0000 7f1e4e800640 1 --2- 172.21.15.5:0/3823846717 >> v2:172.21.15.107:3300/0 conn(0x7f1e5015a590 0x7f1e5013fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.613+0000 7f1e47e00640 1 -- 172.21.15.5:0/3823846717 >> v2:172.21.15.107:3300/0 conn(0x7f1e5015a590 msgr2=0x7f1e5013fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.613+0000 7f1e47e00640 1 --2- 172.21.15.5:0/3823846717 >> v2:172.21.15.107:3300/0 conn(0x7f1e5015a590 0x7f1e5013fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.613+0000 7f1e47e00640 1 -- 172.21.15.5:0/3823846717 >> v1:172.21.15.107:6789/0 conn(0x7f1e500b0e30 legacy=0x7f1e500cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.613+0000 7f1e47e00640 1 -- 172.21.15.5:0/3823846717 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5015b0f0 con 0x7f1e50156f90 2024-08-17T02:47:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.614+0000 7f1e47e00640 1 --2- 172.21.15.5:0/3823846717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e50156f90 0x7f1e500b1200 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009910 tx=0x7f1e380091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b420416092ecabf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.614+0000 7f1e4d400640 1 -- 172.21.15.5:0/3823846717 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3802ae40 con 0x7f1e50156f90 2024-08-17T02:47:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.614+0000 7f1e4d400640 1 -- 172.21.15.5:0/3823846717 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e38032440 con 0x7f1e50156f90 2024-08-17T02:47:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.614+0000 7f1e4d400640 1 -- 172.21.15.5:0/3823846717 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38032820 con 0x7f1e50156f90 2024-08-17T02:47:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.614+0000 7f1e4f200640 1 -- 172.21.15.5:0/3823846717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e50156f90 msgr2=0x7f1e500b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.615+0000 7f1e4f200640 1 --2- 172.21.15.5:0/3823846717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e50156f90 0x7f1e500b1200 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009910 tx=0x7f1e380091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.615+0000 7f1e4f200640 1 -- 172.21.15.5:0/3823846717 shutdown_connections 2024-08-17T02:47:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.615+0000 7f1e4f200640 1 --2- 172.21.15.5:0/3823846717 >> v2:172.21.15.107:3300/0 conn(0x7f1e5015a590 0x7f1e5013fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.615+0000 7f1e4f200640 1 --2- 172.21.15.5:0/3823846717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e50156f90 0x7f1e500b1200 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.615+0000 7f1e4f200640 1 -- 172.21.15.5:0/3823846717 >> 172.21.15.5:0/3823846717 conn(0x7f1e50062af0 msgr2=0x7f1e50062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.615+0000 7f1e4f200640 1 -- 172.21.15.5:0/3823846717 shutdown_connections 2024-08-17T02:47:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.615+0000 7f1e4f200640 1 -- 172.21.15.5:0/3823846717 wait complete. 2024-08-17T02:47:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.616+0000 7f1e4f200640 1 Processor -- start 2024-08-17T02:47:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.616+0000 7f1e4f200640 1 -- start start 2024-08-17T02:47:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.617+0000 7f1e4f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e500b0e30 0x7f1e50169260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.617+0000 7f1e4f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e50156f90 0x7f1e5013e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.617+0000 7f1e4f200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e5015a590 0x7f1e50138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.617+0000 7f1e4f200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5013cf50 con 0x7f1e5015a590 2024-08-17T02:47:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.617+0000 7f1e4f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5013c2d0 con 0x7f1e500b0e30 2024-08-17T02:47:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.617+0000 7f1e4f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5013c5b0 con 0x7f1e50156f90 2024-08-17T02:47:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.617+0000 7f1e4e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e5015a590 0x7f1e50138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.617+0000 7f1e4e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e5015a590 0x7f1e50138da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33292/0 (socket says 172.21.15.5:33292) 2024-08-17T02:47:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.617+0000 7f1e4e800640 1 -- 172.21.15.5:0/1290173286 learned_addr learned my addr 172.21.15.5:0/1290173286 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.618+0000 7f1e4de00640 1 --2- 172.21.15.5:0/1290173286 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e500b0e30 0x7f1e50169260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.618+0000 7f1e47e00640 1 --2- 172.21.15.5:0/1290173286 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e50156f90 0x7f1e5013e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.618+0000 7f1e4e800640 1 -- 172.21.15.5:0/1290173286 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e50156f90 msgr2=0x7f1e5013e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.618+0000 7f1e4e800640 1 --2- 172.21.15.5:0/1290173286 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e50156f90 0x7f1e5013e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.618+0000 7f1e4e800640 1 -- 172.21.15.5:0/1290173286 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e500b0e30 msgr2=0x7f1e50169260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.618+0000 7f1e4e800640 1 --2- 172.21.15.5:0/1290173286 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e500b0e30 0x7f1e50169260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.618+0000 7f1e4e800640 1 -- 172.21.15.5:0/1290173286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e38009450 con 0x7f1e5015a590 2024-08-17T02:47:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.618+0000 7f1e47e00640 1 --2- 172.21.15.5:0/1290173286 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e50156f90 0x7f1e5013e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.618+0000 7f1e4de00640 1 --2- 172.21.15.5:0/1290173286 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e500b0e30 0x7f1e50169260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.618+0000 7f1e4e800640 1 --2- 172.21.15.5:0/1290173286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e5015a590 0x7f1e50138da0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009df0 tx=0x7f1e4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.618+0000 7f1e45600640 1 -- 172.21.15.5:0/1290173286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4800cd40 con 0x7f1e5015a590 2024-08-17T02:47:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.618+0000 7f1e45600640 1 -- 172.21.15.5:0/1290173286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4800f040 con 0x7f1e5015a590 2024-08-17T02:47:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.618+0000 7f1e4f200640 1 -- 172.21.15.5:0/1290173286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5013c890 con 0x7f1e5015a590 2024-08-17T02:47:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.618+0000 7f1e45600640 1 -- 172.21.15.5:0/1290173286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e480146d0 con 0x7f1e5015a590 2024-08-17T02:47:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.618+0000 7f1e4f200640 1 -- 172.21.15.5:0/1290173286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5013ed40 con 0x7f1e5015a590 2024-08-17T02:47:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.620+0000 7f1e4f200640 1 -- 172.21.15.5:0/1290173286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e5013ef90 con 0x7f1e5015a590 2024-08-17T02:47:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.620+0000 7f1e45600640 1 -- 172.21.15.5:0/1290173286 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1e48014a80 con 0x7f1e5015a590 2024-08-17T02:47:07.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.622+0000 7f1e45600640 1 --2- 172.21.15.5:0/1290173286 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1e2c065150 0x7f1e2c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.622+0000 7f1e45600640 1 -- 172.21.15.5:0/1290173286 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e48082ee0 con 0x7f1e5015a590 2024-08-17T02:47:07.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.622+0000 7f1e4de00640 1 --2- 172.21.15.5:0/1290173286 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1e2c065150 0x7f1e2c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.622+0000 7f1e4de00640 1 --2- 172.21.15.5:0/1290173286 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1e2c065150 0x7f1e2c067600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1e40001820 tx=0x7f1e40009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.626+0000 7f1e45600640 1 -- 172.21.15.5:0/1290173286 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1e48050f00 con 0x7f1e5015a590 2024-08-17T02:47:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.852+0000 7f1e4f200640 1 -- 172.21.15.5:0/1290173286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1e50070720 con 0x7f1e5015a590 2024-08-17T02:47:07.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.855+0000 7f1e45600640 1 -- 172.21.15.5:0/1290173286 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161021 (secure 0 0 0) 0x7f1e48054520 con 0x7f1e5015a590 2024-08-17T02:47:07.857 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.858+0000 7f1e4f200640 1 -- 172.21.15.5:0/1290173286 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1e2c065150 msgr2=0x7f1e2c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.858+0000 7f1e4f200640 1 --2- 172.21.15.5:0/1290173286 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1e2c065150 0x7f1e2c067600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1e40001820 tx=0x7f1e40009040 comp rx=0 tx=0).stop 2024-08-17T02:47:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.858+0000 7f1e4f200640 1 -- 172.21.15.5:0/1290173286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e5015a590 msgr2=0x7f1e50138da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.858+0000 7f1e4f200640 1 --2- 172.21.15.5:0/1290173286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e5015a590 0x7f1e50138da0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009df0 tx=0x7f1e4800b040 comp rx=0 tx=0).stop 2024-08-17T02:47:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.858+0000 7f1e4f200640 1 -- 172.21.15.5:0/1290173286 shutdown_connections 2024-08-17T02:47:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.858+0000 7f1e4f200640 1 --2- 172.21.15.5:0/1290173286 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1e2c065150 0x7f1e2c067600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.858+0000 7f1e4f200640 1 --2- 172.21.15.5:0/1290173286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e5015a590 0x7f1e50138da0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.858+0000 7f1e4f200640 1 --2- 172.21.15.5:0/1290173286 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1e50156f90 0x7f1e5013e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.858+0000 7f1e4f200640 1 --2- 172.21.15.5:0/1290173286 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e500b0e30 0x7f1e50169260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.858+0000 7f1e4f200640 1 -- 172.21.15.5:0/1290173286 >> 172.21.15.5:0/1290173286 conn(0x7f1e50062af0 msgr2=0x7f1e5006dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.858+0000 7f1e4f200640 1 -- 172.21.15.5:0/1290173286 shutdown_connections 2024-08-17T02:47:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:07.858+0000 7f1e4f200640 1 -- 172.21.15.5:0/1290173286 wait complete. 2024-08-17T02:47:07.873 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":36929},{"type":"v1","addr":"172.21.15.5:6833","nonce":36929}]},"active_addr":"172.21.15.5:6833/36929","active_change":"2024-08-17T02:46:39.040327+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":1256040632}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":568461839}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":948376255}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":603898409}]}]} 2024-08-17T02:47:07.876 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:47:07.877 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:47:07.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.028+0000 7fe15e400640 1 Processor -- start 2024-08-17T02:47:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.028+0000 7fe15e400640 1 -- start start 2024-08-17T02:47:08.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.029+0000 7fe15e400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe158155040 0x7fe158158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.029+0000 7fe15e400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe1581591c0 0x7fe15806e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.029+0000 7fe15e400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1580aeeb0 con 0x7fe15806e5a0 2024-08-17T02:47:08.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.029+0000 7fe15e400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe158159610 con 0x7fe1581591c0 2024-08-17T02:47:08.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.029+0000 7fe15e400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15806dee0 con 0x7fe158155040 2024-08-17T02:47:08.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.029+0000 7fe14fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe1581591c0 0x7fe15806e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.029+0000 7fe14fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe1581591c0 0x7fe15806e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33302/0 (socket says 172.21.15.5:33302) 2024-08-17T02:47:08.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.029+0000 7fe14fe00640 1 -- 172.21.15.5:0/1523373760 learned_addr learned my addr 172.21.15.5:0/1523373760 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.029+0000 7fe157400640 1 --2- 172.21.15.5:0/1523373760 >> v2:172.21.15.107:3300/0 conn(0x7fe158155040 0x7fe158158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.030+0000 7fe14fe00640 1 -- 172.21.15.5:0/1523373760 >> v2:172.21.15.107:3300/0 conn(0x7fe158155040 msgr2=0x7fe158158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.030+0000 7fe14fe00640 1 --2- 172.21.15.5:0/1523373760 >> v2:172.21.15.107:3300/0 conn(0x7fe158155040 0x7fe158158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.030+0000 7fe14fe00640 1 -- 172.21.15.5:0/1523373760 >> v1:172.21.15.107:6789/0 conn(0x7fe15806e5a0 legacy=0x7fe15806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.030+0000 7fe14fe00640 1 -- 172.21.15.5:0/1523373760 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1580aadd0 con 0x7fe1581591c0 2024-08-17T02:47:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.031+0000 7fe14fe00640 1 --2- 172.21.15.5:0/1523373760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1581591c0 0x7fe15806e060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe15806c660 tx=0x7fe1400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1503be14fd97d59 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.031+0000 7fe156a00640 1 -- 172.21.15.5:0/1523373760 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14002ad40 con 0x7fe1581591c0 2024-08-17T02:47:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.031+0000 7fe156a00640 1 -- 172.21.15.5:0/1523373760 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe140032440 con 0x7fe1581591c0 2024-08-17T02:47:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.031+0000 7fe156a00640 1 -- 172.21.15.5:0/1523373760 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14002aea0 con 0x7fe1581591c0 2024-08-17T02:47:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.031+0000 7fe15e400640 1 -- 172.21.15.5:0/1523373760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1581591c0 msgr2=0x7fe15806e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.031+0000 7fe15e400640 1 --2- 172.21.15.5:0/1523373760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1581591c0 0x7fe15806e060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe15806c660 tx=0x7fe1400091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.032+0000 7fe15e400640 1 -- 172.21.15.5:0/1523373760 shutdown_connections 2024-08-17T02:47:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.032+0000 7fe15e400640 1 --2- 172.21.15.5:0/1523373760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1581591c0 0x7fe15806e060 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.032+0000 7fe15e400640 1 --2- 172.21.15.5:0/1523373760 >> v2:172.21.15.107:3300/0 conn(0x7fe158155040 0x7fe158158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.032+0000 7fe15e400640 1 -- 172.21.15.5:0/1523373760 >> 172.21.15.5:0/1523373760 conn(0x7fe158066e60 msgr2=0x7fe158067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.032+0000 7fe15e400640 1 -- 172.21.15.5:0/1523373760 shutdown_connections 2024-08-17T02:47:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.032+0000 7fe15e400640 1 -- 172.21.15.5:0/1523373760 wait complete. 2024-08-17T02:47:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.033+0000 7fe15e400640 1 Processor -- start 2024-08-17T02:47:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.033+0000 7fe15e400640 1 -- start start 2024-08-17T02:47:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.034+0000 7fe15e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe15806e5a0 0x7fe1581563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.034+0000 7fe15e400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe158155040 0x7fe1580cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.034+0000 7fe15e400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1581591c0 0x7fe1580c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.034+0000 7fe15e400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe158156920 con 0x7fe15806e5a0 2024-08-17T02:47:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.034+0000 7fe15e400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe158159040 con 0x7fe158155040 2024-08-17T02:47:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.034+0000 7fe15e400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe158169050 con 0x7fe1581591c0 2024-08-17T02:47:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.034+0000 7fe157400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe15806e5a0 0x7fe1581563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.034+0000 7fe157400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe15806e5a0 0x7fe1581563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33308/0 (socket says 172.21.15.5:33308) 2024-08-17T02:47:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.034+0000 7fe157400640 1 -- 172.21.15.5:0/716650786 learned_addr learned my addr 172.21.15.5:0/716650786 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.035+0000 7fe14fe00640 1 --2- 172.21.15.5:0/716650786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe158155040 0x7fe1580cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.035+0000 7fe157400640 1 -- 172.21.15.5:0/716650786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1581591c0 msgr2=0x7fe1580c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.035+0000 7fe157e00640 1 --2- 172.21.15.5:0/716650786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1581591c0 0x7fe1580c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.035+0000 7fe157400640 1 --2- 172.21.15.5:0/716650786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1581591c0 0x7fe1580c07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.035+0000 7fe157400640 1 -- 172.21.15.5:0/716650786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe158155040 msgr2=0x7fe1580cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.035+0000 7fe157400640 1 --2- 172.21.15.5:0/716650786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe158155040 0x7fe1580cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.035+0000 7fe157400640 1 -- 172.21.15.5:0/716650786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe140009450 con 0x7fe15806e5a0 2024-08-17T02:47:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.035+0000 7fe14fe00640 1 --2- 172.21.15.5:0/716650786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe158155040 0x7fe1580cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.035+0000 7fe157e00640 1 --2- 172.21.15.5:0/716650786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1581591c0 0x7fe1580c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.035+0000 7fe157400640 1 --2- 172.21.15.5:0/716650786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe15806e5a0 0x7fe1581563e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe14800d8c0 tx=0x7fe148008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.035+0000 7fe14ea00640 1 -- 172.21.15.5:0/716650786 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14800de50 con 0x7fe15806e5a0 2024-08-17T02:47:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.035+0000 7fe14ea00640 1 -- 172.21.15.5:0/716650786 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14800b8d0 con 0x7fe15806e5a0 2024-08-17T02:47:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.035+0000 7fe15e400640 1 -- 172.21.15.5:0/716650786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1581573d0 con 0x7fe15806e5a0 2024-08-17T02:47:08.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.035+0000 7fe14ea00640 1 -- 172.21.15.5:0/716650786 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14800bc70 con 0x7fe15806e5a0 2024-08-17T02:47:08.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.035+0000 7fe15e400640 1 -- 172.21.15.5:0/716650786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe158156e90 con 0x7fe15806e5a0 2024-08-17T02:47:08.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.037+0000 7fe15e400640 1 -- 172.21.15.5:0/716650786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe158063fb0 con 0x7fe15806e5a0 2024-08-17T02:47:08.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.037+0000 7fe14ea00640 1 -- 172.21.15.5:0/716650786 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe148014640 con 0x7fe15806e5a0 2024-08-17T02:47:08.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.038+0000 7fe14ea00640 1 --2- 172.21.15.5:0/716650786 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe134065150 0x7fe134067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.038+0000 7fe14ea00640 1 -- 172.21.15.5:0/716650786 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe148082a80 con 0x7fe15806e5a0 2024-08-17T02:47:08.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.038+0000 7fe14fe00640 1 --2- 172.21.15.5:0/716650786 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe134065150 0x7fe134067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.039+0000 7fe14fe00640 1 --2- 172.21.15.5:0/716650786 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe134065150 0x7fe134067600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe140034000 tx=0x7fe140032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.042+0000 7fe14ea00640 1 -- 172.21.15.5:0/716650786 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe148050b40 con 0x7fe15806e5a0 2024-08-17T02:47:08.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.225+0000 7fe15e400640 1 -- 172.21.15.5:0/716650786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe158069ad0 con 0x7fe15806e5a0 2024-08-17T02:47:08.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.226+0000 7fe14ea00640 1 -- 172.21.15.5:0/716650786 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fe148054160 con 0x7fe15806e5a0 2024-08-17T02:47:08.227 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:08.227 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:59.170637+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:55.543347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:56.571235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:08.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.228+0000 7fe15e400640 1 -- 172.21.15.5:0/716650786 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe134065150 msgr2=0x7fe134067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.228+0000 7fe15e400640 1 --2- 172.21.15.5:0/716650786 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe134065150 0x7fe134067600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe140034000 tx=0x7fe140032000 comp rx=0 tx=0).stop 2024-08-17T02:47:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.228+0000 7fe15e400640 1 -- 172.21.15.5:0/716650786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe15806e5a0 msgr2=0x7fe1581563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.228+0000 7fe15e400640 1 --2- 172.21.15.5:0/716650786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe15806e5a0 0x7fe1581563e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe14800d8c0 tx=0x7fe148008040 comp rx=0 tx=0).stop 2024-08-17T02:47:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.228+0000 7fe15e400640 1 -- 172.21.15.5:0/716650786 shutdown_connections 2024-08-17T02:47:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.228+0000 7fe15e400640 1 --2- 172.21.15.5:0/716650786 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe134065150 0x7fe134067600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.228+0000 7fe15e400640 1 --2- 172.21.15.5:0/716650786 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1581591c0 0x7fe1580c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.228+0000 7fe15e400640 1 --2- 172.21.15.5:0/716650786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe158155040 0x7fe1580cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.228+0000 7fe15e400640 1 --2- 172.21.15.5:0/716650786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe15806e5a0 0x7fe1581563e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.228+0000 7fe15e400640 1 -- 172.21.15.5:0/716650786 >> 172.21.15.5:0/716650786 conn(0x7fe158066e60 msgr2=0x7fe1580ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:08.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.228+0000 7fe15e400640 1 -- 172.21.15.5:0/716650786 shutdown_connections 2024-08-17T02:47:08.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.228+0000 7fe15e400640 1 -- 172.21.15.5:0/716650786 wait complete. 2024-08-17T02:47:08.244 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:47:08.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:08.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.394+0000 7fe645800640 1 Processor -- start 2024-08-17T02:47:08.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.394+0000 7fe645800640 1 -- start start 2024-08-17T02:47:08.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.395+0000 7fe645800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe6400ad960 0x7fe64015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.395+0000 7fe645800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6400add30 0x7fe640156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.395+0000 7fe645800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64015b5e0 con 0x7fe6400ca050 2024-08-17T02:47:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.395+0000 7fe645800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6400cb160 con 0x7fe6400ad960 2024-08-17T02:47:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.395+0000 7fe645800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400b0d10 con 0x7fe6400add30 2024-08-17T02:47:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.396+0000 7fe63f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6400add30 0x7fe640156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.396+0000 7fe63ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe6400ad960 0x7fe64015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.396+0000 7fe63f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6400add30 0x7fe640156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:59098/0 (socket says 172.21.15.5:59098) 2024-08-17T02:47:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.396+0000 7fe63ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe6400ad960 0x7fe64015b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:47458/0 (socket says 172.21.15.5:47458) 2024-08-17T02:47:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.396+0000 7fe63e000640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe6400ca050 0x7fe640156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:60542/0 (socket says 172.21.15.5:60542) 2024-08-17T02:47:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.396+0000 7fe63f400640 1 -- 172.21.15.5:0/1335150594 learned_addr learned my addr 172.21.15.5:0/1335150594 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.396+0000 7fe63ea00640 1 -- 172.21.15.5:0/1335150594 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6400add30 msgr2=0x7fe640156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.396+0000 7fe63ea00640 1 --2- 172.21.15.5:0/1335150594 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6400add30 0x7fe640156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.396+0000 7fe63ea00640 1 -- 172.21.15.5:0/1335150594 >> v1:172.21.15.107:6789/0 conn(0x7fe6400ca050 legacy=0x7fe640156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.396+0000 7fe63ea00640 1 -- 172.21.15.5:0/1335150594 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6400ca550 con 0x7fe6400ad960 2024-08-17T02:47:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.396+0000 7fe63d600640 1 -- 172.21.15.5:0/1335150594 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370290155 0 0) 0x7fe62c001110 con 0x7fe6400ca050 2024-08-17T02:47:08.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.396+0000 7fe63f400640 1 --2- 172.21.15.5:0/1335150594 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6400add30 0x7fe640156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.397+0000 7fe63ea00640 1 --2- 172.21.15.5:0/1335150594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6400ad960 0x7fe64015b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe630009850 tx=0x7fe6300090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30e19519108199aa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.398+0000 7fe63d600640 1 -- 172.21.15.5:0/1335150594 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63002ae10 con 0x7fe6400ad960 2024-08-17T02:47:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.398+0000 7fe63d600640 1 -- 172.21.15.5:0/1335150594 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe630032440 con 0x7fe6400ad960 2024-08-17T02:47:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.398+0000 7fe63d600640 1 -- 172.21.15.5:0/1335150594 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6300327e0 con 0x7fe6400ad960 2024-08-17T02:47:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.398+0000 7fe645800640 1 -- 172.21.15.5:0/1335150594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6400ad960 msgr2=0x7fe64015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.398+0000 7fe645800640 1 --2- 172.21.15.5:0/1335150594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6400ad960 0x7fe64015b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe630009850 tx=0x7fe6300090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.398+0000 7fe645800640 1 -- 172.21.15.5:0/1335150594 shutdown_connections 2024-08-17T02:47:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.398+0000 7fe645800640 1 --2- 172.21.15.5:0/1335150594 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6400add30 0x7fe640156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.398+0000 7fe645800640 1 --2- 172.21.15.5:0/1335150594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6400ad960 0x7fe64015b0a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.398+0000 7fe645800640 1 -- 172.21.15.5:0/1335150594 >> 172.21.15.5:0/1335150594 conn(0x7fe640066e60 msgr2=0x7fe640067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:08.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.398+0000 7fe645800640 1 -- 172.21.15.5:0/1335150594 shutdown_connections 2024-08-17T02:47:08.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.398+0000 7fe645800640 1 -- 172.21.15.5:0/1335150594 wait complete. 2024-08-17T02:47:08.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.399+0000 7fe645800640 1 Processor -- start 2024-08-17T02:47:08.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.400+0000 7fe645800640 1 -- start start 2024-08-17T02:47:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.400+0000 7fe645800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6400ad960 0x7fe6400a97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.400+0000 7fe645800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6400add30 0x7fe6400ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.400+0000 7fe645800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6400ca050 0x7fe6400ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.400+0000 7fe645800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe640157a80 con 0x7fe6400ca050 2024-08-17T02:47:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.400+0000 7fe645800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe640157450 con 0x7fe6400add30 2024-08-17T02:47:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.400+0000 7fe645800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400aa030 con 0x7fe6400ad960 2024-08-17T02:47:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.401+0000 7fe63f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6400ca050 0x7fe6400ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.401+0000 7fe63f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6400ca050 0x7fe6400ac5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33316/0 (socket says 172.21.15.5:33316) 2024-08-17T02:47:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.401+0000 7fe63f400640 1 -- 172.21.15.5:0/2056885822 learned_addr learned my addr 172.21.15.5:0/2056885822 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.401+0000 7fe63ea00640 1 --2- 172.21.15.5:0/2056885822 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6400ad960 0x7fe6400a97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.401+0000 7fe63e000640 1 --2- 172.21.15.5:0/2056885822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6400add30 0x7fe6400ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.401+0000 7fe63f400640 1 -- 172.21.15.5:0/2056885822 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6400ad960 msgr2=0x7fe6400a97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.401+0000 7fe63f400640 1 --2- 172.21.15.5:0/2056885822 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6400ad960 0x7fe6400a97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.401+0000 7fe63f400640 1 -- 172.21.15.5:0/2056885822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6400add30 msgr2=0x7fe6400ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.401+0000 7fe63f400640 1 --2- 172.21.15.5:0/2056885822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6400add30 0x7fe6400ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.401+0000 7fe63f400640 1 -- 172.21.15.5:0/2056885822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638009ae0 con 0x7fe6400ca050 2024-08-17T02:47:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.401+0000 7fe63f400640 1 --2- 172.21.15.5:0/2056885822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6400ca050 0x7fe6400ac5b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe638009fd0 tx=0x7fe63800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.402+0000 7fe636000640 1 -- 172.21.15.5:0/2056885822 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe638018070 con 0x7fe6400ca050 2024-08-17T02:47:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.402+0000 7fe636000640 1 -- 172.21.15.5:0/2056885822 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63800f040 con 0x7fe6400ca050 2024-08-17T02:47:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.402+0000 7fe636000640 1 -- 172.21.15.5:0/2056885822 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6380092e0 con 0x7fe6400ca050 2024-08-17T02:47:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.402+0000 7fe645800640 1 -- 172.21.15.5:0/2056885822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe630009390 con 0x7fe6400ca050 2024-08-17T02:47:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.402+0000 7fe645800640 1 -- 172.21.15.5:0/2056885822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6400a9cf0 con 0x7fe6400ca050 2024-08-17T02:47:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.403+0000 7fe645800640 1 -- 172.21.15.5:0/2056885822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe640063fb0 con 0x7fe6400ca050 2024-08-17T02:47:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.404+0000 7fe636000640 1 -- 172.21.15.5:0/2056885822 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe638003020 con 0x7fe6400ca050 2024-08-17T02:47:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.405+0000 7fe636000640 1 --2- 172.21.15.5:0/2056885822 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe620065150 0x7fe620067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.405+0000 7fe636000640 1 -- 172.21.15.5:0/2056885822 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe6380829f0 con 0x7fe6400ca050 2024-08-17T02:47:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.405+0000 7fe63ea00640 1 --2- 172.21.15.5:0/2056885822 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe620065150 0x7fe620067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.405+0000 7fe63ea00640 1 --2- 172.21.15.5:0/2056885822 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe620065150 0x7fe620067600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe630034000 tx=0x7fe630032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.408+0000 7fe636000640 1 -- 172.21.15.5:0/2056885822 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe638050ac0 con 0x7fe6400ca050 2024-08-17T02:47:08.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.591+0000 7fe645800640 1 -- 172.21.15.5:0/2056885822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe64006b980 con 0x7fe6400ca050 2024-08-17T02:47:08.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.592+0000 7fe636000640 1 -- 172.21.15.5:0/2056885822 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fe6380540e0 con 0x7fe6400ca050 2024-08-17T02:47:08.592 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:08.592 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:59.170637+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:55.543347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:56.571235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:08.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.593+0000 7fe645800640 1 -- 172.21.15.5:0/2056885822 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe620065150 msgr2=0x7fe620067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.593+0000 7fe645800640 1 --2- 172.21.15.5:0/2056885822 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe620065150 0x7fe620067600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe630034000 tx=0x7fe630032000 comp rx=0 tx=0).stop 2024-08-17T02:47:08.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.593+0000 7fe645800640 1 -- 172.21.15.5:0/2056885822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6400ca050 msgr2=0x7fe6400ac5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.593+0000 7fe645800640 1 --2- 172.21.15.5:0/2056885822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6400ca050 0x7fe6400ac5b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe638009fd0 tx=0x7fe63800b040 comp rx=0 tx=0).stop 2024-08-17T02:47:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.594+0000 7fe645800640 1 -- 172.21.15.5:0/2056885822 shutdown_connections 2024-08-17T02:47:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.594+0000 7fe645800640 1 --2- 172.21.15.5:0/2056885822 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe620065150 0x7fe620067600 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.594+0000 7fe645800640 1 --2- 172.21.15.5:0/2056885822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6400ca050 0x7fe6400ac5b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.594+0000 7fe645800640 1 --2- 172.21.15.5:0/2056885822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6400add30 0x7fe6400ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.594+0000 7fe645800640 1 --2- 172.21.15.5:0/2056885822 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6400ad960 0x7fe6400a97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.594+0000 7fe645800640 1 -- 172.21.15.5:0/2056885822 >> 172.21.15.5:0/2056885822 conn(0x7fe640066e60 msgr2=0x7fe640152a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.594+0000 7fe645800640 1 -- 172.21.15.5:0/2056885822 shutdown_connections 2024-08-17T02:47:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.594+0000 7fe645800640 1 -- 172.21.15.5:0/2056885822 wait complete. 2024-08-17T02:47:08.609 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:47:08.610 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:47:08.610 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:47:08.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:47:08.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:47:08.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:47:08.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:47:08.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:47:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.885+0000 7f7aaf800640 1 Processor -- start 2024-08-17T02:47:08.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.886+0000 7f7aaf800640 1 -- start start 2024-08-17T02:47:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.888+0000 7f7aaf800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7aa80abef0 0x7f7aa806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.888+0000 7f7aaf800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7aa806dd10 0x7f7aa80b0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.888+0000 7f7aaf800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa806e170 con 0x7f7aa8067970 2024-08-17T02:47:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.888+0000 7f7aaf800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa8155860 con 0x7f7aa80abef0 2024-08-17T02:47:08.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.888+0000 7f7aaf800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa80ac4f0 con 0x7f7aa806dd10 2024-08-17T02:47:08.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.888+0000 7f7aace00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7aa8067970 0x7f7aa8159320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:60554/0 (socket says 172.21.15.5:60554) 2024-08-17T02:47:08.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.888+0000 7f7aace00640 1 -- 172.21.15.5:0/3297585299 learned_addr learned my addr 172.21.15.5:0/3297585299 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:08.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.889+0000 7f7aa7e00640 1 --2- 172.21.15.5:0/3297585299 >> v2:172.21.15.5:3300/0 conn(0x7f7aa80abef0 0x7f7aa806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.889+0000 7ff256200640 1 Processor -- start 2024-08-17T02:47:08.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.889+0000 7f7aa7400640 1 -- 172.21.15.5:0/3297585299 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133395212 0 0) 0x7f7aa0001490 con 0x7f7aa8067970 2024-08-17T02:47:08.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.889+0000 7f7aa7400640 1 -- 172.21.15.5:0/3297585299 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a8c0034e0 con 0x7f7aa8067970 2024-08-17T02:47:08.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.890+0000 7ff256200640 1 -- start start 2024-08-17T02:47:08.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.890+0000 7f8cc1400640 1 Processor -- start 2024-08-17T02:47:08.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.889+0000 7f7aad800640 1 --2- 172.21.15.5:0/3297585299 >> v2:172.21.15.107:3300/0 conn(0x7f7aa806dd10 0x7f7aa80b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.890+0000 7fb77f400640 1 Processor -- start 2024-08-17T02:47:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.890+0000 7f7aa7e00640 1 -- 172.21.15.5:0/3297585299 >> v2:172.21.15.107:3300/0 conn(0x7f7aa806dd10 msgr2=0x7f7aa80b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.890+0000 7f7aa7e00640 1 --2- 172.21.15.5:0/3297585299 >> v2:172.21.15.107:3300/0 conn(0x7f7aa806dd10 0x7f7aa80b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.890+0000 7f7aa7e00640 1 -- 172.21.15.5:0/3297585299 >> v1:172.21.15.107:6789/0 conn(0x7f7aa8067970 legacy=0x7f7aa8159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.890+0000 7f7aa7e00640 1 -- 172.21.15.5:0/3297585299 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa80ac7d0 con 0x7f7aa80abef0 2024-08-17T02:47:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.890+0000 7f8cc1400640 1 -- start start 2024-08-17T02:47:08.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.891+0000 7fb77f400640 1 -- start start 2024-08-17T02:47:08.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.891+0000 7f7aa7e00640 1 --2- 172.21.15.5:0/3297585299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa80abef0 0x7f7aa806d7d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7aa806d5d0 tx=0x7f7a940090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a16d9c49c0bd2e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.892+0000 7f8cc1400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8cbc1589e0 0x7f8cbc158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.892+0000 7f8cc1400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cbc0ca9c0 0x7f8cbc0cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.892+0000 7f8cc1400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cbc0af9a0 con 0x7f8cbc0cda30 2024-08-17T02:47:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.892+0000 7f8cc1400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cbc0af810 con 0x7f8cbc1589e0 2024-08-17T02:47:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.892+0000 7f8cc1400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc0cb310 con 0x7f8cbc0ca9c0 2024-08-17T02:47:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.893+0000 7fb77f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb77814fe00 0x7fb7780cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.893+0000 7fb77f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7780d0320 0x7fb7780ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.893+0000 7fb77f400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7780cdef0 con 0x7fb7780cca30 2024-08-17T02:47:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.893+0000 7fb77f400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7780af8e0 con 0x7fb77814fe00 2024-08-17T02:47:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.893+0000 7fb77f400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7780ccf10 con 0x7fb7780d0320 2024-08-17T02:47:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.893+0000 7f8cbb200640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8cbc0cda30 0x7f8cbc0cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:60562/0 (socket says 172.21.15.5:60562) 2024-08-17T02:47:08.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.893+0000 7f8cbb200640 1 -- 172.21.15.5:0/3785317463 learned_addr learned my addr 172.21.15.5:0/3785317463 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:08.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.892+0000 7f7aa7400640 1 -- 172.21.15.5:0/3297585299 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9402ae60 con 0x7f7aa80abef0 2024-08-17T02:47:08.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.892+0000 7f7aa7400640 1 -- 172.21.15.5:0/3297585299 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a94032440 con 0x7f7aa80abef0 2024-08-17T02:47:08.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.892+0000 7f7aa7400640 1 -- 172.21.15.5:0/3297585299 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a940327c0 con 0x7f7aa80abef0 2024-08-17T02:47:08.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.893+0000 7f7aaf800640 1 -- 172.21.15.5:0/3297585299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa80abef0 msgr2=0x7f7aa806d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.893+0000 7f7aaf800640 1 --2- 172.21.15.5:0/3297585299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa80abef0 0x7f7aa806d7d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7aa806d5d0 tx=0x7f7a940090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.893+0000 7f8cba800640 1 --2- 172.21.15.5:0/3785317463 >> v2:172.21.15.107:3300/0 conn(0x7f8cbc1589e0 0x7f8cbc158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.893+0000 7ff256200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2500cb0d0 0x7ff250158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.893+0000 7ff256200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2500af9a0 con 0x7ff2500cda30 2024-08-17T02:47:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.893+0000 7ff256200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2500ce740 con 0x7ff2501589e0 2024-08-17T02:47:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.893+0000 7ff24f400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff2501589e0 0x7ff2500ca9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:60576/0 (socket says 172.21.15.5:60576) 2024-08-17T02:47:08.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.893+0000 7ff24f400640 1 -- 172.21.15.5:0/4152205743 learned_addr learned my addr 172.21.15.5:0/4152205743 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:08.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.893+0000 7f8cb9e00640 1 --2- 172.21.15.5:0/3785317463 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cbc0ca9c0 0x7f8cbc0cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.894+0000 7f7aaf800640 1 -- 172.21.15.5:0/3297585299 shutdown_connections 2024-08-17T02:47:08.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.894+0000 7f7aaf800640 1 --2- 172.21.15.5:0/3297585299 >> v2:172.21.15.107:3300/0 conn(0x7f7aa806dd10 0x7f7aa80b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.894+0000 7f7aaf800640 1 --2- 172.21.15.5:0/3297585299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa80abef0 0x7f7aa806d7d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.894+0000 7f7aaf800640 1 -- 172.21.15.5:0/3297585299 >> 172.21.15.5:0/3297585299 conn(0x7f7aa8066e60 msgr2=0x7f7aa8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:08.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.894+0000 7f7aaf800640 1 -- 172.21.15.5:0/3297585299 shutdown_connections 2024-08-17T02:47:08.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.894+0000 7f8cba800640 1 -- 172.21.15.5:0/3785317463 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cbc0ca9c0 msgr2=0x7f8cbc0cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:08.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.894+0000 7f8cba800640 1 --2- 172.21.15.5:0/3785317463 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cbc0ca9c0 0x7f8cbc0cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.894+0000 7f8cba800640 1 -- 172.21.15.5:0/3785317463 >> v1:172.21.15.107:6789/0 conn(0x7f8cbc0cda30 legacy=0x7f8cbc0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.894+0000 7f8cba800640 1 -- 172.21.15.5:0/3785317463 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc0ce740 con 0x7f8cbc1589e0 2024-08-17T02:47:08.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.894+0000 7ff256200640 1 -- 172.21.15.5:0/4152205743 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2500af810 con 0x7ff2500cb0d0 2024-08-17T02:47:08.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.894+0000 7ff24ea00640 1 --2- 172.21.15.5:0/4152205743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2500cb0d0 0x7ff250158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.894+0000 7f7aaf800640 1 -- 172.21.15.5:0/3297585299 wait complete. 2024-08-17T02:47:08.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.894+0000 7fb77ca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb77814fe00 0x7fb7780cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.894+0000 7fb76fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb7780cca30 0x7fb7780cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42100/0 (socket says 172.21.15.5:42100) 2024-08-17T02:47:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.895+0000 7fc7a1600640 1 Processor -- start 2024-08-17T02:47:08.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.894+0000 7fb76fe00640 1 -- 172.21.15.5:0/2992705392 learned_addr learned my addr 172.21.15.5:0/2992705392 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.895+0000 7f2650800640 1 Processor -- start 2024-08-17T02:47:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.894+0000 7fb77d400640 1 --2- 172.21.15.5:0/2992705392 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7780d0320 0x7fb7780ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.895+0000 7f2650800640 1 -- start start 2024-08-17T02:47:08.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.895+0000 7fc7a1600640 1 -- start start 2024-08-17T02:47:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.895+0000 7ff24e000640 1 -- 172.21.15.5:0/4152205743 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705394127 0 0) 0x7ff2500ce740 con 0x7ff2501589e0 2024-08-17T02:47:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7fb777e00640 1 -- 172.21.15.5:0/2992705392 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404685713 0 0) 0x7fb7780cdef0 con 0x7fb7780cca30 2024-08-17T02:47:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.895+0000 7f8cba800640 1 --2- 172.21.15.5:0/3785317463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cbc1589e0 0x7f8cbc158db0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009850 tx=0x7f8ca80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b284f9a126304fd8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7f7aaf800640 1 Processor -- start 2024-08-17T02:47:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.895+0000 7ff24e000640 1 -- 172.21.15.5:0/4152205743 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2340034e0 con 0x7ff2501589e0 2024-08-17T02:47:08.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7ff24e000640 1 -- 172.21.15.5:0/4152205743 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4123151197 0 0) 0x7ff2340034e0 con 0x7ff2501589e0 2024-08-17T02:47:08.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7ff24e000640 1 -- 172.21.15.5:0/4152205743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2500cb0d0 msgr2=0x7ff250158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:08.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7ff24e000640 1 --2- 172.21.15.5:0/4152205743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2500cb0d0 0x7ff250158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7ff24e000640 1 -- 172.21.15.5:0/4152205743 >> v1:172.21.15.5:6789/0 conn(0x7ff2500cda30 legacy=0x7ff2500cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:08.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7ff24e000640 1 -- 172.21.15.5:0/4152205743 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2500cea00 con 0x7ff2501589e0 2024-08-17T02:47:08.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7ff24e000640 1 -- 172.21.15.5:0/4152205743 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7ff2480017f0 con 0x7ff2501589e0 2024-08-17T02:47:08.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7ff24e000640 1 -- 172.21.15.5:0/4152205743 >> v1:172.21.15.107:6789/0 conn(0x7ff2501589e0 legacy=0x7ff2500ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7ff24e000640 1 --2- 172.21.15.5:0/4152205743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff234003a50 0x7ff234003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7ff24e000640 1 --2- 172.21.15.5:0/4152205743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff234004780 0x7ff234004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7ff24e000640 1 --2- 172.21.15.5:0/4152205743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff234005180 0x7ff23400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7ff24e000640 1 -- 172.21.15.5:0/4152205743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2500af810 con 0x7ff234003a50 2024-08-17T02:47:08.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7ff24e000640 1 -- 172.21.15.5:0/4152205743 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23400c0a0 con 0x7ff234005180 2024-08-17T02:47:08.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7ff24e000640 1 -- 172.21.15.5:0/4152205743 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23400c260 con 0x7ff234004780 2024-08-17T02:47:08.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7fb77ca00640 1 -- 172.21.15.5:0/2992705392 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7780d0320 msgr2=0x7fb7780ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:08.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7fb77ca00640 1 --2- 172.21.15.5:0/2992705392 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7780d0320 0x7fb7780ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7fb77ca00640 1 -- 172.21.15.5:0/2992705392 >> v1:172.21.15.5:6789/0 conn(0x7fb7780cca30 legacy=0x7fb7780cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.896+0000 7fb77ca00640 1 -- 172.21.15.5:0/2992705392 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7780cdba0 con 0x7fb77814fe00 2024-08-17T02:47:08.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.897+0000 7f7aaf800640 1 -- start start 2024-08-17T02:47:08.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.897+0000 7f8cb9400640 1 -- 172.21.15.5:0/3785317463 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca802ad90 con 0x7f8cbc1589e0 2024-08-17T02:47:08.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.897+0000 7fb77d400640 1 --2- 172.21.15.5:0/2992705392 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7780d0320 0x7fb7780ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.897+0000 7ff24ea00640 1 --2- 172.21.15.5:0/4152205743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff234004780 0x7ff234004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.897+0000 7fc7a1600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc79c06dee0 0x7fc79c154e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.897+0000 7fc7a1600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c0afb80 con 0x7fc79c0abef0 2024-08-17T02:47:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.897+0000 7fc7a1600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c0ac4f0 con 0x7fc79c154a80 2024-08-17T02:47:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.897+0000 7fc7a1600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc79c0ac7d0 con 0x7fc79c06dee0 2024-08-17T02:47:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.897+0000 7ff24fe00640 1 --2- 172.21.15.5:0/4152205743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff234005180 0x7ff23400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.898+0000 7ff24f400640 1 --2- 172.21.15.5:0/4152205743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff234003a50 0x7ff234003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.897+0000 7f2650800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2648157550 0x7f26480ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.897+0000 7f2650800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2648157920 0x7f264815e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.897+0000 7f2650800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26480ac890 0x7f264806dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.897+0000 7f2650800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264815e6c0 con 0x7f2648157550 2024-08-17T02:47:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.897+0000 7f2650800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26480ab7f0 con 0x7f2648157920 2024-08-17T02:47:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.897+0000 7f2650800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26480abad0 con 0x7f26480ac890 2024-08-17T02:47:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.898+0000 7fc79b400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc79c06dee0 0x7fc79c154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.898+0000 7fc79b400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc79c06dee0 0x7fc79c154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:47494/0 (socket says 172.21.15.5:47494) 2024-08-17T02:47:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.898+0000 7fc79b400640 1 -- 172.21.15.5:0/2805503014 learned_addr learned my addr 172.21.15.5:0/2805503014 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.898+0000 7f264e800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26480ac890 0x7f264806dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.898+0000 7f264e800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26480ac890 0x7f264806dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:59150/0 (socket says 172.21.15.5:59150) 2024-08-17T02:47:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.897+0000 7f8cb9400640 1 -- 172.21.15.5:0/3785317463 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca8032440 con 0x7f8cbc1589e0 2024-08-17T02:47:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.898+0000 7f264e800640 1 -- 172.21.15.5:0/2958862147 learned_addr learned my addr 172.21.15.5:0/2958862147 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.898+0000 7f8cb9400640 1 -- 172.21.15.5:0/3785317463 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8032820 con 0x7f8cbc1589e0 2024-08-17T02:47:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.898+0000 7f264d400640 1 --2- 172.21.15.5:0/2958862147 >> v2:172.21.15.107:3300/0 conn(0x7f2648157920 0x7f264815e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7f7aaf800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7aa8067970 0x7f7aa8146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7f7aaf800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa806dd10 0x7f7aa813e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7f7aaf800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7aa80abef0 0x7f7aa813efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7f7aaf800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8145f80 con 0x7f7aa806dd10 2024-08-17T02:47:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7f7aaf800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8145370 con 0x7f7aa80abef0 2024-08-17T02:47:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7f7aaf800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8145650 con 0x7f7aa8067970 2024-08-17T02:47:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7fb77ca00640 1 --2- 172.21.15.5:0/2992705392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77814fe00 0x7fb7780cc4f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb768009850 tx=0x7fb7680090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802af48e0791aa0f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7ff24ea00640 1 -- 172.21.15.5:0/4152205743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff234005180 msgr2=0x7ff23400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7f7aace00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7aa8067970 0x7f7aa8146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7f7aace00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7aa8067970 0x7f7aa8146410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:59152/0 (socket says 172.21.15.5:59152) 2024-08-17T02:47:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7f7aace00640 1 -- 172.21.15.5:0/3780530641 learned_addr learned my addr 172.21.15.5:0/3780530641 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7f7aa7e00640 1 --2- 172.21.15.5:0/3780530641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa806dd10 0x7f7aa813e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7f7aace00640 1 -- 172.21.15.5:0/3780530641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7aa80abef0 msgr2=0x7f7aa813efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7f7aace00640 1 --2- 172.21.15.5:0/3780530641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7aa80abef0 0x7f7aa813efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7f7aace00640 1 -- 172.21.15.5:0/3780530641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa806dd10 msgr2=0x7f7aa813e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7f7aace00640 1 --2- 172.21.15.5:0/3780530641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa806dd10 0x7f7aa813e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7f7aace00640 1 -- 172.21.15.5:0/3780530641 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a94009390 con 0x7f7aa8067970 2024-08-17T02:47:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.901+0000 7f7aa7e00640 1 --2- 172.21.15.5:0/3780530641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa806dd10 0x7f7aa813e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7f8cc1400640 1 -- 172.21.15.5:0/3785317463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cbc1589e0 msgr2=0x7f8cbc158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7f8cc1400640 1 --2- 172.21.15.5:0/3785317463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cbc1589e0 0x7f8cbc158db0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009850 tx=0x7f8ca80090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7f8cc1400640 1 -- 172.21.15.5:0/3785317463 shutdown_connections 2024-08-17T02:47:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7f8cc1400640 1 --2- 172.21.15.5:0/3785317463 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cbc0ca9c0 0x7f8cbc0cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7f8cc1400640 1 --2- 172.21.15.5:0/3785317463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cbc1589e0 0x7f8cbc158db0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7f8cc1400640 1 -- 172.21.15.5:0/3785317463 >> 172.21.15.5:0/3785317463 conn(0x7f8cbc06e590 msgr2=0x7f8cbc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7f264de00640 1 --2- 172.21.15.5:0/2958862147 >> v2:172.21.15.5:3300/0 conn(0x7f2648157550 0x7f26480ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7f264d400640 1 -- 172.21.15.5:0/2958862147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26480ac890 msgr2=0x7f264806dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7f264d400640 1 --2- 172.21.15.5:0/2958862147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26480ac890 0x7f264806dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7f264d400640 1 -- 172.21.15.5:0/2958862147 >> v2:172.21.15.5:3300/0 conn(0x7f2648157550 msgr2=0x7f26480ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7f264d400640 1 --2- 172.21.15.5:0/2958862147 >> v2:172.21.15.5:3300/0 conn(0x7f2648157550 0x7f26480ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7f264d400640 1 -- 172.21.15.5:0/2958862147 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26480abdb0 con 0x7f2648157920 2024-08-17T02:47:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7f264de00640 1 --2- 172.21.15.5:0/2958862147 >> v2:172.21.15.5:3300/0 conn(0x7f2648157550 0x7f26480ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.898+0000 7fc79b400640 1 -- 172.21.15.5:0/2805503014 >> v1:172.21.15.107:6789/0 conn(0x7fc79c154a80 legacy=0x7fc79c159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.898+0000 7fc79b400640 1 -- 172.21.15.5:0/2805503014 >> v1:172.21.15.5:6789/0 conn(0x7fc79c0abef0 legacy=0x7fc79c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:08.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.898+0000 7fc79b400640 1 -- 172.21.15.5:0/2805503014 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c0acab0 con 0x7fc79c06dee0 2024-08-17T02:47:08.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7fc79b400640 1 --2- 172.21.15.5:0/2805503014 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc79c06dee0 0x7fc79c154e50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc79400d1a0 tx=0x7fc794007690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12017735f46d6bbb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7fc79a000640 1 -- 172.21.15.5:0/2805503014 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794033690 con 0x7fc79c06dee0 2024-08-17T02:47:08.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7fc79a000640 1 -- 172.21.15.5:0/2805503014 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7940337f0 con 0x7fc79c06dee0 2024-08-17T02:47:08.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7fc79a000640 1 -- 172.21.15.5:0/2805503014 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794033bd0 con 0x7fc79c06dee0 2024-08-17T02:47:08.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7ff24ea00640 1 --2- 172.21.15.5:0/4152205743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff234005180 0x7ff23400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7ff24ea00640 1 -- 172.21.15.5:0/4152205743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff234003a50 msgr2=0x7ff234003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:08.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7ff24ea00640 1 --2- 172.21.15.5:0/4152205743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff234003a50 0x7ff234003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7ff24f400640 1 --2- 172.21.15.5:0/4152205743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff234003a50 0x7ff234003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:08.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.899+0000 7ff24ea00640 1 -- 172.21.15.5:0/4152205743 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2500cea00 con 0x7ff234004780 2024-08-17T02:47:08.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.900+0000 7ff24fe00640 1 --2- 172.21.15.5:0/4152205743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff234005180 0x7ff23400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:08.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.901+0000 7fb777e00640 1 -- 172.21.15.5:0/2992705392 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76802ad20 con 0x7fb77814fe00 2024-08-17T02:47:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.901+0000 7fb777e00640 1 -- 172.21.15.5:0/2992705392 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76802ae80 con 0x7fb77814fe00 2024-08-17T02:47:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.901+0000 7fb777e00640 1 -- 172.21.15.5:0/2992705392 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768032650 con 0x7fb77814fe00 2024-08-17T02:47:08.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.901+0000 7f7aace00640 1 --2- 172.21.15.5:0/3780530641 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7aa8067970 0x7f7aa8146410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000cd30 tx=0x7f7aa0001ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.901+0000 7f8cc1400640 1 -- 172.21.15.5:0/3785317463 shutdown_connections 2024-08-17T02:47:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.901+0000 7f8cc1400640 1 -- 172.21.15.5:0/3785317463 wait complete. 2024-08-17T02:47:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.901+0000 7fc7a1600640 1 -- 172.21.15.5:0/2805503014 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc79c06dee0 msgr2=0x7fc79c154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.901+0000 7f264d400640 1 --2- 172.21.15.5:0/2958862147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2648157920 0x7f264815e180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f26480adf50 tx=0x7f263c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc075d4d5ee31316 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.901+0000 7fc7a1600640 1 --2- 172.21.15.5:0/2805503014 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc79c06dee0 0x7fc79c154e50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc79400d1a0 tx=0x7fc794007690 comp rx=0 tx=0).stop 2024-08-17T02:47:08.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.901+0000 7ff24ea00640 1 --2- 172.21.15.5:0/4152205743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff234004780 0x7ff234004bf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff250088fb0 tx=0x7ff240008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3b6770f51af251b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7fc7a1600640 1 -- 172.21.15.5:0/2805503014 shutdown_connections 2024-08-17T02:47:08.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7fc7a1600640 1 --2- 172.21.15.5:0/2805503014 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc79c06dee0 0x7fc79c154e50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7fc7a1600640 1 -- 172.21.15.5:0/2805503014 >> 172.21.15.5:0/2805503014 conn(0x7fc79c066e60 msgr2=0x7fc79c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:08.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7fb77f400640 1 -- 172.21.15.5:0/2992705392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77814fe00 msgr2=0x7fb7780cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7fb77f400640 1 --2- 172.21.15.5:0/2992705392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77814fe00 0x7fb7780cc4f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb768009850 tx=0x7fb7680090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7fb77f400640 1 -- 172.21.15.5:0/2992705392 shutdown_connections 2024-08-17T02:47:08.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7fb77f400640 1 --2- 172.21.15.5:0/2992705392 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7780d0320 0x7fb7780ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7fb77f400640 1 --2- 172.21.15.5:0/2992705392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb77814fe00 0x7fb7780cc4f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7fc7a1600640 1 -- 172.21.15.5:0/2805503014 shutdown_connections 2024-08-17T02:47:08.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7fc7a1600640 1 -- 172.21.15.5:0/2805503014 wait complete. 2024-08-17T02:47:08.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7fb77f400640 1 -- 172.21.15.5:0/2992705392 >> 172.21.15.5:0/2992705392 conn(0x7fb778068680 msgr2=0x7fb778068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7ff24e000640 1 -- 172.21.15.5:0/4152205743 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24002a6f0 con 0x7ff234004780 2024-08-17T02:47:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7fb77f400640 1 -- 172.21.15.5:0/2992705392 shutdown_connections 2024-08-17T02:47:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7f264ca00640 1 -- 172.21.15.5:0/2958862147 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c02ad00 con 0x7f2648157920 2024-08-17T02:47:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7f264ca00640 1 -- 172.21.15.5:0/2958862147 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c02ae60 con 0x7f2648157920 2024-08-17T02:47:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7f264ca00640 1 -- 172.21.15.5:0/2958862147 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c032670 con 0x7f2648157920 2024-08-17T02:47:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.901+0000 7f7a9fe00640 1 -- 172.21.15.5:0/3780530641 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa000a850 con 0x7f7aa8067970 2024-08-17T02:47:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7f7a9fe00640 1 -- 172.21.15.5:0/3780530641 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa000a9b0 con 0x7f7aa8067970 2024-08-17T02:47:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7f7a9fe00640 1 -- 172.21.15.5:0/3780530641 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa000ad70 con 0x7f7aa8067970 2024-08-17T02:47:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7ff24e000640 1 -- 172.21.15.5:0/4152205743 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24002e070 con 0x7ff234004780 2024-08-17T02:47:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7ff24e000640 1 -- 172.21.15.5:0/4152205743 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24002aac0 con 0x7ff234004780 2024-08-17T02:47:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.902+0000 7fb77f400640 1 -- 172.21.15.5:0/2992705392 wait complete. 2024-08-17T02:47:08.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.903+0000 7f7aaf800640 1 -- 172.21.15.5:0/3780530641 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa8145930 con 0x7f7aa8067970 2024-08-17T02:47:08.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.903+0000 7f7aaf800640 1 -- 172.21.15.5:0/3780530641 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa8146950 con 0x7f7aa8067970 2024-08-17T02:47:08.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.903+0000 7f8cc1400640 1 Processor -- start 2024-08-17T02:47:08.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.903+0000 7f2650800640 1 -- 172.21.15.5:0/2958862147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2648157920 msgr2=0x7f264815e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.903+0000 7f2650800640 1 --2- 172.21.15.5:0/2958862147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2648157920 0x7f264815e180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f26480adf50 tx=0x7f263c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.903+0000 7f1007a00640 1 Processor -- start 2024-08-17T02:47:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.903+0000 7f1007a00640 1 -- start start 2024-08-17T02:47:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.904+0000 7ff256200640 1 -- 172.21.15.5:0/4152205743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff234004780 msgr2=0x7ff234004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.904+0000 7ff256200640 1 --2- 172.21.15.5:0/4152205743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff234004780 0x7ff234004bf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff250088fb0 tx=0x7ff240008040 comp rx=0 tx=0).stop 2024-08-17T02:47:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.904+0000 7f2650800640 1 -- 172.21.15.5:0/2958862147 shutdown_connections 2024-08-17T02:47:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.904+0000 7f2650800640 1 --2- 172.21.15.5:0/2958862147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26480ac890 0x7f264806dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.904+0000 7fc7a1600640 1 Processor -- start 2024-08-17T02:47:08.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.904+0000 7f2650800640 1 --2- 172.21.15.5:0/2958862147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2648157920 0x7f264815e180 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.904+0000 7f2650800640 1 --2- 172.21.15.5:0/2958862147 >> v2:172.21.15.5:3300/0 conn(0x7f2648157550 0x7f26480ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.904+0000 7f2650800640 1 -- 172.21.15.5:0/2958862147 >> 172.21.15.5:0/2958862147 conn(0x7f2648067930 msgr2=0x7f26480b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.904+0000 7f8cc1400640 1 -- start start 2024-08-17T02:47:08.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.904+0000 7fb77f400640 1 Processor -- start 2024-08-17T02:47:08.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.904+0000 7f2650800640 1 -- 172.21.15.5:0/2958862147 shutdown_connections 2024-08-17T02:47:08.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.904+0000 7f2650800640 1 -- 172.21.15.5:0/2958862147 wait complete. 2024-08-17T02:47:08.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.905+0000 7ff24fe00640 1 -- 172.21.15.5:0/4152205743 reap_dead start 2024-08-17T02:47:08.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.905+0000 7fb77f400640 1 -- start start 2024-08-17T02:47:08.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.904+0000 7fc7a1600640 1 -- start start 2024-08-17T02:47:08.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.905+0000 7f1007a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f100006b8c0 0x7f10000afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.905+0000 7f7aaf800640 1 -- 172.21.15.5:0/3780530641 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7aa8063fb0 con 0x7f7aa8067970 2024-08-17T02:47:08.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.905+0000 7f1007a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10000b00c0 0x7f1000154a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.905+0000 7f1007a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10000abbe0 con 0x7f1000154fa0 2024-08-17T02:47:08.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.905+0000 7f1007a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10000b0d90 con 0x7f10000b00c0 2024-08-17T02:47:08.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.906+0000 7ff256200640 1 -- 172.21.15.5:0/4152205743 shutdown_connections 2024-08-17T02:47:08.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.906+0000 7ff256200640 1 -- 172.21.15.5:0/4152205743 >> 172.21.15.5:0/4152205743 conn(0x7ff25006e590 msgr2=0x7ff25006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:08.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.906+0000 7fc7a1600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc79c06dee0 0x7fc79c159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.906+0000 7fc7a1600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc79c0abef0 0x7fc79c0a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.906+0000 7fc7a1600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc79c154a80 0x7fc79c13d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.905+0000 7f1007a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10000b0510 con 0x7f100006b8c0 2024-08-17T02:47:08.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.906+0000 7f1005a00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1000154fa0 0x7f10000ac070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:60596/0 (socket says 172.21.15.5:60596) 2024-08-17T02:47:08.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.906+0000 7f1005a00640 1 -- 172.21.15.5:0/2302354255 learned_addr learned my addr 172.21.15.5:0/2302354255 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:08.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.906+0000 7f1005000640 1 --2- 172.21.15.5:0/2302354255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f100006b8c0 0x7f10000afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.906+0000 7f0fffe00640 1 --2- 172.21.15.5:0/2302354255 >> v2:172.21.15.5:3300/0 conn(0x7f10000b00c0 0x7f1000154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.906+0000 7fb77f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7780cca30 0x7fb7780c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.906+0000 7fb77f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7780d0320 0x7fb7780b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.906+0000 7fb77f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb77814fe00 0x7fb7780b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.906+0000 7fb77f400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7780c9180 con 0x7fb7780cca30 2024-08-17T02:47:08.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.906+0000 7fb77f400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb778159c80 con 0x7fb77814fe00 2024-08-17T02:47:08.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.906+0000 7fb77f400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7780c8bc0 con 0x7fb7780d0320 2024-08-17T02:47:08.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.906+0000 7fc7a1600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c14d410 con 0x7fc79c06dee0 2024-08-17T02:47:08.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7f1005000640 1 -- 172.21.15.5:0/2302354255 >> v2:172.21.15.5:3300/0 conn(0x7f10000b00c0 msgr2=0x7f1000154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:08.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7f1005000640 1 --2- 172.21.15.5:0/2302354255 >> v2:172.21.15.5:3300/0 conn(0x7f10000b00c0 0x7f1000154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7f1005000640 1 -- 172.21.15.5:0/2302354255 >> v1:172.21.15.107:6789/0 conn(0x7f1000154fa0 legacy=0x7f10000ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7f1005000640 1 -- 172.21.15.5:0/2302354255 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10000b07d0 con 0x7f100006b8c0 2024-08-17T02:47:08.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7fb76fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7780d0320 0x7fb7780b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7fb76fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7780d0320 0x7fb7780b45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:59166/0 (socket says 172.21.15.5:59166) 2024-08-17T02:47:08.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7fb76fe00640 1 -- 172.21.15.5:0/4009970587 learned_addr learned my addr 172.21.15.5:0/4009970587 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:08.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7fb77d400640 1 --2- 172.21.15.5:0/4009970587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb77814fe00 0x7fb7780b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7f2650800640 1 Processor -- start 2024-08-17T02:47:08.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7fc7a1600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c0a7370 con 0x7fc79c0abef0 2024-08-17T02:47:08.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7fc7a1600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c06a160 con 0x7fc79c154a80 2024-08-17T02:47:08.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7fc79b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc79c154a80 0x7fc79c13d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7fc792000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc79c0abef0 0x7fc79c0a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7fc79b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc79c154a80 0x7fc79c13d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:59160/0 (socket says 172.21.15.5:59160) 2024-08-17T02:47:08.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7fc79b400640 1 -- 172.21.15.5:0/3271411227 learned_addr learned my addr 172.21.15.5:0/3271411227 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:08.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7fc79aa00640 1 --2- 172.21.15.5:0/3271411227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc79c06dee0 0x7fc79c159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7ff256200640 1 -- 172.21.15.5:0/4152205743 shutdown_connections 2024-08-17T02:47:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.908+0000 7fb77ca00640 1 --2- 172.21.15.5:0/4009970587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7780cca30 0x7fb7780c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.908+0000 7fb76fe00640 1 -- 172.21.15.5:0/4009970587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb77814fe00 msgr2=0x7fb7780b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.908+0000 7fb76fe00640 1 --2- 172.21.15.5:0/4009970587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb77814fe00 0x7fb7780b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7f2650800640 1 -- start start 2024-08-17T02:47:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.908+0000 7fb76fe00640 1 -- 172.21.15.5:0/4009970587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7780cca30 msgr2=0x7fb7780c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.908+0000 7fc79b400640 1 -- 172.21.15.5:0/3271411227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc79c0abef0 msgr2=0x7fc79c0a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.908+0000 7fc79b400640 1 --2- 172.21.15.5:0/3271411227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc79c0abef0 0x7fc79c0a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.908+0000 7fb76fe00640 1 --2- 172.21.15.5:0/4009970587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7780cca30 0x7fb7780c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.908+0000 7fb76fe00640 1 -- 172.21.15.5:0/4009970587 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb770009a20 con 0x7fb7780d0320 2024-08-17T02:47:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.908+0000 7fb77ca00640 1 --2- 172.21.15.5:0/4009970587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7780cca30 0x7fb7780c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:08.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.908+0000 7fc79b400640 1 -- 172.21.15.5:0/3271411227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc79c06dee0 msgr2=0x7fc79c159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.908+0000 7f1005000640 1 --2- 172.21.15.5:0/2302354255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f100006b8c0 0x7f10000afb80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009850 tx=0x7f0ff00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cec6245229dfda4a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.908+0000 7fb76fe00640 1 --2- 172.21.15.5:0/4009970587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7780d0320 0x7fb7780b45a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb76000c5e0 tx=0x7fb760007d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.908+0000 7fc79b400640 1 --2- 172.21.15.5:0/3271411227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc79c06dee0 0x7fc79c159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.908+0000 7fc79b400640 1 -- 172.21.15.5:0/3271411227 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79400be70 con 0x7fc79c154a80 2024-08-17T02:47:08.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.908+0000 7fc792000640 1 --2- 172.21.15.5:0/3271411227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc79c0abef0 0x7fc79c0a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:08.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7f8cc1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cbc0ca9c0 0x7f8cbc15a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7fc79aa00640 1 --2- 172.21.15.5:0/3271411227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc79c06dee0 0x7fc79c159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:08.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7f2650800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26480ac890 0x7f2648159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7f8cc1400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cbc0cda30 0x7f8cbc1540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7f8cc1400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cbc1589e0 0x7f8cbc151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7f8cc1400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc16e5c0 con 0x7f8cbc0ca9c0 2024-08-17T02:47:08.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7f8cc1400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc16d9b0 con 0x7f8cbc1589e0 2024-08-17T02:47:08.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7f8cc1400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc16dc90 con 0x7f8cbc0cda30 2024-08-17T02:47:08.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.907+0000 7ff256200640 1 -- 172.21.15.5:0/4152205743 wait complete. 2024-08-17T02:47:08.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.908+0000 7f7a9fe00640 1 -- 172.21.15.5:0/3780530641 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7aa0007300 con 0x7f7aa8067970 2024-08-17T02:47:08.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7f7a9fe00640 1 --2- 172.21.15.5:0/3780530641 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7a88065220 0x7f7a880676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7fb774c00640 1 -- 172.21.15.5:0/4009970587 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760005aa0 con 0x7fb7780d0320 2024-08-17T02:47:08.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7f2650800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2648157550 0x7f264806bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7f0fff400640 1 -- 172.21.15.5:0/2302354255 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff002ad90 con 0x7f100006b8c0 2024-08-17T02:47:08.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7f2650800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2648157920 0x7f2648151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7f7a9fe00640 1 -- 172.21.15.5:0/3780530641 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7aa00548d0 con 0x7f7aa8067970 2024-08-17T02:47:08.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7fb77f400640 1 -- 172.21.15.5:0/4009970587 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb768009390 con 0x7fb7780d0320 2024-08-17T02:47:08.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7fb77f400640 1 -- 172.21.15.5:0/4009970587 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb778159910 con 0x7fb7780d0320 2024-08-17T02:47:08.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7fc79b400640 1 --2- 172.21.15.5:0/3271411227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc79c154a80 0x7fc79c13d2b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc79400d1a0 tx=0x7fc79403b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7f0fff400640 1 -- 172.21.15.5:0/2302354255 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff0032440 con 0x7f100006b8c0 2024-08-17T02:47:08.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7f0fff400640 1 -- 172.21.15.5:0/2302354255 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0032820 con 0x7f100006b8c0 2024-08-17T02:47:08.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7f7a9fe00640 1 --2- 172.21.15.5:0/3780530641 >> [v2:172.21.15.5:6808/37203,v1:172.21.15.5:6810/37203] conn(0x7f7a8806e040 0x7f7a880704d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7f7aa7e00640 1 --2- 172.21.15.5:0/3780530641 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7a88065220 0x7f7a880676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7fc792a00640 1 -- 172.21.15.5:0/3271411227 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794008700 con 0x7fc79c154a80 2024-08-17T02:47:08.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7f7a9fe00640 1 -- 172.21.15.5:0/3780530641 --> [v2:172.21.15.5:6808/37203,v1:172.21.15.5:6810/37203] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a88070ba0 con 0x7f7a8806e040 2024-08-17T02:47:08.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7f7a9fe00640 1 -- 172.21.15.5:0/3780530641 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7aa0053fa0 con 0x7f7aa8067970 2024-08-17T02:47:08.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.909+0000 7f8cbb200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cbc1589e0 0x7f8cbc151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7f8cbb200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cbc1589e0 0x7f8cbc151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:47514/0 (socket says 172.21.15.5:47514) 2024-08-17T02:47:08.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7f8cbb200640 1 -- 172.21.15.5:0/4238670589 learned_addr learned my addr 172.21.15.5:0/4238670589 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:08.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7f8cba800640 1 --2- 172.21.15.5:0/4238670589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cbc0ca9c0 0x7f8cbc15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7f264d400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2648157550 0x7f264806bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7f264d400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2648157550 0x7f264806bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:59174/0 (socket says 172.21.15.5:59174) 2024-08-17T02:47:08.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7f264e800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2648157920 0x7f2648151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7f264de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26480ac890 0x7f2648159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7f8cba800640 1 -- 172.21.15.5:0/4238670589 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cbc0cda30 msgr2=0x7f8cbc1540b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:47:08.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7f8cba800640 1 --2- 172.21.15.5:0/4238670589 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cbc0cda30 0x7f8cbc1540b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7f8cba800640 1 -- 172.21.15.5:0/4238670589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cbc1589e0 msgr2=0x7f8cbc151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7f8cba800640 1 --2- 172.21.15.5:0/4238670589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cbc1589e0 0x7f8cbc151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7f8cba800640 1 -- 172.21.15.5:0/4238670589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca8009390 con 0x7f8cbc0ca9c0 2024-08-17T02:47:08.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7f8cba800640 1 --2- 172.21.15.5:0/4238670589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cbc0ca9c0 0x7f8cbc15a860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8031000 tx=0x7f8ca8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7f8cb2000640 1 -- 172.21.15.5:0/4238670589 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8031de0 con 0x7f8cbc0ca9c0 2024-08-17T02:47:08.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7f7aad800640 1 --2- 172.21.15.5:0/3780530641 >> [v2:172.21.15.5:6808/37203,v1:172.21.15.5:6810/37203] conn(0x7f7a8806e040 0x7f7a880704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7f8cb2000640 1 -- 172.21.15.5:0/4238670589 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca803e450 con 0x7f8cbc0ca9c0 2024-08-17T02:47:08.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7f8cb2000640 1 -- 172.21.15.5:0/4238670589 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca803e7d0 con 0x7f8cbc0ca9c0 2024-08-17T02:47:08.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7ff256200640 1 Processor -- start 2024-08-17T02:47:08.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7f264e800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2648157920 0x7f2648151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:47530/0 (socket says 172.21.15.5:47530) 2024-08-17T02:47:08.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7f264d400640 1 -- 172.21.15.5:0/2917505884 learned_addr learned my addr 172.21.15.5:0/2917505884 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:08.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7f2650800640 1 -- 172.21.15.5:0/2917505884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2648158d00 con 0x7f26480ac890 2024-08-17T02:47:08.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7fc792a00640 1 -- 172.21.15.5:0/3271411227 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc794008880 con 0x7fc79c154a80 2024-08-17T02:47:08.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7fc792a00640 1 -- 172.21.15.5:0/3271411227 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7940316a0 con 0x7fc79c154a80 2024-08-17T02:47:08.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7fb774c00640 1 -- 172.21.15.5:0/4009970587 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb760005c00 con 0x7fb7780d0320 2024-08-17T02:47:08.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7ff256200640 1 -- start start 2024-08-17T02:47:08.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.910+0000 7fb774c00640 1 -- 172.21.15.5:0/4009970587 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760005aa0 con 0x7fb7780d0320 2024-08-17T02:47:08.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7fb77f400640 1 -- 172.21.15.5:0/4009970587 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb778063fb0 con 0x7fb7780d0320 2024-08-17T02:47:08.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7fc7a1600640 1 -- 172.21.15.5:0/3271411227 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79c0a4a10 con 0x7fc79c154a80 2024-08-17T02:47:08.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.912+0000 7fc7a1600640 1 -- 172.21.15.5:0/3271411227 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79c069830 con 0x7fc79c154a80 2024-08-17T02:47:08.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.912+0000 7f7aad800640 1 --2- 172.21.15.5:0/3780530641 >> [v2:172.21.15.5:6808/37203,v1:172.21.15.5:6810/37203] conn(0x7f7a8806e040 0x7f7a880704d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.912+0000 7f9d86800640 1 Processor -- start 2024-08-17T02:47:08.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.912+0000 7f7aa7e00640 1 --2- 172.21.15.5:0/3780530641 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7a88065220 0x7f7a880676d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7a94034000 tx=0x7f7a94032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7f8cc1400640 1 -- 172.21.15.5:0/4238670589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cbc16df70 con 0x7f8cbc0ca9c0 2024-08-17T02:47:08.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.911+0000 7f8cc1400640 1 -- 172.21.15.5:0/4238670589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cbc16d660 con 0x7f8cbc0ca9c0 2024-08-17T02:47:08.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.912+0000 7f2650800640 1 -- 172.21.15.5:0/2917505884 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264816e050 con 0x7f2648157920 2024-08-17T02:47:08.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.912+0000 7f2650800640 1 -- 172.21.15.5:0/2917505884 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2648159860 con 0x7f2648157550 2024-08-17T02:47:08.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.912+0000 7f9d86800640 1 -- start start 2024-08-17T02:47:08.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.912+0000 7f1007a00640 1 -- 172.21.15.5:0/2302354255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f100006b8c0 msgr2=0x7f10000afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.913+0000 7f1007a00640 1 --2- 172.21.15.5:0/2302354255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f100006b8c0 0x7f10000afb80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009850 tx=0x7f0ff00090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.913+0000 7f8cc1400640 1 -- 172.21.15.5:0/4238670589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8cbc063fb0 con 0x7f8cbc0ca9c0 2024-08-17T02:47:08.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.913+0000 7f1007a00640 1 -- 172.21.15.5:0/2302354255 shutdown_connections 2024-08-17T02:47:08.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.913+0000 7f1007a00640 1 --2- 172.21.15.5:0/2302354255 >> v2:172.21.15.5:3300/0 conn(0x7f10000b00c0 0x7f1000154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.913+0000 7f1007a00640 1 --2- 172.21.15.5:0/2302354255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f100006b8c0 0x7f10000afb80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.913+0000 7f1007a00640 1 -- 172.21.15.5:0/2302354255 >> 172.21.15.5:0/2302354255 conn(0x7f1000066e60 msgr2=0x7f1000067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:08.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7f1007a00640 1 -- 172.21.15.5:0/2302354255 shutdown_connections 2024-08-17T02:47:08.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7ff256200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff25015b950 0x7ff25015bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7fc7a1600640 1 -- 172.21.15.5:0/3271411227 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc79c063fb0 con 0x7fc79c154a80 2024-08-17T02:47:08.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7f1007a00640 1 -- 172.21.15.5:0/2302354255 wait complete. 2024-08-17T02:47:08.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7ff256200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff25016c4e0 0x7ff2500b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7ff256200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2500afe30 0x7ff2500b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7ff256200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2500b07e0 con 0x7ff25016c4e0 2024-08-17T02:47:08.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7ff256200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25015a040 con 0x7ff2500afe30 2024-08-17T02:47:08.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7ff256200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25014a500 con 0x7ff25015b950 2024-08-17T02:47:08.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7ff24f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff25015b950 0x7ff25015bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7ff24f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff25015b950 0x7ff25015bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:59196/0 (socket says 172.21.15.5:59196) 2024-08-17T02:47:08.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7ff24f400640 1 -- 172.21.15.5:0/1969996210 learned_addr learned my addr 172.21.15.5:0/1969996210 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:08.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.915+0000 7ff24ea00640 1 --2- 172.21.15.5:0/1969996210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff25016c4e0 0x7ff2500b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.915+0000 7ff24fe00640 1 --2- 172.21.15.5:0/1969996210 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2500afe30 0x7ff2500b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7fb774c00640 1 -- 172.21.15.5:0/4009970587 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb7600070d0 con 0x7fb7780d0320 2024-08-17T02:47:08.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.915+0000 7f7a9fe00640 1 -- 172.21.15.5:0/3780530641 <== osd.2 v2:172.21.15.5:6808/37203 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7a88070ba0 con 0x7f7a8806e040 2024-08-17T02:47:08.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.915+0000 7f8cb2000640 1 -- 172.21.15.5:0/4238670589 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8ca803ec00 con 0x7f8cbc0ca9c0 2024-08-17T02:47:08.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.916+0000 7ff24fe00640 1 -- 172.21.15.5:0/1969996210 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff25015b950 msgr2=0x7ff25015bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.916+0000 7ff24fe00640 1 --2- 172.21.15.5:0/1969996210 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff25015b950 0x7ff25015bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.916+0000 7ff24fe00640 1 -- 172.21.15.5:0/1969996210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff25016c4e0 msgr2=0x7ff2500b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.916+0000 7ff24fe00640 1 --2- 172.21.15.5:0/1969996210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff25016c4e0 0x7ff2500b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7f264d400640 1 -- 172.21.15.5:0/2917505884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2648157920 msgr2=0x7f2648151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7f264d400640 1 --2- 172.21.15.5:0/2917505884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2648157920 0x7f2648151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7f264d400640 1 -- 172.21.15.5:0/2917505884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26480ac890 msgr2=0x7f2648159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7f264d400640 1 --2- 172.21.15.5:0/2917505884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26480ac890 0x7f2648159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.914+0000 7f264d400640 1 -- 172.21.15.5:0/2917505884 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c009390 con 0x7f2648157550 2024-08-17T02:47:08.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.915+0000 7f264d400640 1 --2- 172.21.15.5:0/2917505884 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2648157550 0x7f264806bd40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f263c035040 tx=0x7f263c032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.915+0000 7f2641600640 1 -- 172.21.15.5:0/2917505884 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c03b6e0 con 0x7f2648157550 2024-08-17T02:47:08.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.915+0000 7f2641600640 1 -- 172.21.15.5:0/2917505884 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c03b840 con 0x7f2648157550 2024-08-17T02:47:08.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.916+0000 7f1007a00640 1 Processor -- start 2024-08-17T02:47:08.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.916+0000 7f2641600640 1 -- 172.21.15.5:0/2917505884 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c03bbe0 con 0x7f2648157550 2024-08-17T02:47:08.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.916+0000 7f2650800640 1 -- 172.21.15.5:0/2917505884 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2648158f30 con 0x7f2648157550 2024-08-17T02:47:08.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.916+0000 7f2650800640 1 -- 172.21.15.5:0/2917505884 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26481594f0 con 0x7f2648157550 2024-08-17T02:47:08.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.916+0000 7fb774c00640 1 --2- 172.21.15.5:0/4009970587 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb7540651b0 0x7fb754067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.916+0000 7ff24fe00640 1 -- 172.21.15.5:0/1969996210 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25015c260 con 0x7ff2500afe30 2024-08-17T02:47:08.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.916+0000 7ff24ea00640 1 --2- 172.21.15.5:0/1969996210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff25016c4e0 0x7ff2500b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:08.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.917+0000 7fb774c00640 1 -- 172.21.15.5:0/4009970587 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb760081320 con 0x7fb7780d0320 2024-08-17T02:47:08.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.917+0000 7fb774c00640 1 --2- 172.21.15.5:0/4009970587 >> [v2:172.21.15.5:6809/37204,v1:172.21.15.5:6811/37204] conn(0x7fb75406d3c0 0x7fb75406f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.917+0000 7fb774c00640 1 -- 172.21.15.5:0/4009970587 --> [v2:172.21.15.5:6809/37204,v1:172.21.15.5:6811/37204] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb75406fe80 con 0x7fb75406d3c0 2024-08-17T02:47:08.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.917+0000 7fb774c00640 1 -- 172.21.15.5:0/4009970587 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb760081560 con 0x7fb7780d0320 2024-08-17T02:47:08.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.917+0000 7f8cb2000640 1 --2- 172.21.15.5:0/4238670589 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8c9c0652a0 0x7f8c9c067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.917+0000 7f8cb2000640 1 -- 172.21.15.5:0/4238670589 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ca80a2d90 con 0x7f8cbc0ca9c0 2024-08-17T02:47:08.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.917+0000 7f8cb2000640 1 --2- 172.21.15.5:0/4238670589 >> [v2:172.21.15.5:6824/37194,v1:172.21.15.5:6825/37194] conn(0x7f8c9c06d4b0 0x7f8c9c06f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.917+0000 7f8cb9e00640 1 --2- 172.21.15.5:0/4238670589 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8c9c0652a0 0x7f8c9c067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.918+0000 7f8cb2000640 1 -- 172.21.15.5:0/4238670589 --> [v2:172.21.15.5:6824/37194,v1:172.21.15.5:6825/37194] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c9c06ff70 con 0x7f8c9c06d4b0 2024-08-17T02:47:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.917+0000 7f2650800640 1 -- 172.21.15.5:0/2917505884 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2648063fb0 con 0x7f2648157550 2024-08-17T02:47:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.918+0000 7f8cbb200640 1 --2- 172.21.15.5:0/4238670589 >> [v2:172.21.15.5:6824/37194,v1:172.21.15.5:6825/37194] conn(0x7f8c9c06d4b0 0x7f8c9c06f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.918+0000 7f8cb2000640 1 -- 172.21.15.5:0/4238670589 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ca80a6020 con 0x7f8cbc0ca9c0 2024-08-17T02:47:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.918+0000 7f9d86800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9d80158e50 0x7f9d80159220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.918+0000 7fc792a00640 1 -- 172.21.15.5:0/3271411227 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc794031ad0 con 0x7fc79c154a80 2024-08-17T02:47:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.917+0000 7ff24fe00640 1 --2- 172.21.15.5:0/1969996210 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2500afe30 0x7ff2500b02a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff2500cbdd0 tx=0x7ff23c009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.917+0000 7fb77ca00640 1 --2- 172.21.15.5:0/4009970587 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb7540651b0 0x7fb754067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.918+0000 7fb77ca00640 1 --2- 172.21.15.5:0/4009970587 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb7540651b0 0x7fb754067660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb768034000 tx=0x7fb768032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.918+0000 7fb77d400640 1 --2- 172.21.15.5:0/4009970587 >> [v2:172.21.15.5:6809/37204,v1:172.21.15.5:6811/37204] conn(0x7fb75406d3c0 0x7fb75406f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.918+0000 7f8cb9e00640 1 --2- 172.21.15.5:0/4238670589 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8c9c0652a0 0x7f8c9c067750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8cac006fd0 tx=0x7f8cac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.919+0000 7f8cbb200640 1 --2- 172.21.15.5:0/4238670589 >> [v2:172.21.15.5:6824/37194,v1:172.21.15.5:6825/37194] conn(0x7f8c9c06d4b0 0x7f8c9c06f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.919+0000 7f9d86800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8015a320 con 0x7f9d80159760 2024-08-17T02:47:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.916+0000 7f1007a00640 1 -- start start 2024-08-17T02:47:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.919+0000 7f9d86800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d80159d80 con 0x7f9d800ac9e0 2024-08-17T02:47:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.919+0000 7f9d86800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8015a040 con 0x7f9d80158e50 2024-08-17T02:47:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.917+0000 7f1007a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f100006b8c0 0x7f1000169610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.917+0000 7f1007a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10000b00c0 0x7f10001464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.918+0000 7f1007a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1000154fa0 0x7f1000148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.918+0000 7f0fffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10000b00c0 0x7f10001464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.918+0000 7f0fffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10000b00c0 0x7f10001464d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33438/0 (socket says 172.21.15.5:33438) 2024-08-17T02:47:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.918+0000 7f1007a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100014c0a0 con 0x7f10000b00c0 2024-08-17T02:47:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.918+0000 7f1007a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1000169b50 con 0x7f100006b8c0 2024-08-17T02:47:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.918+0000 7f1007a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100014b210 con 0x7f1000154fa0 2024-08-17T02:47:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.918+0000 7f0fffe00640 1 -- 172.21.15.5:0/263600951 learned_addr learned my addr 172.21.15.5:0/263600951 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.919+0000 7f0fffe00640 1 -- 172.21.15.5:0/263600951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1000154fa0 msgr2=0x7f1000148f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:47:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.919+0000 7f0fffe00640 1 --2- 172.21.15.5:0/263600951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1000154fa0 0x7f1000148f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.919+0000 7f0fffe00640 1 -- 172.21.15.5:0/263600951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f100006b8c0 msgr2=0x7f1000169610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:47:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.919+0000 7f0fffe00640 1 --2- 172.21.15.5:0/263600951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f100006b8c0 0x7f1000169610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.919+0000 7f0fffe00640 1 -- 172.21.15.5:0/263600951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff0009390 con 0x7f10000b00c0 2024-08-17T02:47:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.919+0000 7f0fffe00640 1 --2- 172.21.15.5:0/263600951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10000b00c0 0x7f10001464d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800e4f0 tx=0x7f0ff8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.920+0000 7fb77d400640 1 --2- 172.21.15.5:0/4009970587 >> [v2:172.21.15.5:6809/37204,v1:172.21.15.5:6811/37204] conn(0x7fb75406d3c0 0x7fb75406f7d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.920+0000 7f9d7ea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9d80159760 0x7f9d800ac2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42126/0 (socket says 172.21.15.5:42126) 2024-08-17T02:47:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.920+0000 7f9d7ea00640 1 -- 172.21.15.5:0/4241448813 learned_addr learned my addr 172.21.15.5:0/4241448813 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.919+0000 7fc792a00640 1 --2- 172.21.15.5:0/3271411227 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc7780651d0 0x7fc778067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.920+0000 7f9d7f400640 1 --2- 172.21.15.5:0/4241448813 >> v2:172.21.15.107:3300/0 conn(0x7f9d80158e50 0x7f9d80159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.919+0000 7ff246a00640 1 -- 172.21.15.5:0/1969996210 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c007070 con 0x7ff2500afe30 2024-08-17T02:47:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.920+0000 7ff246a00640 1 -- 172.21.15.5:0/1969996210 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23c0071f0 con 0x7ff2500afe30 2024-08-17T02:47:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.920+0000 7f9d7e000640 1 -- 172.21.15.5:0/4241448813 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655689822 0 0) 0x7f9d8015a320 con 0x7f9d80159760 2024-08-17T02:47:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.920+0000 7f0ff7e00640 1 -- 172.21.15.5:0/263600951 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8014420 con 0x7f10000b00c0 2024-08-17T02:47:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.920+0000 7ff246a00640 1 -- 172.21.15.5:0/1969996210 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c0075f0 con 0x7ff2500afe30 2024-08-17T02:47:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.920+0000 7f8cb2000640 1 -- 172.21.15.5:0/4238670589 <== osd.3 v2:172.21.15.5:6824/37194 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8c9c06ff70 con 0x7f8c9c06d4b0 2024-08-17T02:47:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.920+0000 7f0ff7e00640 1 -- 172.21.15.5:0/263600951 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff8014580 con 0x7f10000b00c0 2024-08-17T02:47:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.921+0000 7f0ff7e00640 1 -- 172.21.15.5:0/263600951 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8014900 con 0x7f10000b00c0 2024-08-17T02:47:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.921+0000 7f1007a00640 1 -- 172.21.15.5:0/263600951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100014b490 con 0x7f10000b00c0 2024-08-17T02:47:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.920+0000 7f2641600640 1 -- 172.21.15.5:0/2917505884 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f263c039040 con 0x7f2648157550 2024-08-17T02:47:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.921+0000 7f9d7e000640 1 -- 172.21.15.5:0/4241448813 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d640034e0 con 0x7f9d80159760 2024-08-17T02:47:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.919+0000 7fc792a00640 1 -- 172.21.15.5:0/3271411227 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc7940a40e0 con 0x7fc79c154a80 2024-08-17T02:47:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.919+0000 7fc79aa00640 1 --2- 172.21.15.5:0/3271411227 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc7780651d0 0x7fc778067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.921+0000 7f9d7f400640 1 -- 172.21.15.5:0/4241448813 >> v1:172.21.15.107:6789/0 conn(0x7f9d800ac9e0 legacy=0x7f9d800a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.921+0000 7f9d7f400640 1 -- 172.21.15.5:0/4241448813 >> v1:172.21.15.5:6789/0 conn(0x7f9d80159760 legacy=0x7f9d800ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.921+0000 7f9d7f400640 1 -- 172.21.15.5:0/4241448813 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d800a97f0 con 0x7f9d80158e50 2024-08-17T02:47:08.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.920+0000 7fc792a00640 1 --2- 172.21.15.5:0/3271411227 >> [v2:172.21.15.107:6808/37109,v1:172.21.15.107:6809/37109] conn(0x7fc77806d3e0 0x7fc77806f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.921+0000 7fc792a00640 1 -- 172.21.15.5:0/3271411227 --> [v2:172.21.15.107:6808/37109,v1:172.21.15.107:6809/37109] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc77806fea0 con 0x7fc77806d3e0 2024-08-17T02:47:08.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.921+0000 7fc792a00640 1 -- 172.21.15.5:0/3271411227 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7940a6680 con 0x7fc79c154a80 2024-08-17T02:47:08.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.921+0000 7fc792000640 1 --2- 172.21.15.5:0/3271411227 >> [v2:172.21.15.107:6808/37109,v1:172.21.15.107:6809/37109] conn(0x7fc77806d3e0 0x7fc77806f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.922+0000 7f2641600640 1 --2- 172.21.15.5:0/2917505884 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f262c0652a0 0x7f262c067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.921+0000 7f1007a00640 1 -- 172.21.15.5:0/263600951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100014ba50 con 0x7f10000b00c0 2024-08-17T02:47:08.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.922+0000 7ff256200640 1 -- 172.21.15.5:0/1969996210 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2501594c0 con 0x7ff2500afe30 2024-08-17T02:47:08.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.922+0000 7ff256200640 1 -- 172.21.15.5:0/1969996210 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff250159a80 con 0x7ff2500afe30 2024-08-17T02:47:08.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.922+0000 7f2641600640 1 -- 172.21.15.5:0/2917505884 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f263c041030 con 0x7f2648157550 2024-08-17T02:47:08.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.922+0000 7f2641600640 1 --2- 172.21.15.5:0/2917505884 >> [v2:172.21.15.107:6800/37108,v1:172.21.15.107:6801/37108] conn(0x7f262c06d4b0 0x7f262c06f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.922+0000 7f2641600640 1 -- 172.21.15.5:0/2917505884 --> [v2:172.21.15.107:6800/37108,v1:172.21.15.107:6801/37108] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f262c06ff70 con 0x7f262c06d4b0 2024-08-17T02:47:08.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.922+0000 7f2641600640 1 -- 172.21.15.5:0/2917505884 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f263c0a7220 con 0x7f2648157550 2024-08-17T02:47:08.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.922+0000 7fc792000640 1 --2- 172.21.15.5:0/3271411227 >> [v2:172.21.15.107:6808/37109,v1:172.21.15.107:6809/37109] conn(0x7fc77806d3e0 0x7fc77806f7f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.923+0000 7f264e800640 1 --2- 172.21.15.5:0/2917505884 >> [v2:172.21.15.107:6800/37108,v1:172.21.15.107:6801/37108] conn(0x7f262c06d4b0 0x7f262c06f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.923+0000 7f264de00640 1 --2- 172.21.15.5:0/2917505884 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f262c0652a0 0x7f262c067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.923+0000 7fc79aa00640 1 --2- 172.21.15.5:0/3271411227 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc7780651d0 0x7fc778067680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc784007fd0 tx=0x7fc784009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.923+0000 7ff256200640 1 -- 172.21.15.5:0/1969996210 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff250168eb0 con 0x7ff2500afe30 2024-08-17T02:47:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.923+0000 7f9d7f400640 1 --2- 172.21.15.5:0/4241448813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d80158e50 0x7f9d80159220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009e60 tx=0x7f9d78009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=125383d9889cbdd2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.923+0000 7fc792a00640 1 -- 172.21.15.5:0/3271411227 <== osd.5 v2:172.21.15.107:6808/37109 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc77806fea0 con 0x7fc77806d3e0 2024-08-17T02:47:08.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.924+0000 7fb774c00640 1 -- 172.21.15.5:0/4009970587 <== osd.1 v2:172.21.15.5:6809/37204 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb75406fe80 con 0x7fb75406d3c0 2024-08-17T02:47:08.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.924+0000 7f264e800640 1 --2- 172.21.15.5:0/2917505884 >> [v2:172.21.15.107:6800/37108,v1:172.21.15.107:6801/37108] conn(0x7f262c06d4b0 0x7f262c06f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.922+0000 7f1007a00640 1 -- 172.21.15.5:0/263600951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1000063fb0 con 0x7f10000b00c0 2024-08-17T02:47:08.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.925+0000 7f264de00640 1 --2- 172.21.15.5:0/2917505884 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f262c0652a0 0x7f262c067750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2648152600 tx=0x7f2644007850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.925+0000 7f9d7e000640 1 -- 172.21.15.5:0/4241448813 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78007550 con 0x7f9d80158e50 2024-08-17T02:47:08.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.925+0000 7f9d7e000640 1 -- 172.21.15.5:0/4241448813 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7802d050 con 0x7f9d80158e50 2024-08-17T02:47:08.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.925+0000 7f9d7e000640 1 -- 172.21.15.5:0/4241448813 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78007920 con 0x7f9d80158e50 2024-08-17T02:47:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.925+0000 7f2641600640 1 -- 172.21.15.5:0/2917505884 <== osd.4 v2:172.21.15.107:6800/37108 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f262c06ff70 con 0x7f262c06d4b0 2024-08-17T02:47:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.925+0000 7f0ff7e00640 1 -- 172.21.15.5:0/263600951 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0ff8014c70 con 0x7f10000b00c0 2024-08-17T02:47:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.926+0000 7f9d86800640 1 -- 172.21.15.5:0/4241448813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d80158e50 msgr2=0x7f9d80159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.926+0000 7f9d86800640 1 --2- 172.21.15.5:0/4241448813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d80158e50 0x7f9d80159220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009e60 tx=0x7f9d78009780 comp rx=0 tx=0).stop 2024-08-17T02:47:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.926+0000 7f9d86800640 1 -- 172.21.15.5:0/4241448813 shutdown_connections 2024-08-17T02:47:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.926+0000 7f9d86800640 1 --2- 172.21.15.5:0/4241448813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d80158e50 0x7f9d80159220 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.926+0000 7f9d86800640 1 -- 172.21.15.5:0/4241448813 >> 172.21.15.5:0/4241448813 conn(0x7f9d80095a70 msgr2=0x7f9d80095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.927+0000 7f0ff7e00640 1 --2- 172.21.15.5:0/263600951 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0fe0065150 0x7f0fe0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.928+0000 7ff246a00640 1 -- 172.21.15.5:0/1969996210 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff23c0069a0 con 0x7ff2500afe30 2024-08-17T02:47:08.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.927+0000 7f0ff7e00640 1 -- 172.21.15.5:0/263600951 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0ff80836a0 con 0x7f10000b00c0 2024-08-17T02:47:08.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.927+0000 7f0ff7e00640 1 --2- 172.21.15.5:0/263600951 >> [v2:172.21.15.107:6816/37110,v1:172.21.15.107:6817/37110] conn(0x7f0fe006d360 0x7f0fe006f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.927+0000 7f0ff7e00640 1 -- 172.21.15.5:0/263600951 --> [v2:172.21.15.107:6816/37110,v1:172.21.15.107:6817/37110] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0fe006fe20 con 0x7f0fe006d360 2024-08-17T02:47:08.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.927+0000 7f0ff7e00640 1 -- 172.21.15.5:0/263600951 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ff8083a70 con 0x7f10000b00c0 2024-08-17T02:47:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.929+0000 7f9d86800640 1 -- 172.21.15.5:0/4241448813 shutdown_connections 2024-08-17T02:47:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.929+0000 7f1005000640 1 --2- 172.21.15.5:0/263600951 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0fe0065150 0x7f0fe0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.929+0000 7f9d86800640 1 -- 172.21.15.5:0/4241448813 wait complete. 2024-08-17T02:47:08.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.929+0000 7ff246a00640 1 --2- 172.21.15.5:0/1969996210 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff2300652a0 0x7ff230067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.929+0000 7ff246a00640 1 -- 172.21.15.5:0/1969996210 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff23c0819b0 con 0x7ff2500afe30 2024-08-17T02:47:08.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.930+0000 7ff246a00640 1 --2- 172.21.15.5:0/1969996210 >> [v2:172.21.15.5:6800/37190,v1:172.21.15.5:6801/37190] conn(0x7ff23006d4b0 0x7ff23006f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.930+0000 7ff246a00640 1 -- 172.21.15.5:0/1969996210 --> [v2:172.21.15.5:6800/37190,v1:172.21.15.5:6801/37190] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff23006ff70 con 0x7ff23006d4b0 2024-08-17T02:47:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.930+0000 7ff246a00640 1 -- 172.21.15.5:0/1969996210 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff23c081ce0 con 0x7ff2500afe30 2024-08-17T02:47:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.930+0000 7ff24f400640 1 --2- 172.21.15.5:0/1969996210 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff2300652a0 0x7ff230067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.930+0000 7ff24ea00640 1 --2- 172.21.15.5:0/1969996210 >> [v2:172.21.15.5:6800/37190,v1:172.21.15.5:6801/37190] conn(0x7ff23006d4b0 0x7ff23006f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.931+0000 7ff24f400640 1 --2- 172.21.15.5:0/1969996210 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff2300652a0 0x7ff230067750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff248007360 tx=0x7ff248001150 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.931+0000 7f9d86800640 1 Processor -- start 2024-08-17T02:47:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.932+0000 7f1005a00640 1 --2- 172.21.15.5:0/263600951 >> [v2:172.21.15.107:6816/37110,v1:172.21.15.107:6817/37110] conn(0x7f0fe006d360 0x7f0fe006f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.932+0000 7ff24ea00640 1 --2- 172.21.15.5:0/1969996210 >> [v2:172.21.15.5:6800/37190,v1:172.21.15.5:6801/37190] conn(0x7ff23006d4b0 0x7ff23006f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.932+0000 7f9d86800640 1 -- start start 2024-08-17T02:47:08.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.932+0000 7f1005000640 1 --2- 172.21.15.5:0/263600951 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0fe0065150 0x7f0fe0067600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0034000 tx=0x7f0ff0032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.933+0000 7f9d86800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d800ac9e0 0x7f9d80098100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.934+0000 7ff246a00640 1 -- 172.21.15.5:0/1969996210 <== osd.0 v2:172.21.15.5:6800/37190 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff23006ff70 con 0x7ff23006d4b0 2024-08-17T02:47:08.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.934+0000 7f1005a00640 1 --2- 172.21.15.5:0/263600951 >> [v2:172.21.15.107:6816/37110,v1:172.21.15.107:6817/37110] conn(0x7f0fe006d360 0x7f0fe006f770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.934+0000 7f9d86800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d80158e50 0x7f9d8009a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.934+0000 7f9d86800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d80159760 0x7f9d800968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.934+0000 7f9d86800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d80096de0 con 0x7f9d80158e50 2024-08-17T02:47:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.934+0000 7f9d86800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d80097080 con 0x7f9d800ac9e0 2024-08-17T02:47:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.934+0000 7f9d86800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d80097360 con 0x7f9d80159760 2024-08-17T02:47:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.934+0000 7f9d7f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d800ac9e0 0x7f9d80098100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.935+0000 7f9d7ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d80158e50 0x7f9d8009a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.935+0000 7f9d7fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d80159760 0x7f9d800968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.935+0000 7f9d7ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d80158e50 0x7f9d8009a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33448/0 (socket says 172.21.15.5:33448) 2024-08-17T02:47:09.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.935+0000 7f9d7ea00640 1 -- 172.21.15.5:0/4076321148 learned_addr learned my addr 172.21.15.5:0/4076321148 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:09.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.935+0000 7f9d7ea00640 1 -- 172.21.15.5:0/4076321148 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d80159760 msgr2=0x7f9d800968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.935+0000 7f9d7ea00640 1 --2- 172.21.15.5:0/4076321148 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d80159760 0x7f9d800968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.935+0000 7f0ff7e00640 1 -- 172.21.15.5:0/263600951 <== osd.6 v2:172.21.15.107:6816/37110 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f0fe006fe20 con 0x7f0fe006d360 2024-08-17T02:47:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.935+0000 7f9d7ea00640 1 -- 172.21.15.5:0/4076321148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d800ac9e0 msgr2=0x7f9d80098100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.935+0000 7f9d7ea00640 1 --2- 172.21.15.5:0/4076321148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d800ac9e0 0x7f9d80098100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.935+0000 7f9d7ea00640 1 -- 172.21.15.5:0/4076321148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d78009a20 con 0x7f9d80158e50 2024-08-17T02:47:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.935+0000 7f9d7fe00640 1 --2- 172.21.15.5:0/4076321148 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d80159760 0x7f9d800968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.935+0000 7f9d7f400640 1 --2- 172.21.15.5:0/4076321148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d800ac9e0 0x7f9d80098100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.940+0000 7f9d7ea00640 1 --2- 172.21.15.5:0/4076321148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d80158e50 0x7f9d8009a3e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000c590 tx=0x7f9d70007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.941+0000 7f9d76a00640 1 -- 172.21.15.5:0/4076321148 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70005b70 con 0x7f9d80158e50 2024-08-17T02:47:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.941+0000 7f9d76a00640 1 -- 172.21.15.5:0/4076321148 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d70005cf0 con 0x7f9d80158e50 2024-08-17T02:47:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.941+0000 7f9d76a00640 1 -- 172.21.15.5:0/4076321148 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70007320 con 0x7f9d80158e50 2024-08-17T02:47:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.941+0000 7f9d86800640 1 -- 172.21.15.5:0/4076321148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d80097640 con 0x7f9d80158e50 2024-08-17T02:47:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.944+0000 7f9d86800640 1 -- 172.21.15.5:0/4076321148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d80097c80 con 0x7f9d80158e50 2024-08-17T02:47:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.945+0000 7f9d6fe00640 1 -- 172.21.15.5:0/4076321148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d50000fd0 con 0x7f9d80158e50 2024-08-17T02:47:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.945+0000 7f9d76a00640 1 -- 172.21.15.5:0/4076321148 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9d7001b3b0 con 0x7f9d80158e50 2024-08-17T02:47:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.946+0000 7f8cc1400640 1 -- 172.21.15.5:0/4238670589 --> [v2:172.21.15.5:6824/37194,v1:172.21.15.5:6825/37194] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8cbc155f70 con 0x7f8c9c06d4b0 2024-08-17T02:47:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.946+0000 7f8cb2000640 1 -- 172.21.15.5:0/4238670589 <== osd.3 v2:172.21.15.5:6824/37194 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8cbc155f70 con 0x7f8c9c06d4b0 2024-08-17T02:47:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.947+0000 7f8cc1400640 1 -- 172.21.15.5:0/4238670589 >> [v2:172.21.15.5:6824/37194,v1:172.21.15.5:6825/37194] conn(0x7f8c9c06d4b0 msgr2=0x7f8c9c06f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.947+0000 7f8cc1400640 1 --2- 172.21.15.5:0/4238670589 >> [v2:172.21.15.5:6824/37194,v1:172.21.15.5:6825/37194] conn(0x7f8c9c06d4b0 0x7f8c9c06f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.947+0000 7f9d76a00640 1 --2- 172.21.15.5:0/4076321148 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9d5c065220 0x7f9d5c0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.947+0000 7f9d76a00640 1 -- 172.21.15.5:0/4076321148 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d70087060 con 0x7f9d80158e50 2024-08-17T02:47:09.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.948+0000 7f9d76a00640 1 --2- 172.21.15.5:0/4076321148 >> [v2:172.21.15.107:6824/37152,v1:172.21.15.107:6825/37152] conn(0x7f9d5c06d430 0x7f9d5c06f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.948+0000 7f9d76a00640 1 -- 172.21.15.5:0/4076321148 --> [v2:172.21.15.107:6824/37152,v1:172.21.15.107:6825/37152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d5c06fef0 con 0x7f9d5c06d430 2024-08-17T02:47:09.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.948+0000 7f9d76a00640 1 -- 172.21.15.5:0/4076321148 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d70081790 con 0x7f9d80158e50 2024-08-17T02:47:09.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.948+0000 7f9d7f400640 1 --2- 172.21.15.5:0/4076321148 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9d5c065220 0x7f9d5c0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.948+0000 7f8cc1400640 1 -- 172.21.15.5:0/4238670589 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8c9c0652a0 msgr2=0x7f8c9c067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.948+0000 7f8cc1400640 1 --2- 172.21.15.5:0/4238670589 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8c9c0652a0 0x7f8c9c067750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8cac006fd0 tx=0x7f8cac008040 comp rx=0 tx=0).stop 2024-08-17T02:47:09.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.948+0000 7f8cc1400640 1 -- 172.21.15.5:0/4238670589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cbc0ca9c0 msgr2=0x7f8cbc15a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.948+0000 7f8cc1400640 1 --2- 172.21.15.5:0/4238670589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cbc0ca9c0 0x7f8cbc15a860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8031000 tx=0x7f8ca8032000 comp rx=0 tx=0).stop 2024-08-17T02:47:09.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.948+0000 7f8cbb200640 1 -- 172.21.15.5:0/4238670589 reap_dead start 2024-08-17T02:47:09.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.949+0000 7f8cc1400640 1 -- 172.21.15.5:0/4238670589 shutdown_connections 2024-08-17T02:47:09.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.949+0000 7f8cc1400640 1 -- 172.21.15.5:0/4238670589 >> 172.21.15.5:0/4238670589 conn(0x7f8cbc06e590 msgr2=0x7f8cbc156350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.949+0000 7f9d7fe00640 1 --2- 172.21.15.5:0/4076321148 >> [v2:172.21.15.107:6824/37152,v1:172.21.15.107:6825/37152] conn(0x7f9d5c06d430 0x7f9d5c06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.949+0000 7f9d7f400640 1 --2- 172.21.15.5:0/4076321148 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9d5c065220 0x7f9d5c0676d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9d78034000 tx=0x7f9d78037000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.949+0000 7f8cc1400640 1 -- 172.21.15.5:0/4238670589 shutdown_connections 2024-08-17T02:47:09.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.950+0000 7f8cc1400640 1 -- 172.21.15.5:0/4238670589 wait complete. 2024-08-17T02:47:09.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.950+0000 7f9d7fe00640 1 --2- 172.21.15.5:0/4076321148 >> [v2:172.21.15.107:6824/37152,v1:172.21.15.107:6825/37152] conn(0x7f9d5c06d430 0x7f9d5c06f840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.951+0000 7f7aaf800640 1 -- 172.21.15.5:0/3780530641 --> [v2:172.21.15.5:6808/37203,v1:172.21.15.5:6810/37203] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7aa806e170 con 0x7f7a8806e040 2024-08-17T02:47:09.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.951+0000 7f7a9fe00640 1 -- 172.21.15.5:0/3780530641 <== osd.2 v2:172.21.15.5:6808/37203 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7aa806e170 con 0x7f7a8806e040 2024-08-17T02:47:09.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.951+0000 7f9d76a00640 1 -- 172.21.15.5:0/4076321148 <== osd.7 v2:172.21.15.107:6824/37152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f9d5c06fef0 con 0x7f9d5c06d430 2024-08-17T02:47:09.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.952+0000 7f7aaf800640 1 -- 172.21.15.5:0/3780530641 >> [v2:172.21.15.5:6808/37203,v1:172.21.15.5:6810/37203] conn(0x7f7a8806e040 msgr2=0x7f7a880704d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.952+0000 7f7aaf800640 1 --2- 172.21.15.5:0/3780530641 >> [v2:172.21.15.5:6808/37203,v1:172.21.15.5:6810/37203] conn(0x7f7a8806e040 0x7f7a880704d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.953+0000 7f7aaf800640 1 -- 172.21.15.5:0/3780530641 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7a88065220 msgr2=0x7f7a880676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.953+0000 7f7aaf800640 1 --2- 172.21.15.5:0/3780530641 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7a88065220 0x7f7a880676d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7a94034000 tx=0x7f7a94032000 comp rx=0 tx=0).stop 2024-08-17T02:47:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.953+0000 7f7aaf800640 1 -- 172.21.15.5:0/3780530641 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7aa8067970 msgr2=0x7f7aa8146410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.953+0000 7f7aaf800640 1 --2- 172.21.15.5:0/3780530641 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7aa8067970 0x7f7aa8146410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000cd30 tx=0x7f7aa0001ad0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.953+0000 7f7aad800640 1 -- 172.21.15.5:0/3780530641 reap_dead start 2024-08-17T02:47:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.953+0000 7f7aaf800640 1 -- 172.21.15.5:0/3780530641 shutdown_connections 2024-08-17T02:47:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.953+0000 7f7aaf800640 1 -- 172.21.15.5:0/3780530641 >> 172.21.15.5:0/3780530641 conn(0x7f7aa8066e60 msgr2=0x7f7aa8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.954+0000 7f7aaf800640 1 -- 172.21.15.5:0/3780530641 shutdown_connections 2024-08-17T02:47:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.954+0000 7fb77f400640 1 -- 172.21.15.5:0/4009970587 --> [v2:172.21.15.5:6809/37204,v1:172.21.15.5:6811/37204] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb77806e370 con 0x7fb75406d3c0 2024-08-17T02:47:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.954+0000 7f7aaf800640 1 -- 172.21.15.5:0/3780530641 wait complete. 2024-08-17T02:47:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.955+0000 7fb774c00640 1 -- 172.21.15.5:0/4009970587 <== osd.1 v2:172.21.15.5:6809/37204 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb77806e370 con 0x7fb75406d3c0 2024-08-17T02:47:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.956+0000 7fb77f400640 1 -- 172.21.15.5:0/4009970587 >> [v2:172.21.15.5:6809/37204,v1:172.21.15.5:6811/37204] conn(0x7fb75406d3c0 msgr2=0x7fb75406f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.956+0000 7fb77f400640 1 --2- 172.21.15.5:0/4009970587 >> [v2:172.21.15.5:6809/37204,v1:172.21.15.5:6811/37204] conn(0x7fb75406d3c0 0x7fb75406f7d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.957+0000 7fc7a1600640 1 -- 172.21.15.5:0/3271411227 --> [v2:172.21.15.107:6808/37109,v1:172.21.15.107:6809/37109] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc79c0ad280 con 0x7fc77806d3e0 2024-08-17T02:47:09.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.957+0000 7fb77f400640 1 -- 172.21.15.5:0/4009970587 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb7540651b0 msgr2=0x7fb754067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.957+0000 7fb77f400640 1 --2- 172.21.15.5:0/4009970587 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb7540651b0 0x7fb754067660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb768034000 tx=0x7fb768032000 comp rx=0 tx=0).stop 2024-08-17T02:47:09.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.957+0000 7fb77f400640 1 -- 172.21.15.5:0/4009970587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7780d0320 msgr2=0x7fb7780b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.957+0000 7fb77f400640 1 --2- 172.21.15.5:0/4009970587 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7780d0320 0x7fb7780b45a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb76000c5e0 tx=0x7fb760007d00 comp rx=0 tx=0).stop 2024-08-17T02:47:09.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.957+0000 7fb77d400640 1 -- 172.21.15.5:0/4009970587 reap_dead start 2024-08-17T02:47:09.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.957+0000 7fb77f400640 1 -- 172.21.15.5:0/4009970587 shutdown_connections 2024-08-17T02:47:09.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.957+0000 7fb77f400640 1 -- 172.21.15.5:0/4009970587 >> 172.21.15.5:0/4009970587 conn(0x7fb778068680 msgr2=0x7fb7780b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.957+0000 7fb77f400640 1 -- 172.21.15.5:0/4009970587 shutdown_connections 2024-08-17T02:47:09.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.957+0000 7fb77f400640 1 -- 172.21.15.5:0/4009970587 wait complete. 2024-08-17T02:47:09.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.957+0000 7fc792a00640 1 -- 172.21.15.5:0/3271411227 <== osd.5 v2:172.21.15.107:6808/37109 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc79c0ad280 con 0x7fc77806d3e0 2024-08-17T02:47:09.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.958+0000 7fc7a1600640 1 -- 172.21.15.5:0/3271411227 >> [v2:172.21.15.107:6808/37109,v1:172.21.15.107:6809/37109] conn(0x7fc77806d3e0 msgr2=0x7fc77806f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.958+0000 7fc7a1600640 1 --2- 172.21.15.5:0/3271411227 >> [v2:172.21.15.107:6808/37109,v1:172.21.15.107:6809/37109] conn(0x7fc77806d3e0 0x7fc77806f7f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.958+0000 7fc7a1600640 1 -- 172.21.15.5:0/3271411227 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc7780651d0 msgr2=0x7fc778067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.958+0000 7fc7a1600640 1 --2- 172.21.15.5:0/3271411227 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc7780651d0 0x7fc778067680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc784007fd0 tx=0x7fc784009040 comp rx=0 tx=0).stop 2024-08-17T02:47:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.958+0000 7fc7a1600640 1 -- 172.21.15.5:0/3271411227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc79c154a80 msgr2=0x7fc79c13d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.958+0000 7fc7a1600640 1 --2- 172.21.15.5:0/3271411227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc79c154a80 0x7fc79c13d2b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc79400d1a0 tx=0x7fc79403b000 comp rx=0 tx=0).stop 2024-08-17T02:47:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.958+0000 7fc79b400640 1 -- 172.21.15.5:0/3271411227 reap_dead start 2024-08-17T02:47:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.959+0000 7fc7a1600640 1 -- 172.21.15.5:0/3271411227 shutdown_connections 2024-08-17T02:47:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.959+0000 7fc7a1600640 1 -- 172.21.15.5:0/3271411227 >> 172.21.15.5:0/3271411227 conn(0x7fc79c066e60 msgr2=0x7fc79c14ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.959+0000 7f2650800640 1 -- 172.21.15.5:0/2917505884 --> [v2:172.21.15.107:6800/37108,v1:172.21.15.107:6801/37108] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2648151780 con 0x7f262c06d4b0 2024-08-17T02:47:09.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.959+0000 7fc7a1600640 1 -- 172.21.15.5:0/3271411227 shutdown_connections 2024-08-17T02:47:09.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.960+0000 7f2641600640 1 -- 172.21.15.5:0/2917505884 <== osd.4 v2:172.21.15.107:6800/37108 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2648151780 con 0x7f262c06d4b0 2024-08-17T02:47:09.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.960+0000 7fc7a1600640 1 -- 172.21.15.5:0/3271411227 wait complete. 2024-08-17T02:47:09.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.961+0000 7ff256200640 1 -- 172.21.15.5:0/1969996210 --> [v2:172.21.15.5:6800/37190,v1:172.21.15.5:6801/37190] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff250063fb0 con 0x7ff23006d4b0 2024-08-17T02:47:09.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.961+0000 7f2650800640 1 -- 172.21.15.5:0/2917505884 >> [v2:172.21.15.107:6800/37108,v1:172.21.15.107:6801/37108] conn(0x7f262c06d4b0 msgr2=0x7f262c06f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.961+0000 7f2650800640 1 --2- 172.21.15.5:0/2917505884 >> [v2:172.21.15.107:6800/37108,v1:172.21.15.107:6801/37108] conn(0x7f262c06d4b0 0x7f262c06f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.962+0000 7ff246a00640 1 -- 172.21.15.5:0/1969996210 <== osd.0 v2:172.21.15.5:6800/37190 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff250063fb0 con 0x7ff23006d4b0 2024-08-17T02:47:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.961+0000 7f2650800640 1 -- 172.21.15.5:0/2917505884 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f262c0652a0 msgr2=0x7f262c067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.961+0000 7f2650800640 1 --2- 172.21.15.5:0/2917505884 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f262c0652a0 0x7f262c067750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2648152600 tx=0x7f2644007850 comp rx=0 tx=0).stop 2024-08-17T02:47:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.961+0000 7f2650800640 1 -- 172.21.15.5:0/2917505884 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2648157550 msgr2=0x7f264806bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.962+0000 7f2650800640 1 --2- 172.21.15.5:0/2917505884 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2648157550 0x7f264806bd40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f263c035040 tx=0x7f263c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.962+0000 7f264e800640 1 -- 172.21.15.5:0/2917505884 reap_dead start 2024-08-17T02:47:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.962+0000 7f2650800640 1 -- 172.21.15.5:0/2917505884 shutdown_connections 2024-08-17T02:47:09.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.962+0000 7f2650800640 1 -- 172.21.15.5:0/2917505884 >> 172.21.15.5:0/2917505884 conn(0x7f2648067930 msgr2=0x7f26480cb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.963+0000 7f2650800640 1 -- 172.21.15.5:0/2917505884 shutdown_connections 2024-08-17T02:47:09.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.963+0000 7f2650800640 1 -- 172.21.15.5:0/2917505884 wait complete. 2024-08-17T02:47:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.966+0000 7ff256200640 1 -- 172.21.15.5:0/1969996210 >> [v2:172.21.15.5:6800/37190,v1:172.21.15.5:6801/37190] conn(0x7ff23006d4b0 msgr2=0x7ff23006f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.966+0000 7ff256200640 1 --2- 172.21.15.5:0/1969996210 >> [v2:172.21.15.5:6800/37190,v1:172.21.15.5:6801/37190] conn(0x7ff23006d4b0 0x7ff23006f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.966+0000 7ff256200640 1 -- 172.21.15.5:0/1969996210 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff2300652a0 msgr2=0x7ff230067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.966+0000 7ff256200640 1 --2- 172.21.15.5:0/1969996210 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff2300652a0 0x7ff230067750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff248007360 tx=0x7ff248001150 comp rx=0 tx=0).stop 2024-08-17T02:47:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.966+0000 7ff256200640 1 -- 172.21.15.5:0/1969996210 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2500afe30 msgr2=0x7ff2500b02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.966+0000 7ff256200640 1 --2- 172.21.15.5:0/1969996210 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2500afe30 0x7ff2500b02a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff2500cbdd0 tx=0x7ff23c009040 comp rx=0 tx=0).stop 2024-08-17T02:47:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.966+0000 7ff24fe00640 1 -- 172.21.15.5:0/1969996210 reap_dead start 2024-08-17T02:47:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.966+0000 7ff256200640 1 -- 172.21.15.5:0/1969996210 shutdown_connections 2024-08-17T02:47:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.966+0000 7ff256200640 1 -- 172.21.15.5:0/1969996210 >> 172.21.15.5:0/1969996210 conn(0x7ff25006e590 msgr2=0x7ff2500ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.966+0000 7ff256200640 1 -- 172.21.15.5:0/1969996210 shutdown_connections 2024-08-17T02:47:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.967+0000 7ff256200640 1 -- 172.21.15.5:0/1969996210 wait complete. 2024-08-17T02:47:09.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.968+0000 7f1007a00640 1 -- 172.21.15.5:0/263600951 --> [v2:172.21.15.107:6816/37110,v1:172.21.15.107:6817/37110] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f100014bdf0 con 0x7f0fe006d360 2024-08-17T02:47:09.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.969+0000 7f0ff7e00640 1 -- 172.21.15.5:0/263600951 <== osd.6 v2:172.21.15.107:6816/37110 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f100014bdf0 con 0x7f0fe006d360 2024-08-17T02:47:09.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.970+0000 7f1007a00640 1 -- 172.21.15.5:0/263600951 >> [v2:172.21.15.107:6816/37110,v1:172.21.15.107:6817/37110] conn(0x7f0fe006d360 msgr2=0x7f0fe006f770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.970+0000 7f1007a00640 1 --2- 172.21.15.5:0/263600951 >> [v2:172.21.15.107:6816/37110,v1:172.21.15.107:6817/37110] conn(0x7f0fe006d360 0x7f0fe006f770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.971+0000 7f1007a00640 1 -- 172.21.15.5:0/263600951 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0fe0065150 msgr2=0x7f0fe0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.971+0000 7f1007a00640 1 --2- 172.21.15.5:0/263600951 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0fe0065150 0x7f0fe0067600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0034000 tx=0x7f0ff0032000 comp rx=0 tx=0).stop 2024-08-17T02:47:09.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.971+0000 7f1007a00640 1 -- 172.21.15.5:0/263600951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10000b00c0 msgr2=0x7f10001464d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.971+0000 7f1007a00640 1 --2- 172.21.15.5:0/263600951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10000b00c0 0x7f10001464d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800e4f0 tx=0x7f0ff8009920 comp rx=0 tx=0).stop 2024-08-17T02:47:09.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.971+0000 7f1005a00640 1 -- 172.21.15.5:0/263600951 reap_dead start 2024-08-17T02:47:09.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.971+0000 7f1007a00640 1 -- 172.21.15.5:0/263600951 shutdown_connections 2024-08-17T02:47:09.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.971+0000 7f1007a00640 1 -- 172.21.15.5:0/263600951 >> 172.21.15.5:0/263600951 conn(0x7f1000066e60 msgr2=0x7f100006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.974+0000 7f1007a00640 1 -- 172.21.15.5:0/263600951 shutdown_connections 2024-08-17T02:47:09.023 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-08-17T02:47:09.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.974+0000 7f1007a00640 1 -- 172.21.15.5:0/263600951 wait complete. 2024-08-17T02:47:09.025 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:47:09.026 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-08-17T02:47:09.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:47:09.027 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-08-17T02:47:09.027 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:47:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.984+0000 7f9d6fe00640 1 -- 172.21.15.5:0/4076321148 --> [v2:172.21.15.107:6824/37152,v1:172.21.15.107:6825/37152] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d50002ca0 con 0x7f9d5c06d430 2024-08-17T02:47:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.985+0000 7f9d76a00640 1 -- 172.21.15.5:0/4076321148 <== osd.7 v2:172.21.15.107:6824/37152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9d50002ca0 con 0x7f9d5c06d430 2024-08-17T02:47:09.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.986+0000 7f9d6fe00640 1 -- 172.21.15.5:0/4076321148 >> [v2:172.21.15.107:6824/37152,v1:172.21.15.107:6825/37152] conn(0x7f9d5c06d430 msgr2=0x7f9d5c06f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.986+0000 7f9d6fe00640 1 --2- 172.21.15.5:0/4076321148 >> [v2:172.21.15.107:6824/37152,v1:172.21.15.107:6825/37152] conn(0x7f9d5c06d430 0x7f9d5c06f840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.987+0000 7f9d6fe00640 1 -- 172.21.15.5:0/4076321148 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9d5c065220 msgr2=0x7f9d5c0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.987+0000 7f9d6fe00640 1 --2- 172.21.15.5:0/4076321148 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9d5c065220 0x7f9d5c0676d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9d78034000 tx=0x7f9d78037000 comp rx=0 tx=0).stop 2024-08-17T02:47:09.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.987+0000 7f9d6fe00640 1 -- 172.21.15.5:0/4076321148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d80158e50 msgr2=0x7f9d8009a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.987+0000 7f9d6fe00640 1 --2- 172.21.15.5:0/4076321148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d80158e50 0x7f9d8009a3e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000c590 tx=0x7f9d70007d70 comp rx=0 tx=0).stop 2024-08-17T02:47:09.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.987+0000 7f9d7fe00640 1 -- 172.21.15.5:0/4076321148 reap_dead start 2024-08-17T02:47:09.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.987+0000 7f9d6fe00640 1 -- 172.21.15.5:0/4076321148 shutdown_connections 2024-08-17T02:47:09.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.987+0000 7f9d6fe00640 1 -- 172.21.15.5:0/4076321148 >> 172.21.15.5:0/4076321148 conn(0x7f9d80095a70 msgr2=0x7f9d80157d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.987+0000 7f9d6fe00640 1 -- 172.21.15.5:0/4076321148 shutdown_connections 2024-08-17T02:47:09.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:08.987+0000 7f9d6fe00640 1 -- 172.21.15.5:0/4076321148 wait complete. 2024-08-17T02:47:09.031 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-08-17T02:47:09.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:47:09.032 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-08-17T02:47:09.032 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:47:09.033 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-08-17T02:47:09.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:47:09.035 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-08-17T02:47:09.035 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:47:09.037 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-08-17T02:47:09.037 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:47:09.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.333+0000 7f04d9200640 1 Processor -- start 2024-08-17T02:47:09.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.333+0000 7f04d9200640 1 -- start start 2024-08-17T02:47:09.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.335+0000 7f04d9200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04cc0e26b0 0x7f04cc006bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.335+0000 7f04d9200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04cc0543f0 0x7f04cc0e2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.335+0000 7f04d9200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f04cc0e2fc0 0x7f04cc057aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.335+0000 7f04d9200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04cc0572e0 con 0x7f04cc0e26b0 2024-08-17T02:47:09.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.335+0000 7f04d9200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04cc0074b0 con 0x7f04cc0e2fc0 2024-08-17T02:47:09.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.335+0000 7f04d9200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc007790 con 0x7f04cc0543f0 2024-08-17T02:47:09.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.335+0000 7f04d3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04cc0e26b0 0x7f04cc006bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.335+0000 7f04d2a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04cc0543f0 0x7f04cc0e2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.335+0000 7f04d2a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04cc0543f0 0x7f04cc0e2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:59208/0 (socket says 172.21.15.5:59208) 2024-08-17T02:47:09.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.335+0000 7f04d2a00640 1 -- 172.21.15.5:0/4070747186 learned_addr learned my addr 172.21.15.5:0/4070747186 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:09.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.336+0000 7f04d3e00640 1 --2- 172.21.15.5:0/4070747186 >> v2:172.21.15.107:3300/0 conn(0x7f04cc0e2fc0 0x7f04cc057aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.336+0000 7f04d2a00640 1 -- 172.21.15.5:0/4070747186 >> v2:172.21.15.107:3300/0 conn(0x7f04cc0e2fc0 msgr2=0x7f04cc057aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:09.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.336+0000 7f04d2a00640 1 --2- 172.21.15.5:0/4070747186 >> v2:172.21.15.107:3300/0 conn(0x7f04cc0e2fc0 0x7f04cc057aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.336+0000 7f04d2a00640 1 -- 172.21.15.5:0/4070747186 >> v2:172.21.15.5:3300/0 conn(0x7f04cc0e26b0 msgr2=0x7f04cc006bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:09.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.336+0000 7f04d2a00640 1 --2- 172.21.15.5:0/4070747186 >> v2:172.21.15.5:3300/0 conn(0x7f04cc0e26b0 0x7f04cc006bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.338+0000 7f8bc4a00640 1 Processor -- start 2024-08-17T02:47:09.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.336+0000 7f04d2a00640 1 -- 172.21.15.5:0/4070747186 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc057580 con 0x7f04cc0543f0 2024-08-17T02:47:09.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.338+0000 7f04d3e00640 1 --2- 172.21.15.5:0/4070747186 >> v2:172.21.15.107:3300/0 conn(0x7f04cc0e2fc0 0x7f04cc057aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:09.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.338+0000 7f04d2a00640 1 --2- 172.21.15.5:0/4070747186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04cc0543f0 0x7f04cc0e2a80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f04d4064f60 tx=0x7f04d4064990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4e73065189b798a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.339+0000 7f04d2000640 1 -- 172.21.15.5:0/4070747186 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d40ba3f0 con 0x7f04cc0543f0 2024-08-17T02:47:09.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.339+0000 7f04d2000640 1 -- 172.21.15.5:0/4070747186 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d40ba550 con 0x7f04cc0543f0 2024-08-17T02:47:09.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.339+0000 7f04d2000640 1 -- 172.21.15.5:0/4070747186 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d40ba990 con 0x7f04cc0543f0 2024-08-17T02:47:09.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.340+0000 7f04d9200640 1 -- 172.21.15.5:0/4070747186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04cc0543f0 msgr2=0x7f04cc0e2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.340+0000 7f04d9200640 1 --2- 172.21.15.5:0/4070747186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04cc0543f0 0x7f04cc0e2a80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f04d4064f60 tx=0x7f04d4064990 comp rx=0 tx=0).stop 2024-08-17T02:47:09.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.340+0000 7f04d9200640 1 -- 172.21.15.5:0/4070747186 shutdown_connections 2024-08-17T02:47:09.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.340+0000 7f04d9200640 1 --2- 172.21.15.5:0/4070747186 >> v2:172.21.15.107:3300/0 conn(0x7f04cc0e2fc0 0x7f04cc057aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.340+0000 7f04d9200640 1 --2- 172.21.15.5:0/4070747186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04cc0543f0 0x7f04cc0e2a80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.340+0000 7f04d9200640 1 --2- 172.21.15.5:0/4070747186 >> v2:172.21.15.5:3300/0 conn(0x7f04cc0e26b0 0x7f04cc006bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.340+0000 7f04d9200640 1 -- 172.21.15.5:0/4070747186 >> 172.21.15.5:0/4070747186 conn(0x7f04cc00e5c0 msgr2=0x7f04cc00e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.339+0000 7f8bc4a00640 1 -- start start 2024-08-17T02:47:09.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.340+0000 7f04d9200640 1 -- 172.21.15.5:0/4070747186 shutdown_connections 2024-08-17T02:47:09.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.341+0000 7f8bc4a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8bc0154a80 0x7f8bc00abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.342+0000 7f8bc4a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8bc006dee0 0x7f8bc0154e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.342+0000 7f8bc4a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc00afb80 con 0x7f8bc0159320 2024-08-17T02:47:09.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.341+0000 7f04d9200640 1 -- 172.21.15.5:0/4070747186 wait complete. 2024-08-17T02:47:09.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.342+0000 7f8bc4a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc00ac4f0 con 0x7f8bc0154a80 2024-08-17T02:47:09.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.342+0000 7f8bc4a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc00ac7d0 con 0x7f8bc006dee0 2024-08-17T02:47:09.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.342+0000 7f8bbde00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8bc0154a80 0x7f8bc00abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.343+0000 7f04d9200640 1 Processor -- start 2024-08-17T02:47:09.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.343+0000 7f8bbde00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8bc0154a80 0x7f8bc00abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:47572/0 (socket says 172.21.15.5:47572) 2024-08-17T02:47:09.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.343+0000 7f8bbde00640 1 -- 172.21.15.5:0/3234247473 learned_addr learned my addr 172.21.15.5:0/3234247473 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:09.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.343+0000 7f04d9200640 1 -- start start 2024-08-17T02:47:09.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.343+0000 7f8bbe800640 1 --2- 172.21.15.5:0/3234247473 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8bc006dee0 0x7f8bc0154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.344+0000 7f8bbca00640 1 -- 172.21.15.5:0/3234247473 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172443157 0 0) 0x7f8bc00afb80 con 0x7f8bc0159320 2024-08-17T02:47:09.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.345+0000 7f8bbca00640 1 -- 172.21.15.5:0/3234247473 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ba40056f0 con 0x7f8bc0159320 2024-08-17T02:47:09.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.344+0000 7f04d9200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04cc0543f0 0x7f04cc03df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.344+0000 7f04d9200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04cc0e26b0 0x7f04cc0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.344+0000 7f04d9200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04cc0e2fc0 0x7f04cc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.344+0000 7f04d9200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc03edf0 con 0x7f04cc0e26b0 2024-08-17T02:47:09.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.344+0000 7f04d9200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc03e830 con 0x7f04cc0e2fc0 2024-08-17T02:47:09.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.344+0000 7f04d9200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc03eb10 con 0x7f04cc0543f0 2024-08-17T02:47:09.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.344+0000 7f04d3400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04cc0543f0 0x7f04cc03df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.344+0000 7f04d3400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04cc0543f0 0x7f04cc03df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:59220/0 (socket says 172.21.15.5:59220) 2024-08-17T02:47:09.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.344+0000 7f04d3400640 1 -- 172.21.15.5:0/2066673199 learned_addr learned my addr 172.21.15.5:0/2066673199 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:09.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.345+0000 7f04d2a00640 1 --2- 172.21.15.5:0/2066673199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04cc0e26b0 0x7f04cc0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.345+0000 7f04d3e00640 1 --2- 172.21.15.5:0/2066673199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04cc0e2fc0 0x7f04cc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.345+0000 7f04d3400640 1 -- 172.21.15.5:0/2066673199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04cc0e2fc0 msgr2=0x7f04cc0579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.345+0000 7f04d3400640 1 --2- 172.21.15.5:0/2066673199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04cc0e2fc0 0x7f04cc0579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.345+0000 7f04d3400640 1 -- 172.21.15.5:0/2066673199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04cc0e26b0 msgr2=0x7f04cc0cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.345+0000 7f04d3400640 1 --2- 172.21.15.5:0/2066673199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04cc0e26b0 0x7f04cc0cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.345+0000 7f04d3400640 1 -- 172.21.15.5:0/2066673199 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d404c200 con 0x7f04cc0543f0 2024-08-17T02:47:09.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.345+0000 7f04d2a00640 1 --2- 172.21.15.5:0/2066673199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04cc0e26b0 0x7f04cc0cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:09.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.346+0000 7f04d3400640 1 --2- 172.21.15.5:0/2066673199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04cc0543f0 0x7f04cc03df50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f04c800e900 tx=0x7f04c80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.345+0000 7f8bbe800640 1 -- 172.21.15.5:0/3234247473 >> v2:172.21.15.107:3300/0 conn(0x7f8bc0154a80 msgr2=0x7f8bc00abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:09.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.345+0000 7f8bbe800640 1 --2- 172.21.15.5:0/3234247473 >> v2:172.21.15.107:3300/0 conn(0x7f8bc0154a80 0x7f8bc00abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.345+0000 7f8bbe800640 1 -- 172.21.15.5:0/3234247473 >> v1:172.21.15.5:6789/0 conn(0x7f8bc0159320 legacy=0x7f8bc006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.345+0000 7f8bbe800640 1 -- 172.21.15.5:0/3234247473 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc00acab0 con 0x7f8bc006dee0 2024-08-17T02:47:09.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.347+0000 7f04c6a00640 1 -- 172.21.15.5:0/2066673199 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c800c8e0 con 0x7f04cc0543f0 2024-08-17T02:47:09.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.347+0000 7f04c6a00640 1 -- 172.21.15.5:0/2066673199 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c800ca40 con 0x7f04cc0543f0 2024-08-17T02:47:09.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.347+0000 7f04c6a00640 1 -- 172.21.15.5:0/2066673199 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c800cdc0 con 0x7f04cc0543f0 2024-08-17T02:47:09.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.347+0000 7f04d9200640 1 -- 172.21.15.5:0/2066673199 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04cc0d3170 con 0x7f04cc0543f0 2024-08-17T02:47:09.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.347+0000 7f04d9200640 1 -- 172.21.15.5:0/2066673199 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc03e490 con 0x7f04cc0543f0 2024-08-17T02:47:09.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.347+0000 7f8bbe800640 1 --2- 172.21.15.5:0/3234247473 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8bc006dee0 0x7f8bc0154e50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009850 tx=0x7f8bb00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8bbd8ff465ae729 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.348+0000 7f8bbca00640 1 -- 172.21.15.5:0/3234247473 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb002adb0 con 0x7f8bc006dee0 2024-08-17T02:47:09.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.348+0000 7f8bbca00640 1 -- 172.21.15.5:0/3234247473 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb0032440 con 0x7f8bc006dee0 2024-08-17T02:47:09.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.348+0000 7f8bbca00640 1 -- 172.21.15.5:0/3234247473 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0032820 con 0x7f8bc006dee0 2024-08-17T02:47:09.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.349+0000 7f04d9200640 1 -- 172.21.15.5:0/2066673199 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04cc0d3670 con 0x7f04cc0543f0 2024-08-17T02:47:09.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.350+0000 7f8bc4a00640 1 -- 172.21.15.5:0/3234247473 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8bc006dee0 msgr2=0x7f8bc0154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.350+0000 7f8bc4a00640 1 --2- 172.21.15.5:0/3234247473 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8bc006dee0 0x7f8bc0154e50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009850 tx=0x7f8bb00090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.350+0000 7f8bc4a00640 1 -- 172.21.15.5:0/3234247473 shutdown_connections 2024-08-17T02:47:09.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.350+0000 7f8bc4a00640 1 --2- 172.21.15.5:0/3234247473 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8bc006dee0 0x7f8bc0154e50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.349+0000 7f69a8e00640 1 Processor -- start 2024-08-17T02:47:09.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.350+0000 7f69a8e00640 1 -- start start 2024-08-17T02:47:09.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.350+0000 7f8bc4a00640 1 --2- 172.21.15.5:0/3234247473 >> v2:172.21.15.107:3300/0 conn(0x7f8bc0154a80 0x7f8bc00abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.351+0000 7f8bc4a00640 1 -- 172.21.15.5:0/3234247473 >> 172.21.15.5:0/3234247473 conn(0x7f8bc0066e60 msgr2=0x7f8bc0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.352+0000 7f69a8e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69a40ac620 0x7f69a40c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.352+0000 7f8bc4a00640 1 -- 172.21.15.5:0/3234247473 shutdown_connections 2024-08-17T02:47:09.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.352+0000 7f69a8e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a406e400 con 0x7f69a415cf40 2024-08-17T02:47:09.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.352+0000 7f8bc4a00640 1 -- 172.21.15.5:0/3234247473 wait complete. 2024-08-17T02:47:09.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.352+0000 7f04c6a00640 1 -- 172.21.15.5:0/2066673199 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f04c8013680 con 0x7f04cc0543f0 2024-08-17T02:47:09.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.353+0000 7f9e9de00640 1 Processor -- start 2024-08-17T02:47:09.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.352+0000 7f69a8e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a40af5a0 con 0x7f69a415d310 2024-08-17T02:47:09.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.353+0000 7ff591c00640 1 Processor -- start 2024-08-17T02:47:09.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.353+0000 7ff591c00640 1 -- start start 2024-08-17T02:47:09.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.352+0000 7f69a8e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a40ae990 con 0x7f69a40ac620 2024-08-17T02:47:09.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.353+0000 7f69a2800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f69a415d310 0x7f69a40afa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:60616/0 (socket says 172.21.15.5:60616) 2024-08-17T02:47:09.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.354+0000 7f69a1e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f69a415cf40 0x7f69a40abf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42148/0 (socket says 172.21.15.5:42148) 2024-08-17T02:47:09.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.354+0000 7f69a1e00640 1 -- 172.21.15.5:0/2171772820 learned_addr learned my addr 172.21.15.5:0/2171772820 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:09.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.354+0000 7f04c6a00640 1 --2- 172.21.15.5:0/2066673199 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f04b40652a0 0x7f04b4067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.354+0000 7f04c6a00640 1 -- 172.21.15.5:0/2066673199 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04c8082560 con 0x7f04cc0543f0 2024-08-17T02:47:09.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.354+0000 7f6999400640 1 --2- 172.21.15.5:0/2171772820 >> v2:172.21.15.5:3300/0 conn(0x7f69a40ac620 0x7f69a40c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.355+0000 7f8bc4a00640 1 Processor -- start 2024-08-17T02:47:09.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.355+0000 7f69a1400640 1 -- 172.21.15.5:0/2171772820 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708587333 0 0) 0x7f69a406e400 con 0x7f69a415cf40 2024-08-17T02:47:09.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.353+0000 7f9e9de00640 1 -- start start 2024-08-17T02:47:09.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.355+0000 7f9e9de00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9e98154a80 0x7f9e980abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.355+0000 7f9e9de00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e98159320 0x7f9e9806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.355+0000 7f9e9de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e9806dd10 0x7f9e98154e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.355+0000 7f9e9de00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e9806e140 con 0x7f9e9806dd10 2024-08-17T02:47:09.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.355+0000 7f9e9de00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e980afb80 con 0x7f9e98154a80 2024-08-17T02:47:09.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.355+0000 7f9e9de00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e980ac4f0 con 0x7f9e98159320 2024-08-17T02:47:09.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.355+0000 7f8bc4a00640 1 -- start start 2024-08-17T02:47:09.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.355+0000 7f69a1400640 1 -- 172.21.15.5:0/2171772820 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69880034e0 con 0x7f69a415cf40 2024-08-17T02:47:09.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.355+0000 7f69a1400640 1 -- 172.21.15.5:0/2171772820 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851504750 0 0) 0x7f69a40af5a0 con 0x7f69a415d310 2024-08-17T02:47:09.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.355+0000 7f69a1400640 1 -- 172.21.15.5:0/2171772820 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69a406e400 con 0x7f69a415d310 2024-08-17T02:47:09.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.355+0000 7f04d2a00640 1 --2- 172.21.15.5:0/2066673199 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f04b40652a0 0x7f04b4067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.356+0000 7f9e96a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9e98154a80 0x7f9e980abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.356+0000 7f9e96a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9e98154a80 0x7f9e980abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:47586/0 (socket says 172.21.15.5:47586) 2024-08-17T02:47:09.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.356+0000 7f9e96a00640 1 -- 172.21.15.5:0/286358929 learned_addr learned my addr 172.21.15.5:0/286358929 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:09.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.356+0000 7f9e96000640 1 --2- 172.21.15.5:0/286358929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e98159320 0x7f9e9806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.356+0000 7f6999400640 1 -- 172.21.15.5:0/2171772820 >> v1:172.21.15.107:6789/0 conn(0x7f69a415d310 legacy=0x7f69a40afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.355+0000 7ff591c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff58c1589e0 0x7ff58c158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.356+0000 7ff591c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0ce140 0x7ff58c0cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.356+0000 7ff591c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58c0af9a0 con 0x7ff58c0ca9c0 2024-08-17T02:47:09.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.356+0000 7ff591c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff58c0af810 con 0x7ff58c1589e0 2024-08-17T02:47:09.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.356+0000 7ff591c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c0cb340 con 0x7ff58c0ce140 2024-08-17T02:47:09.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.356+0000 7ff58b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0ce140 0x7ff58c0cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.356+0000 7f9e97400640 1 --2- 172.21.15.5:0/286358929 >> v2:172.21.15.5:3300/0 conn(0x7f9e9806dd10 0x7f9e98154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.357+0000 7f04d2a00640 1 --2- 172.21.15.5:0/2066673199 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f04b40652a0 0x7f04b4067750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0078d0 tx=0x7f04d40bc000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.356+0000 7f69a1400640 1 -- 172.21.15.5:0/2171772820 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3272274486 0 0) 0x7f69a406e400 con 0x7f69a415d310 2024-08-17T02:47:09.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.356+0000 7f6999400640 1 -- 172.21.15.5:0/2171772820 >> v1:172.21.15.5:6789/0 conn(0x7f69a415cf40 legacy=0x7f69a40abf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.356+0000 7f6999400640 1 -- 172.21.15.5:0/2171772820 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a40aec70 con 0x7f69a40ac620 2024-08-17T02:47:09.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.356+0000 7ff58b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0ce140 0x7ff58c0cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:59236/0 (socket says 172.21.15.5:59236) 2024-08-17T02:47:09.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.356+0000 7ff58b400640 1 -- 172.21.15.5:0/1879103747 learned_addr learned my addr 172.21.15.5:0/1879103747 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:09.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.357+0000 7ff58b400640 1 -- 172.21.15.5:0/1879103747 >> v2:172.21.15.5:3300/0 conn(0x7ff58c1589e0 msgr2=0x7ff58c158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:09.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.357+0000 7ff58b400640 1 --2- 172.21.15.5:0/1879103747 >> v2:172.21.15.5:3300/0 conn(0x7ff58c1589e0 0x7ff58c158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.357+0000 7f9e96a00640 1 -- 172.21.15.5:0/286358929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e98159320 msgr2=0x7f9e9806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:09.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.357+0000 7f9e96a00640 1 --2- 172.21.15.5:0/286358929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e98159320 0x7f9e9806d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.357+0000 7f9e96a00640 1 -- 172.21.15.5:0/286358929 >> v2:172.21.15.5:3300/0 conn(0x7f9e9806dd10 msgr2=0x7f9e98154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:09.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.357+0000 7f9e96a00640 1 --2- 172.21.15.5:0/286358929 >> v2:172.21.15.5:3300/0 conn(0x7f9e9806dd10 0x7f9e98154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.357+0000 7ff58b400640 1 -- 172.21.15.5:0/1879103747 >> v1:172.21.15.107:6789/0 conn(0x7ff58c0ca9c0 legacy=0x7ff58c0cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.357+0000 7ff589600640 1 -- 172.21.15.5:0/1879103747 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912727883 0 0) 0x7ff58c0af9a0 con 0x7ff58c0ca9c0 2024-08-17T02:47:09.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.357+0000 7ff58b400640 1 -- 172.21.15.5:0/1879103747 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c0ce740 con 0x7ff58c0ce140 2024-08-17T02:47:09.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.357+0000 7f9e96a00640 1 -- 172.21.15.5:0/286358929 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e980ac7d0 con 0x7f9e98154a80 2024-08-17T02:47:09.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.358+0000 7f8bc4a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bc006dee0 0x7f8bc00cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.358+0000 7f8bc4a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8bc0154a80 0x7f8bc016d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.358+0000 7f8bc4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bc0159320 0x7f8bc01538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.358+0000 7f9e96000640 1 --2- 172.21.15.5:0/286358929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e98159320 0x7f9e9806d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:09.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.358+0000 7f8bbde00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bc006dee0 0x7f8bc00cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.358+0000 7f8bc4a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc01420b0 con 0x7f8bc0159320 2024-08-17T02:47:09.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.358+0000 7f8bc4a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc00cc130 con 0x7f8bc006dee0 2024-08-17T02:47:09.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.358+0000 7f8bc4a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc014b7a0 con 0x7f8bc0154a80 2024-08-17T02:47:09.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.358+0000 7fa7f3200640 1 Processor -- start 2024-08-17T02:47:09.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.358+0000 7fa7f3200640 1 -- start start 2024-08-17T02:47:09.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.359+0000 7f6999400640 1 --2- 172.21.15.5:0/2171772820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69a40ac620 0x7f69a40c7fc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f69940097d0 tx=0x7f69940090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c52710f7fe6ab4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.359+0000 7f9e96a00640 1 --2- 172.21.15.5:0/286358929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e98154a80 0x7f9e980abef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9e9806e6a0 tx=0x7f9e90007820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57b80b8d891e1ffa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.358+0000 7f8bbde00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bc006dee0 0x7f8bc00cae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:47596/0 (socket says 172.21.15.5:47596) 2024-08-17T02:47:09.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.358+0000 7f8bbde00640 1 -- 172.21.15.5:0/3399420411 learned_addr learned my addr 172.21.15.5:0/3399420411 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:09.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.359+0000 7f8bbe800640 1 --2- 172.21.15.5:0/3399420411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bc0159320 0x7f8bc01538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.359+0000 7f8bbd400640 1 --2- 172.21.15.5:0/3399420411 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8bc0154a80 0x7f8bc016d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.359+0000 7ff58b400640 1 --2- 172.21.15.5:0/1879103747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0ce140 0x7ff58c0cae00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff584009f20 tx=0x7ff584009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bcd42b1f278b866 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.359+0000 7f9e95600640 1 -- 172.21.15.5:0/286358929 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9002e640 con 0x7f9e98154a80 2024-08-17T02:47:09.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.359+0000 7f9e95600640 1 -- 172.21.15.5:0/286358929 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9002e7a0 con 0x7f9e98154a80 2024-08-17T02:47:09.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.359+0000 7f16d5400640 1 Processor -- start 2024-08-17T02:47:09.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.359+0000 7f16d5400640 1 -- start start 2024-08-17T02:47:09.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7f9e95600640 1 -- 172.21.15.5:0/286358929 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9002eb80 con 0x7f9e98154a80 2024-08-17T02:47:09.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7ff589600640 1 -- 172.21.15.5:0/1879103747 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584031400 con 0x7ff58c0ce140 2024-08-17T02:47:09.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7ff589600640 1 -- 172.21.15.5:0/1879103747 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58402d050 con 0x7ff58c0ce140 2024-08-17T02:47:09.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7ff589600640 1 -- 172.21.15.5:0/1879103747 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5840317d0 con 0x7ff58c0ce140 2024-08-17T02:47:09.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7f8bbde00640 1 -- 172.21.15.5:0/3399420411 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8bc0154a80 msgr2=0x7f8bc016d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7f8bbde00640 1 --2- 172.21.15.5:0/3399420411 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8bc0154a80 0x7f8bc016d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7f8bbde00640 1 -- 172.21.15.5:0/3399420411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bc0159320 msgr2=0x7f8bc01538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7f8bbde00640 1 --2- 172.21.15.5:0/3399420411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bc0159320 0x7f8bc01538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7f8bbde00640 1 -- 172.21.15.5:0/3399420411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0009390 con 0x7f8bc006dee0 2024-08-17T02:47:09.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7f8bbd400640 1 --2- 172.21.15.5:0/3399420411 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8bc0154a80 0x7f8bc016d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:09.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7f8bbe800640 1 --2- 172.21.15.5:0/3399420411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bc0159320 0x7f8bc01538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:09.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7f69a1400640 1 -- 172.21.15.5:0/2171772820 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c0017f0 con 0x7f69a40ac620 2024-08-17T02:47:09.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7f69a1400640 1 -- 172.21.15.5:0/2171772820 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699402aa70 con 0x7f69a40ac620 2024-08-17T02:47:09.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7f69a1400640 1 -- 172.21.15.5:0/2171772820 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699402ae10 con 0x7f69a40ac620 2024-08-17T02:47:09.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7ff591c00640 1 -- 172.21.15.5:0/1879103747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0ce140 msgr2=0x7ff58c0cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7ff591c00640 1 --2- 172.21.15.5:0/1879103747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0ce140 0x7ff58c0cae00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff584009f20 tx=0x7ff584009840 comp rx=0 tx=0).stop 2024-08-17T02:47:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7f9e9de00640 1 -- 172.21.15.5:0/286358929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e98154a80 msgr2=0x7f9e980abef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.360+0000 7f9e9de00640 1 --2- 172.21.15.5:0/286358929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e98154a80 0x7f9e980abef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9e9806e6a0 tx=0x7f9e90007820 comp rx=0 tx=0).stop 2024-08-17T02:47:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f8bbde00640 1 --2- 172.21.15.5:0/3399420411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bc006dee0 0x7f8bc00cae60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8007c50 tx=0x7f8bb8009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f04c6a00640 1 -- 172.21.15.5:0/2066673199 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f04c80506b0 con 0x7f04cc0543f0 2024-08-17T02:47:09.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f9e9de00640 1 -- 172.21.15.5:0/286358929 shutdown_connections 2024-08-17T02:47:09.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f9e9de00640 1 --2- 172.21.15.5:0/286358929 >> v2:172.21.15.5:3300/0 conn(0x7f9e9806dd10 0x7f9e98154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f9e9de00640 1 --2- 172.21.15.5:0/286358929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e98159320 0x7f9e9806d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f9e9de00640 1 --2- 172.21.15.5:0/286358929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e98154a80 0x7f9e980abef0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f9e9de00640 1 -- 172.21.15.5:0/286358929 >> 172.21.15.5:0/286358929 conn(0x7f9e98066e60 msgr2=0x7f9e98067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7ff591c00640 1 -- 172.21.15.5:0/1879103747 shutdown_connections 2024-08-17T02:47:09.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7ff591c00640 1 --2- 172.21.15.5:0/1879103747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0ce140 0x7ff58c0cae00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7ff591c00640 1 --2- 172.21.15.5:0/1879103747 >> v2:172.21.15.5:3300/0 conn(0x7ff58c1589e0 0x7ff58c158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f3f42000640 1 Processor -- start 2024-08-17T02:47:09.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7fa7f3200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa7f4157e10 0x7fa7f40ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f69a8e00640 1 -- 172.21.15.5:0/2171772820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69a40ac620 msgr2=0x7f69a40c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f69a8e00640 1 --2- 172.21.15.5:0/2171772820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69a40ac620 0x7f69a40c7fc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f69940097d0 tx=0x7f69940090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f8bb5600640 1 -- 172.21.15.5:0/3399420411 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8007e90 con 0x7f8bc006dee0 2024-08-17T02:47:09.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f9e9de00640 1 -- 172.21.15.5:0/286358929 shutdown_connections 2024-08-17T02:47:09.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f3f42000640 1 -- start start 2024-08-17T02:47:09.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f9e9de00640 1 -- 172.21.15.5:0/286358929 wait complete. 2024-08-17T02:47:09.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7fa7f3200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f40ae2e0 con 0x7fa7f40aae50 2024-08-17T02:47:09.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7fa7f3200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f4156030 con 0x7fa7f40cc0c0 2024-08-17T02:47:09.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7fa7f3200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f4155160 con 0x7fa7f4157e10 2024-08-17T02:47:09.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f8bc4a00640 1 -- 172.21.15.5:0/3399420411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc00cb520 con 0x7f8bc006dee0 2024-08-17T02:47:09.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.362+0000 7f8bc4a00640 1 -- 172.21.15.5:0/3399420411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc00cbb60 con 0x7f8bc006dee0 2024-08-17T02:47:09.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7ff591c00640 1 -- 172.21.15.5:0/1879103747 >> 172.21.15.5:0/1879103747 conn(0x7ff58c06e590 msgr2=0x7ff58c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.362+0000 7f8bb5600640 1 -- 172.21.15.5:0/3399420411 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb8007e90 con 0x7f8bc006dee0 2024-08-17T02:47:09.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.363+0000 7f69a8e00640 1 -- 172.21.15.5:0/2171772820 shutdown_connections 2024-08-17T02:47:09.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.363+0000 7f69a8e00640 1 --2- 172.21.15.5:0/2171772820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69a40ac620 0x7f69a40c7fc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.363+0000 7f69a8e00640 1 -- 172.21.15.5:0/2171772820 >> 172.21.15.5:0/2171772820 conn(0x7f69a4066e60 msgr2=0x7f69a4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f16d5400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f16d014fe00 0x7f16d00cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f16d5400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16d00cca30 0x7f16d00cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f16d5400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d00d0150 0x7f16d015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f16d5400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d00af8e0 con 0x7f16d00cca30 2024-08-17T02:47:09.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f16d5400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d00d05b0 con 0x7f16d014fe00 2024-08-17T02:47:09.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.361+0000 7f16d5400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00cdef0 con 0x7f16d00d0150 2024-08-17T02:47:09.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.362+0000 7f16cde00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16d00cca30 0x7f16d00cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.362+0000 7f16cde00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16d00cca30 0x7f16d00cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33500/0 (socket says 172.21.15.5:33500) 2024-08-17T02:47:09.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.362+0000 7f16cde00640 1 -- 172.21.15.5:0/912240805 learned_addr learned my addr 172.21.15.5:0/912240805 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:09.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.362+0000 7f16ce800640 1 --2- 172.21.15.5:0/912240805 >> v2:172.21.15.107:3300/0 conn(0x7f16d014fe00 0x7f16d00cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.362+0000 7f16cf200640 1 --2- 172.21.15.5:0/912240805 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d00d0150 0x7f16d015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.363+0000 7f8bb5600640 1 -- 172.21.15.5:0/3399420411 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8017440 con 0x7f8bc006dee0 2024-08-17T02:47:09.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.362+0000 7ff591c00640 1 -- 172.21.15.5:0/1879103747 shutdown_connections 2024-08-17T02:47:09.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.363+0000 7ff591c00640 1 -- 172.21.15.5:0/1879103747 wait complete. 2024-08-17T02:47:09.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.363+0000 7f69a8e00640 1 -- 172.21.15.5:0/2171772820 shutdown_connections 2024-08-17T02:47:09.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.363+0000 7f16ce800640 1 -- 172.21.15.5:0/912240805 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d00d0150 msgr2=0x7f16d015cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:09.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.363+0000 7f16ce800640 1 --2- 172.21.15.5:0/912240805 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d00d0150 0x7f16d015cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.363+0000 7f16ce800640 1 -- 172.21.15.5:0/912240805 >> v2:172.21.15.5:3300/0 conn(0x7f16d00cca30 msgr2=0x7f16d00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:09.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.363+0000 7f16ce800640 1 --2- 172.21.15.5:0/912240805 >> v2:172.21.15.5:3300/0 conn(0x7f16d00cca30 0x7f16d00cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.363+0000 7f16ce800640 1 -- 172.21.15.5:0/912240805 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d00ccf10 con 0x7f16d014fe00 2024-08-17T02:47:09.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.362+0000 7fa7ebe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa7f40cc0c0 0x7fa7f40aa740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:60630/0 (socket says 172.21.15.5:60630) 2024-08-17T02:47:09.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.362+0000 7fa7ebe00640 1 -- 172.21.15.5:0/161521803 learned_addr learned my addr 172.21.15.5:0/161521803 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:09.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.362+0000 7fa7f1e00640 1 --2- 172.21.15.5:0/161521803 >> v2:172.21.15.107:3300/0 conn(0x7fa7f4157e10 0x7fa7f40ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.363+0000 7fa7f1400640 1 -- 172.21.15.5:0/161521803 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170547143 0 0) 0x7fa7f4156030 con 0x7fa7f40cc0c0 2024-08-17T02:47:09.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.363+0000 7fa7f1400640 1 -- 172.21.15.5:0/161521803 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d80056f0 con 0x7fa7f40cc0c0 2024-08-17T02:47:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.363+0000 7fa7f1400640 1 -- 172.21.15.5:0/161521803 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 726915366 0 0) 0x7fa7d80056f0 con 0x7fa7f40cc0c0 2024-08-17T02:47:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.363+0000 7fa7f1400640 1 -- 172.21.15.5:0/161521803 >> v2:172.21.15.107:3300/0 conn(0x7fa7f4157e10 msgr2=0x7fa7f40ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.364+0000 7fa7f1400640 1 --2- 172.21.15.5:0/161521803 >> v2:172.21.15.107:3300/0 conn(0x7fa7f4157e10 0x7fa7f40ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.364+0000 7fa7f1400640 1 -- 172.21.15.5:0/161521803 >> v1:172.21.15.5:6789/0 conn(0x7fa7f40aae50 legacy=0x7fa7f414ea10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:47:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.364+0000 7fa7f1400640 1 -- 172.21.15.5:0/161521803 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f4155420 con 0x7fa7f40cc0c0 2024-08-17T02:47:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.364+0000 7fa7f1400640 1 -- 172.21.15.5:0/161521803 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7fa7e4004c40 con 0x7fa7f40cc0c0 2024-08-17T02:47:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.364+0000 7fa7f1400640 1 -- 172.21.15.5:0/161521803 >> v1:172.21.15.107:6789/0 conn(0x7fa7f40cc0c0 legacy=0x7fa7f40aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.364+0000 7fa7f1400640 1 --2- 172.21.15.5:0/161521803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7d8005c60 0x7fa7d8006050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.364+0000 7fa7f1400640 1 --2- 172.21.15.5:0/161521803 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7d8006990 0x7fa7d8006e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.364+0000 7fa7f1400640 1 --2- 172.21.15.5:0/161521803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7d8007340 0x7fa7d80143e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.364+0000 7fa7f1400640 1 -- 172.21.15.5:0/161521803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f4155160 con 0x7fa7d8007340 2024-08-17T02:47:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.364+0000 7fa7f1400640 1 -- 172.21.15.5:0/161521803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d8014920 con 0x7fa7d8005c60 2024-08-17T02:47:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.364+0000 7fa7f1400640 1 -- 172.21.15.5:0/161521803 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d8014a90 con 0x7fa7d8006990 2024-08-17T02:47:09.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.364+0000 7f9e9de00640 1 Processor -- start 2024-08-17T02:47:09.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.363+0000 7f69a8e00640 1 -- 172.21.15.5:0/2171772820 wait complete. 2024-08-17T02:47:09.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.365+0000 7f3f42000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f3c0b03c0 0x7f3f3c0b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.365+0000 7f3f42000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3f3c06d7d0 0x7f3f3c06dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.365+0000 7f3f42000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f3c0aff30 con 0x7f3f3c15cdc0 2024-08-17T02:47:09.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.365+0000 7f3f42000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3c06e150 con 0x7f3f3c0b03c0 2024-08-17T02:47:09.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.365+0000 7f3f42000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3c0af320 con 0x7f3f3c06d7d0 2024-08-17T02:47:09.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.365+0000 7fa7ebe00640 1 --2- 172.21.15.5:0/161521803 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7d8006990 0x7fa7d8006e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.365+0000 7f16ce800640 1 --2- 172.21.15.5:0/912240805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16d014fe00 0x7f16d00cc4f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16d0088aa0 tx=0x7f16c8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d967f48f0a354dd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.365+0000 7ff591c00640 1 Processor -- start 2024-08-17T02:47:09.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.365+0000 7f3f3b400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f3f3c15cdc0 0x7f3f3c0ae860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:60636/0 (socket says 172.21.15.5:60636) 2024-08-17T02:47:09.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.365+0000 7ff591c00640 1 -- start start 2024-08-17T02:47:09.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.365+0000 7fa7f1e00640 1 --2- 172.21.15.5:0/161521803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7d8005c60 0x7fa7d8006050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.365+0000 7fa7f2800640 1 --2- 172.21.15.5:0/161521803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7d8007340 0x7fa7d80143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.365+0000 7f3f3b400640 1 -- 172.21.15.5:0/1341285275 learned_addr learned my addr 172.21.15.5:0/1341285275 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:09.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.365+0000 7f3f3be00640 1 --2- 172.21.15.5:0/1341285275 >> v2:172.21.15.107:3300/0 conn(0x7f3f3c06d7d0 0x7f3f3c06dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7f9e9de00640 1 -- start start 2024-08-17T02:47:09.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7fa7ebe00640 1 -- 172.21.15.5:0/161521803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7d8005c60 msgr2=0x7fa7d8006050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:09.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7fa7ebe00640 1 --2- 172.21.15.5:0/161521803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7d8005c60 0x7fa7d8006050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7fa7ebe00640 1 -- 172.21.15.5:0/161521803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7d8007340 msgr2=0x7fa7d80143e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:09.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7f3f3aa00640 1 --2- 172.21.15.5:0/1341285275 >> v2:172.21.15.5:3300/0 conn(0x7f3f3c0b03c0 0x7f3f3c0b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7f16cd400640 1 -- 172.21.15.5:0/912240805 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8007550 con 0x7f16d014fe00 2024-08-17T02:47:09.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7f16cd400640 1 -- 172.21.15.5:0/912240805 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c802d050 con 0x7f16d014fe00 2024-08-17T02:47:09.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7f69a8e00640 1 Processor -- start 2024-08-17T02:47:09.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7f16cd400640 1 -- 172.21.15.5:0/912240805 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8007900 con 0x7f16d014fe00 2024-08-17T02:47:09.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7fa7ebe00640 1 --2- 172.21.15.5:0/161521803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7d8007340 0x7fa7d80143e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.365+0000 7f8bb5600640 1 -- 172.21.15.5:0/3399420411 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8bb80177f0 con 0x7f8bc006dee0 2024-08-17T02:47:09.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7f8bc4a00640 1 -- 172.21.15.5:0/3399420411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b98005210 con 0x7f8bc006dee0 2024-08-17T02:47:09.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7f8bb5600640 1 --2- 172.21.15.5:0/3399420411 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8ba0065170 0x7f8ba0067620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7f8bb5600640 1 -- 172.21.15.5:0/3399420411 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bb80549d0 con 0x7f8bc006dee0 2024-08-17T02:47:09.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7f8bbd400640 1 --2- 172.21.15.5:0/3399420411 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8ba0065170 0x7f8ba0067620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7f69a8e00640 1 -- start start 2024-08-17T02:47:09.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7ff591c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c0ca9c0 0x7ff58c15a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7ff591c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0ce140 0x7ff58c0c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7ff591c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff58c1589e0 0x7ff58c0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7ff591c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c15a210 con 0x7ff58c1589e0 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7ff591c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c154140 con 0x7ff58c0ca9c0 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7ff591c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c159320 con 0x7ff58c0ce140 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7f9e9de00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e9806dd10 0x7f9e9814aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7f9e9de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e98154a80 0x7f9e980cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7f9e9de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e98159320 0x7f9e980cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7f9e9de00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9814afc0 con 0x7f9e98154a80 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7f9e9de00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e98156350 con 0x7f9e98159320 2024-08-17T02:47:09.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7f9e9de00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e98156630 con 0x7f9e9806dd10 2024-08-17T02:47:09.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7fa7ebe00640 1 -- 172.21.15.5:0/161521803 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f4155420 con 0x7fa7d8006990 2024-08-17T02:47:09.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7fa7f2800640 1 --2- 172.21.15.5:0/161521803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7d8007340 0x7fa7d80143e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:09.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7fa7f2800640 1 -- 172.21.15.5:0/161521803 reap_dead start 2024-08-17T02:47:09.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7f16d5400640 1 -- 172.21.15.5:0/912240805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16d014fe00 msgr2=0x7f16d00cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.367+0000 7f16d5400640 1 --2- 172.21.15.5:0/912240805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16d014fe00 0x7f16d00cc4f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16d0088aa0 tx=0x7f16c8009780 comp rx=0 tx=0).stop 2024-08-17T02:47:09.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7f3f3be00640 1 -- 172.21.15.5:0/1341285275 >> v2:172.21.15.5:3300/0 conn(0x7f3f3c0b03c0 msgr2=0x7f3f3c0b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:09.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7f3f3be00640 1 --2- 172.21.15.5:0/1341285275 >> v2:172.21.15.5:3300/0 conn(0x7f3f3c0b03c0 0x7f3f3c0b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7f3f3be00640 1 -- 172.21.15.5:0/1341285275 >> v1:172.21.15.107:6789/0 conn(0x7f3f3c15cdc0 legacy=0x7f3f3c0ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.366+0000 7f3f3be00640 1 -- 172.21.15.5:0/1341285275 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c0af600 con 0x7f3f3c06d7d0 2024-08-17T02:47:09.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f16d5400640 1 -- 172.21.15.5:0/912240805 shutdown_connections 2024-08-17T02:47:09.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f16d5400640 1 --2- 172.21.15.5:0/912240805 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d00d0150 0x7f16d015cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f16d5400640 1 --2- 172.21.15.5:0/912240805 >> v2:172.21.15.5:3300/0 conn(0x7f16d00cca30 0x7f16d00cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f16d5400640 1 --2- 172.21.15.5:0/912240805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16d014fe00 0x7f16d00cc4f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7ff58b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff58c1589e0 0x7ff58c0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f16d5400640 1 -- 172.21.15.5:0/912240805 >> 172.21.15.5:0/912240805 conn(0x7f16d0068680 msgr2=0x7f16d0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7ff58b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff58c1589e0 0x7ff58c0b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33510/0 (socket says 172.21.15.5:33510) 2024-08-17T02:47:09.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7ff58b400640 1 -- 172.21.15.5:0/3508507208 learned_addr learned my addr 172.21.15.5:0/3508507208 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:09.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f9e96a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e9806dd10 0x7f9e9814aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f9e97400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e98159320 0x7f9e980cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7ff58aa00640 1 --2- 172.21.15.5:0/3508507208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c0ca9c0 0x7ff58c15a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f69a8e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69a40ac620 0x7f69a415f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f16d5400640 1 -- 172.21.15.5:0/912240805 shutdown_connections 2024-08-17T02:47:09.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f8bbd400640 1 --2- 172.21.15.5:0/3399420411 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8ba0065170 0x7f8ba0067620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8bc01587a0 tx=0x7f8bac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f69a8e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69a415cf40 0x7f69a4160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f69a8e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69a415d310 0x7f69a41565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f69a8e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a415fdf0 con 0x7f69a40ac620 2024-08-17T02:47:09.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f69a8e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a41600d0 con 0x7f69a415d310 2024-08-17T02:47:09.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f69a8e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a41603b0 con 0x7f69a415cf40 2024-08-17T02:47:09.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f69a1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69a40ac620 0x7f69a415f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7f6999400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69a415cf40 0x7f69a4160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7f6999400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69a415cf40 0x7f69a4160e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:59296/0 (socket says 172.21.15.5:59296) 2024-08-17T02:47:09.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7f6999400640 1 -- 172.21.15.5:0/3939478608 learned_addr learned my addr 172.21.15.5:0/3939478608 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:09.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7f69a2800640 1 --2- 172.21.15.5:0/3939478608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69a415d310 0x7f69a41565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7ff58a000640 1 --2- 172.21.15.5:0/3508507208 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0ce140 0x7ff58c0c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f9e96a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e9806dd10 0x7f9e9814aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:59282/0 (socket says 172.21.15.5:59282) 2024-08-17T02:47:09.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f9e96000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e98154a80 0x7f9e980cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f9e97400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e98159320 0x7f9e980cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:47652/0 (socket says 172.21.15.5:47652) 2024-08-17T02:47:09.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f9e97400640 1 -- 172.21.15.5:0/1119338038 learned_addr learned my addr 172.21.15.5:0/1119338038 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:09.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.368+0000 7f16d5400640 1 -- 172.21.15.5:0/912240805 wait complete. 2024-08-17T02:47:09.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7f3f3be00640 1 --2- 172.21.15.5:0/1341285275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f3c06d7d0 0x7f3f3c06dc10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0afea0 tx=0x7f3f280090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebd7b47e8dbaac1e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7ff58b400640 1 -- 172.21.15.5:0/3508507208 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0ce140 msgr2=0x7ff58c0c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7ff58b400640 1 --2- 172.21.15.5:0/3508507208 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0ce140 0x7ff58c0c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7ff58b400640 1 -- 172.21.15.5:0/3508507208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c0ca9c0 msgr2=0x7ff58c15a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7ff58b400640 1 --2- 172.21.15.5:0/3508507208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c0ca9c0 0x7ff58c15a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7ff58b400640 1 -- 172.21.15.5:0/3508507208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff584009ae0 con 0x7ff58c1589e0 2024-08-17T02:47:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7ff58a000640 1 --2- 172.21.15.5:0/3508507208 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0ce140 0x7ff58c0c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7f69a2800640 1 -- 172.21.15.5:0/3939478608 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69a415cf40 msgr2=0x7f69a4160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7f69a2800640 1 --2- 172.21.15.5:0/3939478608 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69a415cf40 0x7f69a4160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7f69a2800640 1 -- 172.21.15.5:0/3939478608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69a40ac620 msgr2=0x7f69a415f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7f69a2800640 1 --2- 172.21.15.5:0/3939478608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69a40ac620 0x7f69a415f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7f69a2800640 1 -- 172.21.15.5:0/3939478608 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6994009390 con 0x7f69a415d310 2024-08-17T02:47:09.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.369+0000 7f6999400640 1 --2- 172.21.15.5:0/3939478608 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69a415cf40 0x7f69a4160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:09.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.370+0000 7f69a2800640 1 --2- 172.21.15.5:0/3939478608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69a415d310 0x7f69a41565b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f699c002250 tx=0x7f699c007be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.370+0000 7f9e97400640 1 -- 172.21.15.5:0/1119338038 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e9806dd10 msgr2=0x7f9e9814aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.370+0000 7f9e97400640 1 --2- 172.21.15.5:0/1119338038 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e9806dd10 0x7f9e9814aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.370+0000 7f9e97400640 1 -- 172.21.15.5:0/1119338038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e98154a80 msgr2=0x7f9e980cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.370+0000 7f9e97400640 1 --2- 172.21.15.5:0/1119338038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e98154a80 0x7f9e980cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.370+0000 7f9e97400640 1 -- 172.21.15.5:0/1119338038 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e90007ac0 con 0x7f9e98159320 2024-08-17T02:47:09.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.370+0000 7f9e96000640 1 --2- 172.21.15.5:0/1119338038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e98154a80 0x7f9e980cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:09.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.370+0000 7ff58b400640 1 --2- 172.21.15.5:0/3508507208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff58c1589e0 0x7ff58c0b3dd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff584009ab0 tx=0x7ff584036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.370+0000 7f9e97400640 1 --2- 172.21.15.5:0/1119338038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e98159320 0x7f9e980cc350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400da20 tx=0x7f9e84008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.370+0000 7f16d5400640 1 Processor -- start 2024-08-17T02:47:09.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.371+0000 7ff582000640 1 -- 172.21.15.5:0/3508507208 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5840078e0 con 0x7ff58c1589e0 2024-08-17T02:47:09.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.370+0000 7fa7ebe00640 1 --2- 172.21.15.5:0/161521803 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7d8006990 0x7fa7d8006e00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400d3a0 tx=0x7fa7e4001670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e99d76b41b462dcc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.371+0000 7ff582000640 1 -- 172.21.15.5:0/3508507208 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff584007a40 con 0x7ff58c1589e0 2024-08-17T02:47:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.371+0000 7ff582000640 1 -- 172.21.15.5:0/3508507208 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584007de0 con 0x7ff58c1589e0 2024-08-17T02:47:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.371+0000 7ff591c00640 1 -- 172.21.15.5:0/3508507208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58c159600 con 0x7ff58c1589e0 2024-08-17T02:47:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.371+0000 7f16d5400640 1 -- start start 2024-08-17T02:47:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.371+0000 7ff591c00640 1 -- 172.21.15.5:0/3508507208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58c159bc0 con 0x7ff58c1589e0 2024-08-17T02:47:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.371+0000 7fa7f1400640 1 -- 172.21.15.5:0/161521803 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e402b680 con 0x7fa7d8006990 2024-08-17T02:47:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.371+0000 7fa7f1400640 1 -- 172.21.15.5:0/161521803 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e4009040 con 0x7fa7d8006990 2024-08-17T02:47:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.371+0000 7fa7f1400640 1 -- 172.21.15.5:0/161521803 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e402bad0 con 0x7fa7d8006990 2024-08-17T02:47:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.372+0000 7f16d5400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16d00cca30 0x7f16d01402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.372+0000 7f16d5400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d00d0150 0x7f16d00b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.372+0000 7f16d5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16d014fe00 0x7f16d00c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.372+0000 7f16d5400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00c82a0 con 0x7f16d014fe00 2024-08-17T02:47:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.372+0000 7f16d5400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00c77d0 con 0x7f16d00cca30 2024-08-17T02:47:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.372+0000 7f16d5400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00b1330 con 0x7f16d00d0150 2024-08-17T02:47:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.372+0000 7f16ce800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16d00cca30 0x7f16d01402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.372+0000 7f16ce800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16d00cca30 0x7f16d01402c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:47674/0 (socket says 172.21.15.5:47674) 2024-08-17T02:47:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.372+0000 7f16ce800640 1 -- 172.21.15.5:0/2345576611 learned_addr learned my addr 172.21.15.5:0/2345576611 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.372+0000 7f16cde00640 1 --2- 172.21.15.5:0/2345576611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d00d0150 0x7f16d00b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7fa7f3200640 1 -- 172.21.15.5:0/161521803 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7d8006990 msgr2=0x7fa7d8006e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7fa7f3200640 1 --2- 172.21.15.5:0/161521803 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7d8006990 0x7fa7d8006e00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400d3a0 tx=0x7fa7e4001670 comp rx=0 tx=0).stop 2024-08-17T02:47:09.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7ff577400640 1 -- 172.21.15.5:0/3508507208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff560005210 con 0x7ff58c1589e0 2024-08-17T02:47:09.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7f16cf200640 1 --2- 172.21.15.5:0/2345576611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16d014fe00 0x7f16d00c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7f16ce800640 1 -- 172.21.15.5:0/2345576611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d00d0150 msgr2=0x7f16d00b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7f16ce800640 1 --2- 172.21.15.5:0/2345576611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d00d0150 0x7f16d00b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7f16ce800640 1 -- 172.21.15.5:0/2345576611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16d014fe00 msgr2=0x7f16d00c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7f9e8e000640 1 -- 172.21.15.5:0/1119338038 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84007910 con 0x7f9e98159320 2024-08-17T02:47:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7f9e8e000640 1 -- 172.21.15.5:0/1119338038 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e84007a90 con 0x7f9e98159320 2024-08-17T02:47:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7f9e8e000640 1 -- 172.21.15.5:0/1119338038 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84007e50 con 0x7f9e98159320 2024-08-17T02:47:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7f9e9de00640 1 -- 172.21.15.5:0/1119338038 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e98156910 con 0x7f9e98159320 2024-08-17T02:47:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7f3f3a000640 1 -- 172.21.15.5:0/1341285275 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2802ad20 con 0x7f3f3c06d7d0 2024-08-17T02:47:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7f3f3a000640 1 -- 172.21.15.5:0/1341285275 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2802ae80 con 0x7f3f3c06d7d0 2024-08-17T02:47:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7f3f3a000640 1 -- 172.21.15.5:0/1341285275 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28032670 con 0x7f3f3c06d7d0 2024-08-17T02:47:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.374+0000 7f8bb5600640 1 -- 172.21.15.5:0/3399420411 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8bb80514a0 con 0x7f8bc006dee0 2024-08-17T02:47:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.374+0000 7ff582000640 1 -- 172.21.15.5:0/3508507208 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff58403c630 con 0x7ff58c1589e0 2024-08-17T02:47:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.374+0000 7f3f42000640 1 -- 172.21.15.5:0/1341285275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f3c06d7d0 msgr2=0x7f3f3c06dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.374+0000 7f3f42000640 1 --2- 172.21.15.5:0/1341285275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f3c06d7d0 0x7f3f3c06dc10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0afea0 tx=0x7f3f280090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7f16ce800640 1 --2- 172.21.15.5:0/2345576611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16d014fe00 0x7f16d00c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7f16ce800640 1 -- 172.21.15.5:0/2345576611 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c8009a20 con 0x7f16d00cca30 2024-08-17T02:47:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.373+0000 7f16cf200640 1 --2- 172.21.15.5:0/2345576611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16d014fe00 0x7f16d00c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.374+0000 7f16ce800640 1 --2- 172.21.15.5:0/2345576611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16d00cca30 0x7f16d01402c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f16c80097c0 tx=0x7f16c8037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.374+0000 7f16c6000640 1 -- 172.21.15.5:0/2345576611 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8031810 con 0x7f16d00cca30 2024-08-17T02:47:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.374+0000 7f16c6000640 1 -- 172.21.15.5:0/2345576611 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c8031990 con 0x7f16d00cca30 2024-08-17T02:47:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.374+0000 7f16c6000640 1 -- 172.21.15.5:0/2345576611 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8031d90 con 0x7f16d00cca30 2024-08-17T02:47:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.375+0000 7f16d5400640 1 -- 172.21.15.5:0/2345576611 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d00c9b20 con 0x7f16d00cca30 2024-08-17T02:47:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.375+0000 7f699a000640 1 -- 172.21.15.5:0/3939478608 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c004d30 con 0x7f69a415d310 2024-08-17T02:47:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.375+0000 7f699a000640 1 -- 172.21.15.5:0/3939478608 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699c00a640 con 0x7f69a415d310 2024-08-17T02:47:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.375+0000 7fa7f3200640 1 -- 172.21.15.5:0/161521803 shutdown_connections 2024-08-17T02:47:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.375+0000 7fa7f3200640 1 --2- 172.21.15.5:0/161521803 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7d8006990 0x7fa7d8006e00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.375+0000 7fa7f3200640 1 -- 172.21.15.5:0/161521803 >> 172.21.15.5:0/161521803 conn(0x7fa7f40678e0 msgr2=0x7fa7f40cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.375+0000 7f699a000640 1 -- 172.21.15.5:0/3939478608 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c00aa40 con 0x7f69a415d310 2024-08-17T02:47:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.375+0000 7f16d5400640 1 -- 172.21.15.5:0/2345576611 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d00c7ce0 con 0x7f16d00cca30 2024-08-17T02:47:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.375+0000 7fa7f3200640 1 -- 172.21.15.5:0/161521803 shutdown_connections 2024-08-17T02:47:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.375+0000 7fa7f3200640 1 -- 172.21.15.5:0/161521803 wait complete. 2024-08-17T02:47:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.375+0000 7f9e9de00640 1 -- 172.21.15.5:0/1119338038 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e98156ed0 con 0x7f9e98159320 2024-08-17T02:47:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.375+0000 7f3f42000640 1 -- 172.21.15.5:0/1341285275 shutdown_connections 2024-08-17T02:47:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.375+0000 7f3f42000640 1 --2- 172.21.15.5:0/1341285275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f3c06d7d0 0x7f3f3c06dc10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.375+0000 7f3f42000640 1 --2- 172.21.15.5:0/1341285275 >> v2:172.21.15.5:3300/0 conn(0x7f3f3c0b03c0 0x7f3f3c0b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.375+0000 7f3f42000640 1 -- 172.21.15.5:0/1341285275 >> 172.21.15.5:0/1341285275 conn(0x7f3f3c066e60 msgr2=0x7f3f3c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.377+0000 7f9e9de00640 1 -- 172.21.15.5:0/1119338038 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9816e660 con 0x7f9e98159320 2024-08-17T02:47:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.377+0000 7f3f42000640 1 -- 172.21.15.5:0/1341285275 shutdown_connections 2024-08-17T02:47:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.377+0000 7ff582000640 1 --2- 172.21.15.5:0/3508507208 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff56c065200 0x7ff56c0676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.377+0000 7ff582000640 1 -- 172.21.15.5:0/3508507208 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff5840a3350 con 0x7ff58c1589e0 2024-08-17T02:47:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.378+0000 7f9e8e000640 1 -- 172.21.15.5:0/1119338038 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9e84010680 con 0x7f9e98159320 2024-08-17T02:47:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.378+0000 7fa7f3200640 1 Processor -- start 2024-08-17T02:47:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.378+0000 7fa7f3200640 1 -- start start 2024-08-17T02:47:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.378+0000 7f16d5400640 1 -- 172.21.15.5:0/2345576611 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d0063fb0 con 0x7f16d00cca30 2024-08-17T02:47:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.379+0000 7ff58aa00640 1 --2- 172.21.15.5:0/3508507208 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff56c065200 0x7ff56c0676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.379+0000 7f9e8e000640 1 --2- 172.21.15.5:0/1119338038 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9e78065150 0x7f9e78067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.379+0000 7f9e8e000640 1 -- 172.21.15.5:0/1119338038 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e84014030 con 0x7f9e98159320 2024-08-17T02:47:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.379+0000 7fa7f3200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7d8006990 0x7fa7f40a7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.379+0000 7fa7f3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f406af00 0x7fa7f414ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.379+0000 7fa7f3200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7f40a98b0 0x7fa7f40a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.379+0000 7fa7f3200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f406bf50 con 0x7fa7f406af00 2024-08-17T02:47:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.379+0000 7fa7f3200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f4166280 con 0x7fa7f40a98b0 2024-08-17T02:47:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.379+0000 7fa7f3200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f40a8480 con 0x7fa7d8006990 2024-08-17T02:47:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.377+0000 7f3f42000640 1 -- 172.21.15.5:0/1341285275 wait complete. 2024-08-17T02:47:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.380+0000 7f69a8e00640 1 -- 172.21.15.5:0/3939478608 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a4160690 con 0x7f69a415d310 2024-08-17T02:47:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.380+0000 7f69a8e00640 1 -- 172.21.15.5:0/3939478608 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a41613d0 con 0x7f69a415d310 2024-08-17T02:47:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.380+0000 7f3f42000640 1 Processor -- start 2024-08-17T02:47:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.380+0000 7f9e96a00640 1 --2- 172.21.15.5:0/1119338038 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9e78065150 0x7f9e78067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.380+0000 7f3f42000640 1 -- start start 2024-08-17T02:47:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.380+0000 7fa7f1e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7d8006990 0x7fa7f40a7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.380+0000 7fa7ebe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f406af00 0x7fa7f414ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.380+0000 7fa7f1e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7d8006990 0x7fa7f40a7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:59306/0 (socket says 172.21.15.5:59306) 2024-08-17T02:47:09.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.380+0000 7fa7f1e00640 1 -- 172.21.15.5:0/374668243 learned_addr learned my addr 172.21.15.5:0/374668243 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:09.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.381+0000 7f69a8e00640 1 -- 172.21.15.5:0/3939478608 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a4160b90 con 0x7f69a415d310 2024-08-17T02:47:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.381+0000 7fa7ebe00640 1 -- 172.21.15.5:0/374668243 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7d8006990 msgr2=0x7fa7f40a7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.381+0000 7fa7ebe00640 1 --2- 172.21.15.5:0/374668243 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7d8006990 0x7fa7f40a7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.381+0000 7fa7ebe00640 1 -- 172.21.15.5:0/374668243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7f40a98b0 msgr2=0x7fa7f40a9d30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:47:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.381+0000 7fa7ebe00640 1 --2- 172.21.15.5:0/374668243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7f40a98b0 0x7fa7f40a9d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.381+0000 7fa7ebe00640 1 -- 172.21.15.5:0/374668243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f406b6b0 con 0x7fa7f406af00 2024-08-17T02:47:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.382+0000 7f9e96a00640 1 --2- 172.21.15.5:0/1119338038 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9e78065150 0x7f9e78067600 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9e90034000 tx=0x7f9e90037000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.382+0000 7ff58aa00640 1 --2- 172.21.15.5:0/3508507208 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff56c065200 0x7ff56c0676b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009ab0 tx=0x7ff57c009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.382+0000 7fa7f1e00640 1 --2- 172.21.15.5:0/374668243 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7d8006990 0x7fa7f40a7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:09.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.382+0000 7fa7ebe00640 1 --2- 172.21.15.5:0/374668243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f406af00 0x7fa7f414ff40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8014c20 tx=0x7fa7e4035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.382+0000 7f3f42000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f3c06d7d0 0x7f3f3c151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.382+0000 7f3f42000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b03c0 0x7f3f3c154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.383+0000 7f3f42000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f3c15cdc0 0x7f3f3c16da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.383+0000 7f3f3b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f3c06d7d0 0x7f3f3c151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.383+0000 7f3f42000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c156180 con 0x7f3f3c0b03c0 2024-08-17T02:47:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.383+0000 7f3f42000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c156460 con 0x7f3f3c15cdc0 2024-08-17T02:47:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.383+0000 7f3f42000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c156740 con 0x7f3f3c06d7d0 2024-08-17T02:47:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.383+0000 7f3f3aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b03c0 0x7f3f3c154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.383+0000 7f3f3aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b03c0 0x7f3f3c154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33562/0 (socket says 172.21.15.5:33562) 2024-08-17T02:47:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.383+0000 7f3f3aa00640 1 -- 172.21.15.5:0/3995646962 learned_addr learned my addr 172.21.15.5:0/3995646962 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.383+0000 7f3f3be00640 1 --2- 172.21.15.5:0/3995646962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f3c15cdc0 0x7f3f3c16da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.384+0000 7f3f3aa00640 1 -- 172.21.15.5:0/3995646962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f3c06d7d0 msgr2=0x7f3f3c151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.384+0000 7f3f3aa00640 1 --2- 172.21.15.5:0/3995646962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f3c06d7d0 0x7f3f3c151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.384+0000 7f3f3aa00640 1 -- 172.21.15.5:0/3995646962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f3c15cdc0 msgr2=0x7f3f3c16da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.384+0000 7f3f3aa00640 1 --2- 172.21.15.5:0/3995646962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f3c15cdc0 0x7f3f3c16da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.384+0000 7f3f3aa00640 1 -- 172.21.15.5:0/3995646962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f28009390 con 0x7f3f3c0b03c0 2024-08-17T02:47:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.384+0000 7f3f3be00640 1 --2- 172.21.15.5:0/3995646962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f3c15cdc0 0x7f3f3c16da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.384+0000 7f3f3aa00640 1 --2- 172.21.15.5:0/3995646962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b03c0 0x7f3f3c154fe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00d890 tx=0x7f3f2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.384+0000 7f9e8e000640 1 -- 172.21.15.5:0/1119338038 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9e9816e660 con 0x7f9e98159320 2024-08-17T02:47:09.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.385+0000 7ff582000640 1 -- 172.21.15.5:0/3508507208 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff584071420 con 0x7ff58c1589e0 2024-08-17T02:47:09.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.385+0000 7fa7e9600640 1 -- 172.21.15.5:0/374668243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4043070 con 0x7fa7f406af00 2024-08-17T02:47:09.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.385+0000 7fa7e9600640 1 -- 172.21.15.5:0/374668243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e403f480 con 0x7fa7f406af00 2024-08-17T02:47:09.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.385+0000 7fa7e9600640 1 -- 172.21.15.5:0/374668243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e403f820 con 0x7fa7f406af00 2024-08-17T02:47:09.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.385+0000 7f3f32a00640 1 -- 172.21.15.5:0/3995646962 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c00de20 con 0x7f3f3c0b03c0 2024-08-17T02:47:09.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.385+0000 7f3f42000640 1 -- 172.21.15.5:0/3995646962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3c156a20 con 0x7f3f3c0b03c0 2024-08-17T02:47:09.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.385+0000 7f3f42000640 1 -- 172.21.15.5:0/3995646962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3c152000 con 0x7f3f3c0b03c0 2024-08-17T02:47:09.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.385+0000 7f3f32a00640 1 -- 172.21.15.5:0/3995646962 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c00b8d0 con 0x7f3f3c0b03c0 2024-08-17T02:47:09.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.385+0000 7f3f32a00640 1 -- 172.21.15.5:0/3995646962 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c00de20 con 0x7f3f3c0b03c0 2024-08-17T02:47:09.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.385+0000 7fa7f3200640 1 -- 172.21.15.5:0/374668243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f406b990 con 0x7fa7f406af00 2024-08-17T02:47:09.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.387+0000 7fa7f3200640 1 -- 172.21.15.5:0/374668243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f40aa270 con 0x7fa7f406af00 2024-08-17T02:47:09.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.386+0000 7f16c6000640 1 -- 172.21.15.5:0/2345576611 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f16c8003040 con 0x7f16d00cca30 2024-08-17T02:47:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.388+0000 7f16c6000640 1 --2- 172.21.15.5:0/2345576611 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f16b00652a0 0x7f16b0067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.388+0000 7fa7f3200640 1 -- 172.21.15.5:0/374668243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f4166050 con 0x7fa7f406af00 2024-08-17T02:47:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.388+0000 7f16c6000640 1 -- 172.21.15.5:0/2345576611 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f16c80a3c50 con 0x7f16d00cca30 2024-08-17T02:47:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.389+0000 7f16cde00640 1 --2- 172.21.15.5:0/2345576611 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f16b00652a0 0x7f16b0067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.389+0000 7f3f42000640 1 -- 172.21.15.5:0/3995646962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f14005210 con 0x7f3f3c0b03c0 2024-08-17T02:47:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.391+0000 7f16c6000640 1 -- 172.21.15.5:0/2345576611 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f16c80a3e60 con 0x7f16d00cca30 2024-08-17T02:47:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.390+0000 7fa7e9600640 1 -- 172.21.15.5:0/374668243 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa7e4048410 con 0x7fa7f406af00 2024-08-17T02:47:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.391+0000 7fa7e9600640 1 --2- 172.21.15.5:0/374668243 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa7d0065250 0x7fa7d0067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.391+0000 7fa7e9600640 1 -- 172.21.15.5:0/374668243 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa7e40a3200 con 0x7fa7f406af00 2024-08-17T02:47:09.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.392+0000 7fa7f1e00640 1 --2- 172.21.15.5:0/374668243 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa7d0065250 0x7fa7d0067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.392+0000 7f16cde00640 1 --2- 172.21.15.5:0/2345576611 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f16b00652a0 0x7f16b0067750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f16d00afee0 tx=0x7f16c00091d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.389+0000 7f699a000640 1 -- 172.21.15.5:0/3939478608 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f699c007150 con 0x7f69a415d310 2024-08-17T02:47:09.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.390+0000 7f699a000640 1 --2- 172.21.15.5:0/3939478608 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f69800652a0 0x7f6980067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.390+0000 7f699a000640 1 -- 172.21.15.5:0/3939478608 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f699c0822a0 con 0x7f69a415d310 2024-08-17T02:47:09.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.394+0000 7fa7f1e00640 1 --2- 172.21.15.5:0/374668243 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa7d0065250 0x7fa7d0067700 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4156db0 tx=0x7fa7dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.393+0000 7f3f32a00640 1 -- 172.21.15.5:0/3995646962 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3f2c00bcd0 con 0x7f3f3c0b03c0 2024-08-17T02:47:09.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.394+0000 7f69a1e00640 1 --2- 172.21.15.5:0/3939478608 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f69800652a0 0x7f6980067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.395+0000 7f3f32a00640 1 --2- 172.21.15.5:0/3995646962 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3f1c065230 0x7f3f1c0676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.395+0000 7f3f32a00640 1 -- 172.21.15.5:0/3995646962 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f2c0825d0 con 0x7f3f3c0b03c0 2024-08-17T02:47:09.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.396+0000 7f3f3b400640 1 --2- 172.21.15.5:0/3995646962 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3f1c065230 0x7f3f1c0676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.397+0000 7f69a1e00640 1 --2- 172.21.15.5:0/3939478608 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f69800652a0 0x7f6980067750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f698c005840 tx=0x7f698c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.397+0000 7f699a000640 1 -- 172.21.15.5:0/3939478608 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f699c050470 con 0x7f69a415d310 2024-08-17T02:47:09.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.397+0000 7f3f3b400640 1 --2- 172.21.15.5:0/3995646962 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3f1c065230 0x7f3f1c0676e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400f380 tx=0x7f3f34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.398+0000 7fa7e9600640 1 -- 172.21.15.5:0/374668243 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa7f4166050 con 0x7fa7f406af00 2024-08-17T02:47:09.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.406+0000 7f3f32a00640 1 -- 172.21.15.5:0/3995646962 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3f2c050760 con 0x7f3f3c0b03c0 2024-08-17T02:47:09.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.786+0000 7f04d9200640 1 -- 172.21.15.5:0/2066673199 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f04cc005250 con 0x7f04cc0543f0 2024-08-17T02:47:09.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.787+0000 7f04c6a00640 1 -- 172.21.15.5:0/2066673199 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f04c8053cd0 con 0x7f04cc0543f0 2024-08-17T02:47:09.788 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-08-17T02:47:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.791+0000 7f04d9200640 1 -- 172.21.15.5:0/2066673199 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f04b40652a0 msgr2=0x7f04b4067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.791+0000 7f04d9200640 1 --2- 172.21.15.5:0/2066673199 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f04b40652a0 0x7f04b4067750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0078d0 tx=0x7f04d40bc000 comp rx=0 tx=0).stop 2024-08-17T02:47:09.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.792+0000 7f04d9200640 1 -- 172.21.15.5:0/2066673199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04cc0543f0 msgr2=0x7f04cc03df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.792+0000 7f04d9200640 1 --2- 172.21.15.5:0/2066673199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04cc0543f0 0x7f04cc03df50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f04c800e900 tx=0x7f04c80090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.792+0000 7f04d9200640 1 -- 172.21.15.5:0/2066673199 shutdown_connections 2024-08-17T02:47:09.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.792+0000 7f04d9200640 1 --2- 172.21.15.5:0/2066673199 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f04b40652a0 0x7f04b4067750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.792+0000 7f04d9200640 1 --2- 172.21.15.5:0/2066673199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04cc0e2fc0 0x7f04cc0579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.792+0000 7f04d9200640 1 --2- 172.21.15.5:0/2066673199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04cc0e26b0 0x7f04cc0cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.792+0000 7f04d9200640 1 --2- 172.21.15.5:0/2066673199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04cc0543f0 0x7f04cc03df50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.792+0000 7f04d9200640 1 -- 172.21.15.5:0/2066673199 >> 172.21.15.5:0/2066673199 conn(0x7f04cc00e5c0 msgr2=0x7f04cc0069a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.792+0000 7f8bc4a00640 1 -- 172.21.15.5:0/3399420411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8b98005790 con 0x7f8bc006dee0 2024-08-17T02:47:09.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.792+0000 7f04d9200640 1 -- 172.21.15.5:0/2066673199 shutdown_connections 2024-08-17T02:47:09.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.793+0000 7f04d9200640 1 -- 172.21.15.5:0/2066673199 wait complete. 2024-08-17T02:47:09.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.793+0000 7f8bb5600640 1 -- 172.21.15.5:0/3399420411 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8bb801c030 con 0x7f8bc006dee0 2024-08-17T02:47:09.795 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-08-17T02:47:09.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.797+0000 7f8bc4a00640 1 -- 172.21.15.5:0/3399420411 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8ba0065170 msgr2=0x7f8ba0067620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.797+0000 7f8bc4a00640 1 --2- 172.21.15.5:0/3399420411 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8ba0065170 0x7f8ba0067620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8bc01587a0 tx=0x7f8bac009040 comp rx=0 tx=0).stop 2024-08-17T02:47:09.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.798+0000 7f8bc4a00640 1 -- 172.21.15.5:0/3399420411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bc006dee0 msgr2=0x7f8bc00cae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.798+0000 7f8bc4a00640 1 --2- 172.21.15.5:0/3399420411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bc006dee0 0x7f8bc00cae60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8007c50 tx=0x7f8bb8009f90 comp rx=0 tx=0).stop 2024-08-17T02:47:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.798+0000 7f8bc4a00640 1 -- 172.21.15.5:0/3399420411 shutdown_connections 2024-08-17T02:47:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.799+0000 7f8bc4a00640 1 --2- 172.21.15.5:0/3399420411 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8ba0065170 0x7f8ba0067620 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.799+0000 7f8bc4a00640 1 --2- 172.21.15.5:0/3399420411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bc0159320 0x7f8bc01538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.799+0000 7f8bc4a00640 1 --2- 172.21.15.5:0/3399420411 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8bc0154a80 0x7f8bc016d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.799+0000 7f8bc4a00640 1 --2- 172.21.15.5:0/3399420411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bc006dee0 0x7f8bc00cae60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.799+0000 7f8bc4a00640 1 -- 172.21.15.5:0/3399420411 >> 172.21.15.5:0/3399420411 conn(0x7f8bc0066e60 msgr2=0x7f8bc006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.799+0000 7f8bc4a00640 1 -- 172.21.15.5:0/3399420411 shutdown_connections 2024-08-17T02:47:09.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.799+0000 7f8bc4a00640 1 -- 172.21.15.5:0/3399420411 wait complete. 2024-08-17T02:47:09.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.811+0000 7f9e9de00640 1 -- 172.21.15.5:0/1119338038 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9e9816e660 con 0x7f9e98159320 2024-08-17T02:47:09.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.813+0000 7f9e8e000640 1 -- 172.21.15.5:0/1119338038 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9e9816e660 con 0x7f9e98159320 2024-08-17T02:47:09.814 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-08-17T02:47:09.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.817+0000 7ff577400640 1 -- 172.21.15.5:0/3508507208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff5600054c0 con 0x7ff58c1589e0 2024-08-17T02:47:09.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.817+0000 7f9e9de00640 1 -- 172.21.15.5:0/1119338038 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9e78065150 msgr2=0x7f9e78067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.817+0000 7f9e9de00640 1 --2- 172.21.15.5:0/1119338038 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9e78065150 0x7f9e78067600 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9e90034000 tx=0x7f9e90037000 comp rx=0 tx=0).stop 2024-08-17T02:47:09.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.817+0000 7f9e9de00640 1 -- 172.21.15.5:0/1119338038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e98159320 msgr2=0x7f9e980cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.817+0000 7f9e9de00640 1 --2- 172.21.15.5:0/1119338038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e98159320 0x7f9e980cc350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400da20 tx=0x7f9e84008040 comp rx=0 tx=0).stop 2024-08-17T02:47:09.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.817+0000 7f16d5400640 1 -- 172.21.15.5:0/2345576611 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f16d01469b0 con 0x7f16d00cca30 2024-08-17T02:47:09.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.817+0000 7f9e9de00640 1 -- 172.21.15.5:0/1119338038 shutdown_connections 2024-08-17T02:47:09.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.817+0000 7f9e9de00640 1 --2- 172.21.15.5:0/1119338038 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9e78065150 0x7f9e78067600 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.817+0000 7f9e9de00640 1 --2- 172.21.15.5:0/1119338038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e98159320 0x7f9e980cc350 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.817+0000 7f9e9de00640 1 --2- 172.21.15.5:0/1119338038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e98154a80 0x7f9e980cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.817+0000 7f9e9de00640 1 --2- 172.21.15.5:0/1119338038 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e9806dd10 0x7f9e9814aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.817+0000 7f9e9de00640 1 -- 172.21.15.5:0/1119338038 >> 172.21.15.5:0/1119338038 conn(0x7f9e98066e60 msgr2=0x7f9e9806a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.817+0000 7ff582000640 1 -- 172.21.15.5:0/3508507208 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff584074a40 con 0x7ff58c1589e0 2024-08-17T02:47:09.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.817+0000 7f9e9de00640 1 -- 172.21.15.5:0/1119338038 shutdown_connections 2024-08-17T02:47:09.820 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-08-17T02:47:09.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.817+0000 7f9e9de00640 1 -- 172.21.15.5:0/1119338038 wait complete. 2024-08-17T02:47:09.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.817+0000 7f16c6000640 1 -- 172.21.15.5:0/2345576611 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f16c804a090 con 0x7f16d00cca30 2024-08-17T02:47:09.822 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-08-17T02:47:09.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-08-17T02:47:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.821+0000 7f16d5400640 1 -- 172.21.15.5:0/2345576611 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f16b00652a0 msgr2=0x7f16b0067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.823 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.821+0000 7ff577400640 1 -- 172.21.15.5:0/3508507208 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff56c065200 msgr2=0x7ff56c0676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.821+0000 7ff577400640 1 --2- 172.21.15.5:0/3508507208 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff56c065200 0x7ff56c0676b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009ab0 tx=0x7ff57c009060 comp rx=0 tx=0).stop 2024-08-17T02:47:09.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.821+0000 7ff577400640 1 -- 172.21.15.5:0/3508507208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff58c1589e0 msgr2=0x7ff58c0b3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.821+0000 7ff577400640 1 --2- 172.21.15.5:0/3508507208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff58c1589e0 0x7ff58c0b3dd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff584009ab0 tx=0x7ff584036000 comp rx=0 tx=0).stop 2024-08-17T02:47:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.821+0000 7ff577400640 1 -- 172.21.15.5:0/3508507208 shutdown_connections 2024-08-17T02:47:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.821+0000 7ff577400640 1 --2- 172.21.15.5:0/3508507208 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff56c065200 0x7ff56c0676b0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009ab0 tx=0x7ff57c009060 comp rx=0 tx=0).stop 2024-08-17T02:47:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.821+0000 7ff577400640 1 --2- 172.21.15.5:0/3508507208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff58c1589e0 0x7ff58c0b3dd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.821+0000 7ff577400640 1 --2- 172.21.15.5:0/3508507208 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff58c0ce140 0x7ff58c0c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.821+0000 7ff577400640 1 --2- 172.21.15.5:0/3508507208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff58c0ca9c0 0x7ff58c15a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.821+0000 7ff577400640 1 -- 172.21.15.5:0/3508507208 >> 172.21.15.5:0/3508507208 conn(0x7ff58c06e590 msgr2=0x7ff58c0cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.821+0000 7f16d5400640 1 --2- 172.21.15.5:0/2345576611 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f16b00652a0 0x7f16b0067750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f16d00afee0 tx=0x7f16c00091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.821+0000 7f16d5400640 1 -- 172.21.15.5:0/2345576611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16d00cca30 msgr2=0x7f16d01402c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.821+0000 7f16d5400640 1 --2- 172.21.15.5:0/2345576611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16d00cca30 0x7f16d01402c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f16c80097c0 tx=0x7f16c8037000 comp rx=0 tx=0).stop 2024-08-17T02:47:09.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.821+0000 7ff577400640 1 -- 172.21.15.5:0/3508507208 shutdown_connections 2024-08-17T02:47:09.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.822+0000 7f16d5400640 1 -- 172.21.15.5:0/2345576611 shutdown_connections 2024-08-17T02:47:09.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.822+0000 7f16d5400640 1 --2- 172.21.15.5:0/2345576611 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f16b00652a0 0x7f16b0067750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.822+0000 7f16d5400640 1 --2- 172.21.15.5:0/2345576611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16d014fe00 0x7f16d00c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.822+0000 7f16d5400640 1 --2- 172.21.15.5:0/2345576611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16d00d0150 0x7f16d00b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.822+0000 7f16d5400640 1 --2- 172.21.15.5:0/2345576611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16d00cca30 0x7f16d01402c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.822+0000 7f16d5400640 1 -- 172.21.15.5:0/2345576611 >> 172.21.15.5:0/2345576611 conn(0x7f16d0068680 msgr2=0x7f16d00cf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.822+0000 7ff577400640 1 -- 172.21.15.5:0/3508507208 wait complete. 2024-08-17T02:47:09.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.822+0000 7f16d5400640 1 -- 172.21.15.5:0/2345576611 shutdown_connections 2024-08-17T02:47:09.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.822+0000 7f16d5400640 1 -- 172.21.15.5:0/2345576611 wait complete. 2024-08-17T02:47:09.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.823+0000 7f3f42000640 1 -- 172.21.15.5:0/3995646962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3f140054c0 con 0x7f3f3c0b03c0 2024-08-17T02:47:09.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-08-17T02:47:09.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.825+0000 7f3f32a00640 1 -- 172.21.15.5:0/3995646962 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f2c053d80 con 0x7f3f3c0b03c0 2024-08-17T02:47:09.828 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-08-17T02:47:09.829 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:09.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.826+0000 7f69a8e00640 1 -- 172.21.15.5:0/3939478608 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f69a4063fb0 con 0x7f69a415d310 2024-08-17T02:47:09.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.826+0000 7fa7f3200640 1 -- 172.21.15.5:0/374668243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa7f4166430 con 0x7fa7f406af00 2024-08-17T02:47:09.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.826+0000 7fa7e9600640 1 -- 172.21.15.5:0/374668243 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7f4166430 con 0x7fa7f406af00 2024-08-17T02:47:09.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.826+0000 7f699a000640 1 -- 172.21.15.5:0/3939478608 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f699c053a90 con 0x7f69a415d310 2024-08-17T02:47:09.830 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-08-17T02:47:09.831 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2024-08-17T02:47:09.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f3f42000640 1 -- 172.21.15.5:0/3995646962 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3f1c065230 msgr2=0x7f3f1c0676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f3f42000640 1 --2- 172.21.15.5:0/3995646962 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3f1c065230 0x7f3f1c0676e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400f380 tx=0x7f3f34009040 comp rx=0 tx=0).stop 2024-08-17T02:47:09.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f3f42000640 1 -- 172.21.15.5:0/3995646962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b03c0 msgr2=0x7f3f3c154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f3f42000640 1 --2- 172.21.15.5:0/3995646962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b03c0 0x7f3f3c154fe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00d890 tx=0x7f3f2c008040 comp rx=0 tx=0).stop 2024-08-17T02:47:09.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f3f42000640 1 -- 172.21.15.5:0/3995646962 shutdown_connections 2024-08-17T02:47:09.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f3f42000640 1 --2- 172.21.15.5:0/3995646962 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3f1c065230 0x7f3f1c0676e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f3f42000640 1 --2- 172.21.15.5:0/3995646962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f3c15cdc0 0x7f3f3c16da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f3f42000640 1 --2- 172.21.15.5:0/3995646962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f3c0b03c0 0x7f3f3c154fe0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f3f42000640 1 --2- 172.21.15.5:0/3995646962 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f3c06d7d0 0x7f3f3c151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f3f42000640 1 -- 172.21.15.5:0/3995646962 >> 172.21.15.5:0/3995646962 conn(0x7f3f3c066e60 msgr2=0x7f3f3c06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f69a8e00640 1 -- 172.21.15.5:0/3939478608 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f69800652a0 msgr2=0x7f6980067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.830+0000 7f3f42000640 1 -- 172.21.15.5:0/3995646962 shutdown_connections 2024-08-17T02:47:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f69a8e00640 1 --2- 172.21.15.5:0/3939478608 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f69800652a0 0x7f6980067750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f698c005840 tx=0x7f698c009040 comp rx=0 tx=0).stop 2024-08-17T02:47:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f69a8e00640 1 -- 172.21.15.5:0/3939478608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69a415d310 msgr2=0x7f69a41565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f69a8e00640 1 --2- 172.21.15.5:0/3939478608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69a415d310 0x7f69a41565b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f699c002250 tx=0x7f699c007be0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f69a8e00640 1 -- 172.21.15.5:0/3939478608 shutdown_connections 2024-08-17T02:47:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f69a8e00640 1 --2- 172.21.15.5:0/3939478608 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f69800652a0 0x7f6980067750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f69a8e00640 1 --2- 172.21.15.5:0/3939478608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69a415d310 0x7f69a41565b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f69a8e00640 1 --2- 172.21.15.5:0/3939478608 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69a415cf40 0x7f69a4160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f69a8e00640 1 --2- 172.21.15.5:0/3939478608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69a40ac620 0x7f69a415f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.829+0000 7f69a8e00640 1 -- 172.21.15.5:0/3939478608 >> 172.21.15.5:0/3939478608 conn(0x7f69a4066e60 msgr2=0x7f69a415ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.830+0000 7f3f42000640 1 -- 172.21.15.5:0/3995646962 wait complete. 2024-08-17T02:47:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.830+0000 7f69a8e00640 1 -- 172.21.15.5:0/3939478608 shutdown_connections 2024-08-17T02:47:09.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.830+0000 7f69a8e00640 1 -- 172.21.15.5:0/3939478608 wait complete. 2024-08-17T02:47:09.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.830+0000 7fa7f3200640 1 -- 172.21.15.5:0/374668243 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa7d0065250 msgr2=0x7fa7d0067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.830+0000 7fa7f3200640 1 --2- 172.21.15.5:0/374668243 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa7d0065250 0x7fa7d0067700 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4156db0 tx=0x7fa7dc009040 comp rx=0 tx=0).stop 2024-08-17T02:47:09.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.830+0000 7fa7f3200640 1 -- 172.21.15.5:0/374668243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f406af00 msgr2=0x7fa7f414ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.830+0000 7fa7f3200640 1 --2- 172.21.15.5:0/374668243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f406af00 0x7fa7f414ff40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8014c20 tx=0x7fa7e4035000 comp rx=0 tx=0).stop 2024-08-17T02:47:09.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.830+0000 7fa7f3200640 1 -- 172.21.15.5:0/374668243 shutdown_connections 2024-08-17T02:47:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.830+0000 7fa7f3200640 1 --2- 172.21.15.5:0/374668243 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa7d0065250 0x7fa7d0067700 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.830+0000 7fa7f3200640 1 --2- 172.21.15.5:0/374668243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7f40a98b0 0x7fa7f40a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.830+0000 7fa7f3200640 1 --2- 172.21.15.5:0/374668243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f406af00 0x7fa7f414ff40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.830+0000 7fa7f3200640 1 --2- 172.21.15.5:0/374668243 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7d8006990 0x7fa7f40a7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.830+0000 7fa7f3200640 1 -- 172.21.15.5:0/374668243 >> 172.21.15.5:0/374668243 conn(0x7fa7f40678e0 msgr2=0x7fa7f4156330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.831+0000 7fa7f3200640 1 -- 172.21.15.5:0/374668243 shutdown_connections 2024-08-17T02:47:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:09.831+0000 7fa7f3200640 1 -- 172.21.15.5:0/374668243 wait complete. 2024-08-17T02:47:09.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-08-17T02:47:09.843 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:09.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-08-17T02:47:09.851 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:09.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-08-17T02:47:09.853 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:09.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-08-17T02:47:09.853 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:09.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-08-17T02:47:09.857 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:09.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-08-17T02:47:09.857 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:09.857 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:47:09.857 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:47:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.047+0000 7f2615800640 1 Processor -- start 2024-08-17T02:47:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.047+0000 7f2615800640 1 -- start start 2024-08-17T02:47:10.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.048+0000 7f2615800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2610158b90 0x7f26100b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.048+0000 7f2615800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26100afd20 con 0x7f26100af130 2024-08-17T02:47:10.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.048+0000 7f2615800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26100affe0 con 0x7f26100b2370 2024-08-17T02:47:10.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.048+0000 7f2615800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26100b02c0 con 0x7f2610158b90 2024-08-17T02:47:10.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.048+0000 7f260f400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f26100af130 0x7f26100ca8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42162/0 (socket says 172.21.15.5:42162) 2024-08-17T02:47:10.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.048+0000 7f260f400640 1 -- 172.21.15.5:0/3374517402 learned_addr learned my addr 172.21.15.5:0/3374517402 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:10.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.049+0000 7f260ea00640 1 --2- 172.21.15.5:0/3374517402 >> v2:172.21.15.107:3300/0 conn(0x7f2610158b90 0x7f26100b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.049+0000 7f260d600640 1 -- 172.21.15.5:0/3374517402 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311828726 0 0) 0x7f26100afd20 con 0x7f26100af130 2024-08-17T02:47:10.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.049+0000 7f260d600640 1 -- 172.21.15.5:0/3374517402 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f40034e0 con 0x7f26100af130 2024-08-17T02:47:10.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.049+0000 7f260ea00640 1 -- 172.21.15.5:0/3374517402 >> v1:172.21.15.107:6789/0 conn(0x7f26100b2370 legacy=0x7f26100aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.049+0000 7f260ea00640 1 -- 172.21.15.5:0/3374517402 >> v1:172.21.15.5:6789/0 conn(0x7f26100af130 legacy=0x7f26100ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.049+0000 7f260ea00640 1 -- 172.21.15.5:0/3374517402 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26100ca3c0 con 0x7f2610158b90 2024-08-17T02:47:10.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.049+0000 7f260d600640 1 -- 172.21.15.5:0/3374517402 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3748471205 0 0) 0x7f25f40034e0 con 0x7f26100af130 2024-08-17T02:47:10.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.050+0000 7f260ea00640 1 --2- 172.21.15.5:0/3374517402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2610158b90 0x7f26100b1e30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2600009850 tx=0x7f26000090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c3ca41e31847187 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:10.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.050+0000 7f260d600640 1 -- 172.21.15.5:0/3374517402 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608001810 con 0x7f2610158b90 2024-08-17T02:47:10.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.050+0000 7f260d600640 1 -- 172.21.15.5:0/3374517402 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260002ab00 con 0x7f2610158b90 2024-08-17T02:47:10.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.051+0000 7f260d600640 1 -- 172.21.15.5:0/3374517402 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260002aea0 con 0x7f2610158b90 2024-08-17T02:47:10.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.051+0000 7f2615800640 1 -- 172.21.15.5:0/3374517402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2610158b90 msgr2=0x7f26100b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.051+0000 7f2615800640 1 --2- 172.21.15.5:0/3374517402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2610158b90 0x7f26100b1e30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2600009850 tx=0x7f26000090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.051+0000 7f2615800640 1 -- 172.21.15.5:0/3374517402 shutdown_connections 2024-08-17T02:47:10.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.051+0000 7f2615800640 1 --2- 172.21.15.5:0/3374517402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2610158b90 0x7f26100b1e30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.051+0000 7f2615800640 1 -- 172.21.15.5:0/3374517402 >> 172.21.15.5:0/3374517402 conn(0x7f261006e590 msgr2=0x7f261006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:10.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.051+0000 7f2615800640 1 -- 172.21.15.5:0/3374517402 shutdown_connections 2024-08-17T02:47:10.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.051+0000 7f2615800640 1 -- 172.21.15.5:0/3374517402 wait complete. 2024-08-17T02:47:10.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.053+0000 7f2615800640 1 Processor -- start 2024-08-17T02:47:10.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.053+0000 7f2615800640 1 -- start start 2024-08-17T02:47:10.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f2615800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26100af130 0x7f261016ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f2615800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26100b2370 0x7f26100c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f2615800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2610158b90 0x7f2610158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f2615800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26100c8620 con 0x7f26100af130 2024-08-17T02:47:10.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f2615800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26100ca150 con 0x7f2610158b90 2024-08-17T02:47:10.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f2615800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26100c7a10 con 0x7f26100b2370 2024-08-17T02:47:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f260ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26100af130 0x7f261016ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f260ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26100af130 0x7f261016ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33564/0 (socket says 172.21.15.5:33564) 2024-08-17T02:47:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f260ea00640 1 -- 172.21.15.5:0/2874524307 learned_addr learned my addr 172.21.15.5:0/2874524307 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f260f400640 1 --2- 172.21.15.5:0/2874524307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2610158b90 0x7f2610158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f260e000640 1 --2- 172.21.15.5:0/2874524307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26100b2370 0x7f26100c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f260ea00640 1 -- 172.21.15.5:0/2874524307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26100b2370 msgr2=0x7f26100c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f260ea00640 1 --2- 172.21.15.5:0/2874524307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26100b2370 0x7f26100c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f260ea00640 1 -- 172.21.15.5:0/2874524307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2610158b90 msgr2=0x7f2610158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f260ea00640 1 --2- 172.21.15.5:0/2874524307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2610158b90 0x7f2610158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f260ea00640 1 -- 172.21.15.5:0/2874524307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2600009390 con 0x7f26100af130 2024-08-17T02:47:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f260e000640 1 --2- 172.21.15.5:0/2874524307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26100b2370 0x7f26100c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.054+0000 7f260ea00640 1 --2- 172.21.15.5:0/2874524307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26100af130 0x7f261016ba40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2600009850 tx=0x7f2600032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.055+0000 7f2606000640 1 -- 172.21.15.5:0/2874524307 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600031780 con 0x7f26100af130 2024-08-17T02:47:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.055+0000 7f2606000640 1 -- 172.21.15.5:0/2874524307 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26000318e0 con 0x7f26100af130 2024-08-17T02:47:10.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.055+0000 7f2606000640 1 -- 172.21.15.5:0/2874524307 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600031ca0 con 0x7f26100af130 2024-08-17T02:47:10.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.055+0000 7f2615800640 1 -- 172.21.15.5:0/2874524307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26100c7cf0 con 0x7f26100af130 2024-08-17T02:47:10.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.055+0000 7f2615800640 1 -- 172.21.15.5:0/2874524307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26100c82b0 con 0x7f26100af130 2024-08-17T02:47:10.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.056+0000 7f2615800640 1 -- 172.21.15.5:0/2874524307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2610063fb0 con 0x7f26100af130 2024-08-17T02:47:10.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.057+0000 7f2606000640 1 -- 172.21.15.5:0/2874524307 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2600043030 con 0x7f26100af130 2024-08-17T02:47:10.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.057+0000 7f2606000640 1 --2- 172.21.15.5:0/2874524307 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f25f0065150 0x7f25f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.058+0000 7f2606000640 1 -- 172.21.15.5:0/2874524307 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2600041070 con 0x7f26100af130 2024-08-17T02:47:10.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.058+0000 7f260e000640 1 --2- 172.21.15.5:0/2874524307 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f25f0065150 0x7f25f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.058+0000 7f260e000640 1 --2- 172.21.15.5:0/2874524307 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f25f0065150 0x7f25f0067600 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f26100b5640 tx=0x7f25fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:10.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.062+0000 7f2606000640 1 -- 172.21.15.5:0/2874524307 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2600070c50 con 0x7f26100af130 2024-08-17T02:47:10.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.245+0000 7f2615800640 1 -- 172.21.15.5:0/2874524307 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f261016bf80 con 0x7f25f0065150 2024-08-17T02:47:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.251+0000 7f2606000640 1 -- 172.21.15.5:0/2874524307 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264510 (secure 0 0 0) 0x7f261016bf80 con 0x7f25f0065150 2024-08-17T02:47:10.255 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:10.257 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:47:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.255+0000 7f2615800640 1 -- 172.21.15.5:0/2874524307 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f25f0065150 msgr2=0x7f25f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.255+0000 7f2615800640 1 --2- 172.21.15.5:0/2874524307 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f25f0065150 0x7f25f0067600 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f26100b5640 tx=0x7f25fc009040 comp rx=0 tx=0).stop 2024-08-17T02:47:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.255+0000 7f2615800640 1 -- 172.21.15.5:0/2874524307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26100af130 msgr2=0x7f261016ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.255+0000 7f2615800640 1 --2- 172.21.15.5:0/2874524307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26100af130 0x7f261016ba40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2600009850 tx=0x7f2600032000 comp rx=0 tx=0).stop 2024-08-17T02:47:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.255+0000 7f2615800640 1 -- 172.21.15.5:0/2874524307 shutdown_connections 2024-08-17T02:47:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.255+0000 7f2615800640 1 --2- 172.21.15.5:0/2874524307 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f25f0065150 0x7f25f0067600 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.255+0000 7f2615800640 1 --2- 172.21.15.5:0/2874524307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2610158b90 0x7f2610158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.255+0000 7f2615800640 1 --2- 172.21.15.5:0/2874524307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26100b2370 0x7f26100c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.255+0000 7f2615800640 1 --2- 172.21.15.5:0/2874524307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26100af130 0x7f261016ba40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.255+0000 7f2615800640 1 -- 172.21.15.5:0/2874524307 >> 172.21.15.5:0/2874524307 conn(0x7f261006e590 msgr2=0x7f26100cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.255+0000 7f2615800640 1 -- 172.21.15.5:0/2874524307 shutdown_connections 2024-08-17T02:47:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.255+0000 7f2615800640 1 -- 172.21.15.5:0/2874524307 wait complete. 2024-08-17T02:47:10.271 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-08-17T02:47:09.055753+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398352,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576368,"statfs":{"total":773094113280,"available":770638200832,"internally_reserved":0,"allocated":2891776,"data_stored":1750644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002032"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200708+0000","last_change":"2024-08-17T02:46:58.194762+0000","last_active":"2024-08-17T02:46:58.200708+0000","last_peered":"2024-08-17T02:46:58.200708+0000","last_clean":"2024-08-17T02:46:58.200708+0000","last_became_active":"2024-08-17T02:46:58.194202+0000","last_became_peered":"2024-08-17T02:46:58.194202+0000","last_unstale":"2024-08-17T02:46:58.200708+0000","last_undegraded":"2024-08-17T02:46:58.200708+0000","last_fullsized":"2024-08-17T02:46:58.200708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:32.670412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192679+0000","last_change":"2024-08-17T02:46:58.187726+0000","last_active":"2024-08-17T02:46:58.192679+0000","last_peered":"2024-08-17T02:46:58.192679+0000","last_clean":"2024-08-17T02:46:58.192679+0000","last_became_active":"2024-08-17T02:46:58.186807+0000","last_became_peered":"2024-08-17T02:46:58.186807+0000","last_unstale":"2024-08-17T02:46:58.192679+0000","last_undegraded":"2024-08-17T02:46:58.192679+0000","last_fullsized":"2024-08-17T02:46:58.192679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.186858+0000","last_change":"2024-08-17T02:46:58.185460+0000","last_active":"2024-08-17T02:46:58.186858+0000","last_peered":"2024-08-17T02:46:58.186858+0000","last_clean":"2024-08-17T02:46:58.186858+0000","last_became_active":"2024-08-17T02:46:58.185174+0000","last_became_peered":"2024-08-17T02:46:58.185174+0000","last_unstale":"2024-08-17T02:46:58.186858+0000","last_undegraded":"2024-08-17T02:46:58.186858+0000","last_fullsized":"2024-08-17T02:46:58.186858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:38.127688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204315+0000","last_change":"2024-08-17T02:46:58.199149+0000","last_active":"2024-08-17T02:46:58.204315+0000","last_peered":"2024-08-17T02:46:58.204315+0000","last_clean":"2024-08-17T02:46:58.204315+0000","last_became_active":"2024-08-17T02:46:58.198846+0000","last_became_peered":"2024-08-17T02:46:58.198846+0000","last_unstale":"2024-08-17T02:46:58.204315+0000","last_undegraded":"2024-08-17T02:46:58.204315+0000","last_fullsized":"2024-08-17T02:46:58.204315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:32.670412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205421+0000","last_change":"2024-08-17T02:46:58.202653+0000","last_active":"2024-08-17T02:46:58.205421+0000","last_peered":"2024-08-17T02:46:58.205421+0000","last_clean":"2024-08-17T02:46:58.205421+0000","last_became_active":"2024-08-17T02:46:58.202358+0000","last_became_peered":"2024-08-17T02:46:58.202358+0000","last_unstale":"2024-08-17T02:46:58.205421+0000","last_undegraded":"2024-08-17T02:46:58.205421+0000","last_fullsized":"2024-08-17T02:46:58.205421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199883+0000","last_change":"2024-08-17T02:46:58.181154+0000","last_active":"2024-08-17T02:46:58.199883+0000","last_peered":"2024-08-17T02:46:58.199883+0000","last_clean":"2024-08-17T02:46:58.199883+0000","last_became_active":"2024-08-17T02:46:58.180861+0000","last_became_peered":"2024-08-17T02:46:58.180861+0000","last_unstale":"2024-08-17T02:46:58.199883+0000","last_undegraded":"2024-08-17T02:46:58.199883+0000","last_fullsized":"2024-08-17T02:46:58.199883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:27:30.743267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193720+0000","last_change":"2024-08-17T02:46:58.190386+0000","last_active":"2024-08-17T02:46:58.193720+0000","last_peered":"2024-08-17T02:46:58.193720+0000","last_clean":"2024-08-17T02:46:58.193720+0000","last_became_active":"2024-08-17T02:46:58.189738+0000","last_became_peered":"2024-08-17T02:46:58.189738+0000","last_unstale":"2024-08-17T02:46:58.193720+0000","last_undegraded":"2024-08-17T02:46:58.193720+0000","last_fullsized":"2024-08-17T02:46:58.193720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:15.650114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190737+0000","last_change":"2024-08-17T02:46:58.182527+0000","last_active":"2024-08-17T02:46:58.190737+0000","last_peered":"2024-08-17T02:46:58.190737+0000","last_clean":"2024-08-17T02:46:58.190737+0000","last_became_active":"2024-08-17T02:46:58.182258+0000","last_became_peered":"2024-08-17T02:46:58.182258+0000","last_unstale":"2024-08-17T02:46:58.190737+0000","last_undegraded":"2024-08-17T02:46:58.190737+0000","last_fullsized":"2024-08-17T02:46:58.190737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:27:30.743267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205404+0000","last_change":"2024-08-17T02:46:58.201855+0000","last_active":"2024-08-17T02:46:58.205404+0000","last_peered":"2024-08-17T02:46:58.205404+0000","last_clean":"2024-08-17T02:46:58.205404+0000","last_became_active":"2024-08-17T02:46:58.201590+0000","last_became_peered":"2024-08-17T02:46:58.201590+0000","last_unstale":"2024-08-17T02:46:58.205404+0000","last_undegraded":"2024-08-17T02:46:58.205404+0000","last_fullsized":"2024-08-17T02:46:58.205404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:13:53.828518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199385+0000","last_change":"2024-08-17T02:46:58.193865+0000","last_active":"2024-08-17T02:46:58.199385+0000","last_peered":"2024-08-17T02:46:58.199385+0000","last_clean":"2024-08-17T02:46:58.199385+0000","last_became_active":"2024-08-17T02:46:58.190621+0000","last_became_peered":"2024-08-17T02:46:58.190621+0000","last_unstale":"2024-08-17T02:46:58.199385+0000","last_undegraded":"2024-08-17T02:46:58.199385+0000","last_fullsized":"2024-08-17T02:46:58.199385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:31.536609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190368+0000","last_change":"2024-08-17T02:46:58.185266+0000","last_active":"2024-08-17T02:46:58.190368+0000","last_peered":"2024-08-17T02:46:58.190368+0000","last_clean":"2024-08-17T02:46:58.190368+0000","last_became_active":"2024-08-17T02:46:58.182572+0000","last_became_peered":"2024-08-17T02:46:58.182572+0000","last_unstale":"2024-08-17T02:46:58.190368+0000","last_undegraded":"2024-08-17T02:46:58.190368+0000","last_fullsized":"2024-08-17T02:46:58.190368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195597+0000","last_change":"2024-08-17T02:46:58.187586+0000","last_active":"2024-08-17T02:46:58.195597+0000","last_peered":"2024-08-17T02:46:58.195597+0000","last_clean":"2024-08-17T02:46:58.195597+0000","last_became_active":"2024-08-17T02:46:58.187335+0000","last_became_peered":"2024-08-17T02:46:58.187335+0000","last_unstale":"2024-08-17T02:46:58.195597+0000","last_undegraded":"2024-08-17T02:46:58.195597+0000","last_fullsized":"2024-08-17T02:46:58.195597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:55.602794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193574+0000","last_change":"2024-08-17T02:46:58.191084+0000","last_active":"2024-08-17T02:46:58.193574+0000","last_peered":"2024-08-17T02:46:58.193574+0000","last_clean":"2024-08-17T02:46:58.193574+0000","last_became_active":"2024-08-17T02:46:58.190785+0000","last_became_peered":"2024-08-17T02:46:58.190785+0000","last_unstale":"2024-08-17T02:46:58.193574+0000","last_undegraded":"2024-08-17T02:46:58.193574+0000","last_fullsized":"2024-08-17T02:46:58.193574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.178552+0000","last_change":"2024-08-17T02:46:58.171881+0000","last_active":"2024-08-17T02:46:58.178552+0000","last_peered":"2024-08-17T02:46:58.178552+0000","last_clean":"2024-08-17T02:46:58.178552+0000","last_became_active":"2024-08-17T02:46:58.171501+0000","last_became_peered":"2024-08-17T02:46:58.171501+0000","last_unstale":"2024-08-17T02:46:58.178552+0000","last_undegraded":"2024-08-17T02:46:58.178552+0000","last_fullsized":"2024-08-17T02:46:58.178552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:33.640796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182891+0000","last_change":"2024-08-17T02:46:58.177768+0000","last_active":"2024-08-17T02:46:58.182891+0000","last_peered":"2024-08-17T02:46:58.182891+0000","last_clean":"2024-08-17T02:46:58.182891+0000","last_became_active":"2024-08-17T02:46:58.177477+0000","last_became_peered":"2024-08-17T02:46:58.177477+0000","last_unstale":"2024-08-17T02:46:58.182891+0000","last_undegraded":"2024-08-17T02:46:58.182891+0000","last_fullsized":"2024-08-17T02:46:58.182891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:31.536609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199278+0000","last_change":"2024-08-17T02:46:58.185626+0000","last_active":"2024-08-17T02:46:58.199278+0000","last_peered":"2024-08-17T02:46:58.199278+0000","last_clean":"2024-08-17T02:46:58.199278+0000","last_became_active":"2024-08-17T02:46:58.185229+0000","last_became_peered":"2024-08-17T02:46:58.185229+0000","last_unstale":"2024-08-17T02:46:58.199278+0000","last_undegraded":"2024-08-17T02:46:58.199278+0000","last_fullsized":"2024-08-17T02:46:58.199278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:05.343969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204193+0000","last_change":"2024-08-17T02:46:58.198656+0000","last_active":"2024-08-17T02:46:58.204193+0000","last_peered":"2024-08-17T02:46:58.204193+0000","last_clean":"2024-08-17T02:46:58.204193+0000","last_became_active":"2024-08-17T02:46:58.198359+0000","last_became_peered":"2024-08-17T02:46:58.198359+0000","last_unstale":"2024-08-17T02:46:58.204193+0000","last_undegraded":"2024-08-17T02:46:58.204193+0000","last_fullsized":"2024-08-17T02:46:58.204193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:11.578823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.201567+0000","last_change":"2024-08-17T02:46:58.199727+0000","last_active":"2024-08-17T02:46:58.201567+0000","last_peered":"2024-08-17T02:46:58.201567+0000","last_clean":"2024-08-17T02:46:58.201567+0000","last_became_active":"2024-08-17T02:46:58.197375+0000","last_became_peered":"2024-08-17T02:46:58.197375+0000","last_unstale":"2024-08-17T02:46:58.201567+0000","last_undegraded":"2024-08-17T02:46:58.201567+0000","last_fullsized":"2024-08-17T02:46:58.201567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:23.710551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205376+0000","last_change":"2024-08-17T02:46:58.201834+0000","last_active":"2024-08-17T02:46:58.205376+0000","last_peered":"2024-08-17T02:46:58.205376+0000","last_clean":"2024-08-17T02:46:58.205376+0000","last_became_active":"2024-08-17T02:46:58.201441+0000","last_became_peered":"2024-08-17T02:46:58.201441+0000","last_unstale":"2024-08-17T02:46:58.205376+0000","last_undegraded":"2024-08-17T02:46:58.205376+0000","last_fullsized":"2024-08-17T02:46:58.205376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:27:30.743267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.186476+0000","last_change":"2024-08-17T02:46:58.183993+0000","last_active":"2024-08-17T02:46:58.186476+0000","last_peered":"2024-08-17T02:46:58.186476+0000","last_clean":"2024-08-17T02:46:58.186476+0000","last_became_active":"2024-08-17T02:46:58.183062+0000","last_became_peered":"2024-08-17T02:46:58.183062+0000","last_unstale":"2024-08-17T02:46:58.186476+0000","last_undegraded":"2024-08-17T02:46:58.186476+0000","last_fullsized":"2024-08-17T02:46:58.186476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182024+0000","last_change":"2024-08-17T02:46:58.179197+0000","last_active":"2024-08-17T02:46:58.182024+0000","last_peered":"2024-08-17T02:46:58.182024+0000","last_clean":"2024-08-17T02:46:58.182024+0000","last_became_active":"2024-08-17T02:46:58.178943+0000","last_became_peered":"2024-08-17T02:46:58.178943+0000","last_unstale":"2024-08-17T02:46:58.182024+0000","last_undegraded":"2024-08-17T02:46:58.182024+0000","last_fullsized":"2024-08-17T02:46:58.182024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:28.627999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200146+0000","last_change":"2024-08-17T02:46:58.193621+0000","last_active":"2024-08-17T02:46:58.200146+0000","last_peered":"2024-08-17T02:46:58.200146+0000","last_clean":"2024-08-17T02:46:58.200146+0000","last_became_active":"2024-08-17T02:46:58.193367+0000","last_became_peered":"2024-08-17T02:46:58.193367+0000","last_unstale":"2024-08-17T02:46:58.200146+0000","last_undegraded":"2024-08-17T02:46:58.200146+0000","last_fullsized":"2024-08-17T02:46:58.200146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:15.650114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.197851+0000","last_change":"2024-08-17T02:46:58.196187+0000","last_active":"2024-08-17T02:46:58.197851+0000","last_peered":"2024-08-17T02:46:58.197851+0000","last_clean":"2024-08-17T02:46:58.197851+0000","last_became_active":"2024-08-17T02:46:58.195945+0000","last_became_peered":"2024-08-17T02:46:58.195945+0000","last_unstale":"2024-08-17T02:46:58.197851+0000","last_undegraded":"2024-08-17T02:46:58.197851+0000","last_fullsized":"2024-08-17T02:46:58.197851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:33.640796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199480+0000","last_change":"2024-08-17T02:46:58.186302+0000","last_active":"2024-08-17T02:46:58.199480+0000","last_peered":"2024-08-17T02:46:58.199480+0000","last_clean":"2024-08-17T02:46:58.199480+0000","last_became_active":"2024-08-17T02:46:58.185991+0000","last_became_peered":"2024-08-17T02:46:58.185991+0000","last_unstale":"2024-08-17T02:46:58.199480+0000","last_undegraded":"2024-08-17T02:46:58.199480+0000","last_fullsized":"2024-08-17T02:46:58.199480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:27.700709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190838+0000","last_change":"2024-08-17T02:46:58.182905+0000","last_active":"2024-08-17T02:46:58.190838+0000","last_peered":"2024-08-17T02:46:58.190838+0000","last_clean":"2024-08-17T02:46:58.190838+0000","last_became_active":"2024-08-17T02:46:58.180544+0000","last_became_peered":"2024-08-17T02:46:58.180544+0000","last_unstale":"2024-08-17T02:46:58.190838+0000","last_undegraded":"2024-08-17T02:46:58.190838+0000","last_fullsized":"2024-08-17T02:46:58.190838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:34.299927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199367+0000","last_change":"2024-08-17T02:46:58.192607+0000","last_active":"2024-08-17T02:46:58.199367+0000","last_peered":"2024-08-17T02:46:58.199367+0000","last_clean":"2024-08-17T02:46:58.199367+0000","last_became_active":"2024-08-17T02:46:58.192400+0000","last_became_peered":"2024-08-17T02:46:58.192400+0000","last_unstale":"2024-08-17T02:46:58.199367+0000","last_undegraded":"2024-08-17T02:46:58.199367+0000","last_fullsized":"2024-08-17T02:46:58.199367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196626+0000","last_change":"2024-08-17T02:46:58.180251+0000","last_active":"2024-08-17T02:46:58.196626+0000","last_peered":"2024-08-17T02:46:58.196626+0000","last_clean":"2024-08-17T02:46:58.196626+0000","last_became_active":"2024-08-17T02:46:58.179999+0000","last_became_peered":"2024-08-17T02:46:58.179999+0000","last_unstale":"2024-08-17T02:46:58.196626+0000","last_undegraded":"2024-08-17T02:46:58.196626+0000","last_fullsized":"2024-08-17T02:46:58.196626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191065+0000","last_change":"2024-08-17T02:46:58.187641+0000","last_active":"2024-08-17T02:46:58.191065+0000","last_peered":"2024-08-17T02:46:58.191065+0000","last_clean":"2024-08-17T02:46:58.191065+0000","last_became_active":"2024-08-17T02:46:58.183623+0000","last_became_peered":"2024-08-17T02:46:58.183623+0000","last_unstale":"2024-08-17T02:46:58.191065+0000","last_undegraded":"2024-08-17T02:46:58.191065+0000","last_fullsized":"2024-08-17T02:46:58.191065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182583+0000","last_change":"2024-08-17T02:46:58.179841+0000","last_active":"2024-08-17T02:46:58.182583+0000","last_peered":"2024-08-17T02:46:58.182583+0000","last_clean":"2024-08-17T02:46:58.182583+0000","last_became_active":"2024-08-17T02:46:58.179424+0000","last_became_peered":"2024-08-17T02:46:58.179424+0000","last_unstale":"2024-08-17T02:46:58.182583+0000","last_undegraded":"2024-08-17T02:46:58.182583+0000","last_fullsized":"2024-08-17T02:46:58.182583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205064+0000","last_change":"2024-08-17T02:46:58.199295+0000","last_active":"2024-08-17T02:46:58.205064+0000","last_peered":"2024-08-17T02:46:58.205064+0000","last_clean":"2024-08-17T02:46:58.205064+0000","last_became_active":"2024-08-17T02:46:58.198388+0000","last_became_peered":"2024-08-17T02:46:58.198388+0000","last_unstale":"2024-08-17T02:46:58.205064+0000","last_undegraded":"2024-08-17T02:46:58.205064+0000","last_fullsized":"2024-08-17T02:46:58.205064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:20.281407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.189531+0000","last_change":"2024-08-17T02:46:58.185183+0000","last_active":"2024-08-17T02:46:58.189531+0000","last_peered":"2024-08-17T02:46:58.189531+0000","last_clean":"2024-08-17T02:46:58.189531+0000","last_became_active":"2024-08-17T02:46:58.184850+0000","last_became_peered":"2024-08-17T02:46:58.184850+0000","last_unstale":"2024-08-17T02:46:58.189531+0000","last_undegraded":"2024-08-17T02:46:58.189531+0000","last_fullsized":"2024-08-17T02:46:58.189531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:52.596395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192369+0000","last_change":"2024-08-17T02:46:58.187380+0000","last_active":"2024-08-17T02:46:58.192369+0000","last_peered":"2024-08-17T02:46:58.192369+0000","last_clean":"2024-08-17T02:46:58.192369+0000","last_became_active":"2024-08-17T02:46:58.187091+0000","last_became_peered":"2024-08-17T02:46:58.187091+0000","last_unstale":"2024-08-17T02:46:58.192369+0000","last_undegraded":"2024-08-17T02:46:58.192369+0000","last_fullsized":"2024-08-17T02:46:58.192369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:28.627999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.179200+0000","last_change":"2024-08-17T02:46:58.174376+0000","last_active":"2024-08-17T02:46:58.179200+0000","last_peered":"2024-08-17T02:46:58.179200+0000","last_clean":"2024-08-17T02:46:58.179200+0000","last_became_active":"2024-08-17T02:46:58.173432+0000","last_became_peered":"2024-08-17T02:46:58.173432+0000","last_unstale":"2024-08-17T02:46:58.179200+0000","last_undegraded":"2024-08-17T02:46:58.179200+0000","last_fullsized":"2024-08-17T02:46:58.179200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:28.364147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193762+0000","last_change":"2024-08-17T02:46:57.189925+0000","last_active":"2024-08-17T02:46:58.193762+0000","last_peered":"2024-08-17T02:46:58.193762+0000","last_clean":"2024-08-17T02:46:58.193762+0000","last_became_active":"2024-08-17T02:46:57.189656+0000","last_became_peered":"2024-08-17T02:46:57.189656+0000","last_unstale":"2024-08-17T02:46:58.193762+0000","last_undegraded":"2024-08-17T02:46:58.193762+0000","last_fullsized":"2024-08-17T02:46:58.193762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182005+0000","last_change":"2024-08-17T02:46:58.178720+0000","last_active":"2024-08-17T02:46:58.182005+0000","last_peered":"2024-08-17T02:46:58.182005+0000","last_clean":"2024-08-17T02:46:58.182005+0000","last_became_active":"2024-08-17T02:46:58.177772+0000","last_became_peered":"2024-08-17T02:46:58.177772+0000","last_unstale":"2024-08-17T02:46:58.182005+0000","last_undegraded":"2024-08-17T02:46:58.182005+0000","last_fullsized":"2024-08-17T02:46:58.182005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:34.299927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.187850+0000","last_change":"2024-08-17T02:46:57.172726+0000","last_active":"2024-08-17T02:46:58.187850+0000","last_peered":"2024-08-17T02:46:58.187850+0000","last_clean":"2024-08-17T02:46:58.187850+0000","last_became_active":"2024-08-17T02:46:57.172399+0000","last_became_peered":"2024-08-17T02:46:57.172399+0000","last_unstale":"2024-08-17T02:46:58.187850+0000","last_undegraded":"2024-08-17T02:46:58.187850+0000","last_fullsized":"2024-08-17T02:46:58.187850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.171412+0000","last_change":"2024-08-17T02:46:57.183195+0000","last_active":"2024-08-17T02:46:58.171412+0000","last_peered":"2024-08-17T02:46:58.171412+0000","last_clean":"2024-08-17T02:46:58.171412+0000","last_became_active":"2024-08-17T02:46:57.182892+0000","last_became_peered":"2024-08-17T02:46:57.182892+0000","last_unstale":"2024-08-17T02:46:58.171412+0000","last_undegraded":"2024-08-17T02:46:58.171412+0000","last_fullsized":"2024-08-17T02:46:58.171412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:03.559127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190912+0000","last_change":"2024-08-17T02:46:58.186355+0000","last_active":"2024-08-17T02:46:58.190912+0000","last_peered":"2024-08-17T02:46:58.190912+0000","last_clean":"2024-08-17T02:46:58.190912+0000","last_became_active":"2024-08-17T02:46:58.184770+0000","last_became_peered":"2024-08-17T02:46:58.184770+0000","last_unstale":"2024-08-17T02:46:58.190912+0000","last_undegraded":"2024-08-17T02:46:58.190912+0000","last_fullsized":"2024-08-17T02:46:58.190912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.174256+0000","last_change":"2024-08-17T02:46:57.182999+0000","last_active":"2024-08-17T02:46:58.174256+0000","last_peered":"2024-08-17T02:46:58.174256+0000","last_clean":"2024-08-17T02:46:58.174256+0000","last_became_active":"2024-08-17T02:46:57.182704+0000","last_became_peered":"2024-08-17T02:46:57.182704+0000","last_unstale":"2024-08-17T02:46:58.174256+0000","last_undegraded":"2024-08-17T02:46:58.174256+0000","last_fullsized":"2024-08-17T02:46:58.174256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182901+0000","last_change":"2024-08-17T02:46:58.178469+0000","last_active":"2024-08-17T02:46:58.182901+0000","last_peered":"2024-08-17T02:46:58.182901+0000","last_clean":"2024-08-17T02:46:58.182901+0000","last_became_active":"2024-08-17T02:46:58.178131+0000","last_became_peered":"2024-08-17T02:46:58.178131+0000","last_unstale":"2024-08-17T02:46:58.182901+0000","last_undegraded":"2024-08-17T02:46:58.182901+0000","last_fullsized":"2024-08-17T02:46:58.182901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.164211+0000","last_change":"2024-08-17T02:46:57.186233+0000","last_active":"2024-08-17T02:46:58.164211+0000","last_peered":"2024-08-17T02:46:58.164211+0000","last_clean":"2024-08-17T02:46:58.164211+0000","last_became_active":"2024-08-17T02:46:57.185870+0000","last_became_peered":"2024-08-17T02:46:57.185870+0000","last_unstale":"2024-08-17T02:46:58.164211+0000","last_undegraded":"2024-08-17T02:46:58.164211+0000","last_fullsized":"2024-08-17T02:46:58.164211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200162+0000","last_change":"2024-08-17T02:46:58.193886+0000","last_active":"2024-08-17T02:46:58.200162+0000","last_peered":"2024-08-17T02:46:58.200162+0000","last_clean":"2024-08-17T02:46:58.200162+0000","last_became_active":"2024-08-17T02:46:58.193601+0000","last_became_peered":"2024-08-17T02:46:58.193601+0000","last_unstale":"2024-08-17T02:46:58.200162+0000","last_undegraded":"2024-08-17T02:46:58.200162+0000","last_fullsized":"2024-08-17T02:46:58.200162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:36.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.176488+0000","last_change":"2024-08-17T02:46:57.178427+0000","last_active":"2024-08-17T02:46:58.176488+0000","last_peered":"2024-08-17T02:46:58.176488+0000","last_clean":"2024-08-17T02:46:58.176488+0000","last_became_active":"2024-08-17T02:46:57.178055+0000","last_became_peered":"2024-08-17T02:46:57.178055+0000","last_unstale":"2024-08-17T02:46:58.176488+0000","last_undegraded":"2024-08-17T02:46:58.176488+0000","last_fullsized":"2024-08-17T02:46:58.176488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.186843+0000","last_change":"2024-08-17T02:46:58.185244+0000","last_active":"2024-08-17T02:46:58.186843+0000","last_peered":"2024-08-17T02:46:58.186843+0000","last_clean":"2024-08-17T02:46:58.186843+0000","last_became_active":"2024-08-17T02:46:58.184932+0000","last_became_peered":"2024-08-17T02:46:58.184932+0000","last_unstale":"2024-08-17T02:46:58.186843+0000","last_undegraded":"2024-08-17T02:46:58.186843+0000","last_fullsized":"2024-08-17T02:46:58.186843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200246+0000","last_change":"2024-08-17T02:46:57.185013+0000","last_active":"2024-08-17T02:46:58.200246+0000","last_peered":"2024-08-17T02:46:58.200246+0000","last_clean":"2024-08-17T02:46:58.200246+0000","last_became_active":"2024-08-17T02:46:57.184784+0000","last_became_peered":"2024-08-17T02:46:57.184784+0000","last_unstale":"2024-08-17T02:46:58.200246+0000","last_undegraded":"2024-08-17T02:46:58.200246+0000","last_fullsized":"2024-08-17T02:46:58.200246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:22.700908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200848+0000","last_change":"2024-08-17T02:46:58.195407+0000","last_active":"2024-08-17T02:46:58.200848+0000","last_peered":"2024-08-17T02:46:58.200848+0000","last_clean":"2024-08-17T02:46:58.200848+0000","last_became_active":"2024-08-17T02:46:58.195124+0000","last_became_peered":"2024-08-17T02:46:58.195124+0000","last_unstale":"2024-08-17T02:46:58.200848+0000","last_undegraded":"2024-08-17T02:46:58.200848+0000","last_fullsized":"2024-08-17T02:46:58.200848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:52.596395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.202448+0000","last_change":"2024-08-17T02:46:57.187357+0000","last_active":"2024-08-17T02:46:58.202448+0000","last_peered":"2024-08-17T02:46:58.202448+0000","last_clean":"2024-08-17T02:46:58.202448+0000","last_became_active":"2024-08-17T02:46:57.187009+0000","last_became_peered":"2024-08-17T02:46:57.187009+0000","last_unstale":"2024-08-17T02:46:58.202448+0000","last_undegraded":"2024-08-17T02:46:58.202448+0000","last_fullsized":"2024-08-17T02:46:58.202448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.197087+0000","last_change":"2024-08-17T02:46:58.192814+0000","last_active":"2024-08-17T02:46:58.197087+0000","last_peered":"2024-08-17T02:46:58.197087+0000","last_clean":"2024-08-17T02:46:58.197087+0000","last_became_active":"2024-08-17T02:46:58.192555+0000","last_became_peered":"2024-08-17T02:46:58.192555+0000","last_unstale":"2024-08-17T02:46:58.197087+0000","last_undegraded":"2024-08-17T02:46:58.197087+0000","last_fullsized":"2024-08-17T02:46:58.197087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:27.700709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195065+0000","last_change":"2024-08-17T02:46:57.173067+0000","last_active":"2024-08-17T02:46:58.195065+0000","last_peered":"2024-08-17T02:46:58.195065+0000","last_clean":"2024-08-17T02:46:58.195065+0000","last_became_active":"2024-08-17T02:46:57.172758+0000","last_became_peered":"2024-08-17T02:46:57.172758+0000","last_unstale":"2024-08-17T02:46:58.195065+0000","last_undegraded":"2024-08-17T02:46:58.195065+0000","last_fullsized":"2024-08-17T02:46:58.195065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:03.559127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195519+0000","last_change":"2024-08-17T02:46:58.193978+0000","last_active":"2024-08-17T02:46:58.195519+0000","last_peered":"2024-08-17T02:46:58.195519+0000","last_clean":"2024-08-17T02:46:58.195519+0000","last_became_active":"2024-08-17T02:46:58.193769+0000","last_became_peered":"2024-08-17T02:46:58.193769+0000","last_unstale":"2024-08-17T02:46:58.195519+0000","last_undegraded":"2024-08-17T02:46:58.195519+0000","last_fullsized":"2024-08-17T02:46:58.195519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.176328+0000","last_change":"2024-08-17T02:46:57.184989+0000","last_active":"2024-08-17T02:46:58.176328+0000","last_peered":"2024-08-17T02:46:58.176328+0000","last_clean":"2024-08-17T02:46:58.176328+0000","last_became_active":"2024-08-17T02:46:57.184687+0000","last_became_peered":"2024-08-17T02:46:57.184687+0000","last_unstale":"2024-08-17T02:46:58.176328+0000","last_undegraded":"2024-08-17T02:46:58.176328+0000","last_fullsized":"2024-08-17T02:46:58.176328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195058+0000","last_change":"2024-08-17T02:46:58.190873+0000","last_active":"2024-08-17T02:46:58.195058+0000","last_peered":"2024-08-17T02:46:58.195058+0000","last_clean":"2024-08-17T02:46:58.195058+0000","last_became_active":"2024-08-17T02:46:58.190322+0000","last_became_peered":"2024-08-17T02:46:58.190322+0000","last_unstale":"2024-08-17T02:46:58.195058+0000","last_undegraded":"2024-08-17T02:46:58.195058+0000","last_fullsized":"2024-08-17T02:46:58.195058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:05.343969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.164482+0000","last_change":"2024-08-17T02:46:57.180474+0000","last_active":"2024-08-17T02:46:58.164482+0000","last_peered":"2024-08-17T02:46:58.164482+0000","last_clean":"2024-08-17T02:46:58.164482+0000","last_became_active":"2024-08-17T02:46:57.180126+0000","last_became_peered":"2024-08-17T02:46:57.180126+0000","last_unstale":"2024-08-17T02:46:58.164482+0000","last_undegraded":"2024-08-17T02:46:58.164482+0000","last_fullsized":"2024-08-17T02:46:58.164482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192352+0000","last_change":"2024-08-17T02:46:58.187354+0000","last_active":"2024-08-17T02:46:58.192352+0000","last_peered":"2024-08-17T02:46:58.192352+0000","last_clean":"2024-08-17T02:46:58.192352+0000","last_became_active":"2024-08-17T02:46:58.187061+0000","last_became_peered":"2024-08-17T02:46:58.187061+0000","last_unstale":"2024-08-17T02:46:58.192352+0000","last_undegraded":"2024-08-17T02:46:58.192352+0000","last_fullsized":"2024-08-17T02:46:58.192352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:33.640796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204507+0000","last_change":"2024-08-17T02:46:57.173178+0000","last_active":"2024-08-17T02:46:58.204507+0000","last_peered":"2024-08-17T02:46:58.204507+0000","last_clean":"2024-08-17T02:46:58.204507+0000","last_became_active":"2024-08-17T02:46:57.171399+0000","last_became_peered":"2024-08-17T02:46:57.171399+0000","last_unstale":"2024-08-17T02:46:58.204507+0000","last_undegraded":"2024-08-17T02:46:58.204507+0000","last_fullsized":"2024-08-17T02:46:58.204507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200463+0000","last_change":"2024-08-17T02:46:58.195024+0000","last_active":"2024-08-17T02:46:58.200463+0000","last_peered":"2024-08-17T02:46:58.200463+0000","last_clean":"2024-08-17T02:46:58.200463+0000","last_became_active":"2024-08-17T02:46:58.194058+0000","last_became_peered":"2024-08-17T02:46:58.194058+0000","last_unstale":"2024-08-17T02:46:58.200463+0000","last_undegraded":"2024-08-17T02:46:58.200463+0000","last_fullsized":"2024-08-17T02:46:58.200463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:36.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193533+0000","last_change":"2024-08-17T02:46:57.179217+0000","last_active":"2024-08-17T02:46:58.193533+0000","last_peered":"2024-08-17T02:46:58.193533+0000","last_clean":"2024-08-17T02:46:58.193533+0000","last_became_active":"2024-08-17T02:46:57.178894+0000","last_became_peered":"2024-08-17T02:46:57.178894+0000","last_unstale":"2024-08-17T02:46:58.193533+0000","last_undegraded":"2024-08-17T02:46:58.193533+0000","last_fullsized":"2024-08-17T02:46:58.193533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:29:23.466288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200370+0000","last_change":"2024-08-17T02:46:58.195478+0000","last_active":"2024-08-17T02:46:58.200370+0000","last_peered":"2024-08-17T02:46:58.200370+0000","last_clean":"2024-08-17T02:46:58.200370+0000","last_became_active":"2024-08-17T02:46:58.195223+0000","last_became_peered":"2024-08-17T02:46:58.195223+0000","last_unstale":"2024-08-17T02:46:58.200370+0000","last_undegraded":"2024-08-17T02:46:58.200370+0000","last_fullsized":"2024-08-17T02:46:58.200370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:20.281407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.197709+0000","last_change":"2024-08-17T02:46:57.188113+0000","last_active":"2024-08-17T02:46:58.197709+0000","last_peered":"2024-08-17T02:46:58.197709+0000","last_clean":"2024-08-17T02:46:58.197709+0000","last_became_active":"2024-08-17T02:46:57.187801+0000","last_became_peered":"2024-08-17T02:46:57.187801+0000","last_unstale":"2024-08-17T02:46:58.197709+0000","last_undegraded":"2024-08-17T02:46:58.197709+0000","last_fullsized":"2024-08-17T02:46:58.197709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:21.241911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204810+0000","last_change":"2024-08-17T02:46:58.198647+0000","last_active":"2024-08-17T02:46:58.204810+0000","last_peered":"2024-08-17T02:46:58.204810+0000","last_clean":"2024-08-17T02:46:58.204810+0000","last_became_active":"2024-08-17T02:46:58.198406+0000","last_became_peered":"2024-08-17T02:46:58.198406+0000","last_unstale":"2024-08-17T02:46:58.204810+0000","last_undegraded":"2024-08-17T02:46:58.204810+0000","last_fullsized":"2024-08-17T02:46:58.204810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:49.067728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196700+0000","last_change":"2024-08-17T02:46:57.177253+0000","last_active":"2024-08-17T02:46:58.196700+0000","last_peered":"2024-08-17T02:46:58.196700+0000","last_clean":"2024-08-17T02:46:58.196700+0000","last_became_active":"2024-08-17T02:46:57.176994+0000","last_became_peered":"2024-08-17T02:46:57.176994+0000","last_unstale":"2024-08-17T02:46:58.196700+0000","last_undegraded":"2024-08-17T02:46:58.196700+0000","last_fullsized":"2024-08-17T02:46:58.196700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:51.586751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199394+0000","last_change":"2024-08-17T02:46:58.186086+0000","last_active":"2024-08-17T02:46:58.199394+0000","last_peered":"2024-08-17T02:46:58.199394+0000","last_clean":"2024-08-17T02:46:58.199394+0000","last_became_active":"2024-08-17T02:46:58.185889+0000","last_became_peered":"2024-08-17T02:46:58.185889+0000","last_unstale":"2024-08-17T02:46:58.199394+0000","last_undegraded":"2024-08-17T02:46:58.199394+0000","last_fullsized":"2024-08-17T02:46:58.199394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:49.067728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.175925+0000","last_change":"2024-08-17T02:46:57.181595+0000","last_active":"2024-08-17T02:46:58.175925+0000","last_peered":"2024-08-17T02:46:58.175925+0000","last_clean":"2024-08-17T02:46:58.175925+0000","last_became_active":"2024-08-17T02:46:57.181288+0000","last_became_peered":"2024-08-17T02:46:57.181288+0000","last_unstale":"2024-08-17T02:46:58.175925+0000","last_undegraded":"2024-08-17T02:46:58.175925+0000","last_fullsized":"2024-08-17T02:46:58.175925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:03.559127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205392+0000","last_change":"2024-08-17T02:46:58.202092+0000","last_active":"2024-08-17T02:46:58.205392+0000","last_peered":"2024-08-17T02:46:58.205392+0000","last_clean":"2024-08-17T02:46:58.205392+0000","last_became_active":"2024-08-17T02:46:58.201265+0000","last_became_peered":"2024-08-17T02:46:58.201265+0000","last_unstale":"2024-08-17T02:46:58.205392+0000","last_undegraded":"2024-08-17T02:46:58.205392+0000","last_fullsized":"2024-08-17T02:46:58.205392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:57.772457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.170897+0000","last_change":"2024-08-17T02:46:48.424689+0000","last_active":"2024-08-17T02:46:58.170897+0000","last_peered":"2024-08-17T02:46:58.170897+0000","last_clean":"2024-08-17T02:46:58.170897+0000","last_became_active":"2024-08-17T02:46:48.423437+0000","last_became_peered":"2024-08-17T02:46:48.423437+0000","last_unstale":"2024-08-17T02:46:58.170897+0000","last_undegraded":"2024-08-17T02:46:58.170897+0000","last_fullsized":"2024-08-17T02:46:58.170897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.106569+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:50.533980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.168621+0000","last_change":"2024-08-17T02:46:57.171177+0000","last_active":"2024-08-17T02:46:58.168621+0000","last_peered":"2024-08-17T02:46:58.168621+0000","last_clean":"2024-08-17T02:46:58.168621+0000","last_became_active":"2024-08-17T02:46:57.170458+0000","last_became_peered":"2024-08-17T02:46:57.170458+0000","last_unstale":"2024-08-17T02:46:58.168621+0000","last_undegraded":"2024-08-17T02:46:58.168621+0000","last_fullsized":"2024-08-17T02:46:58.168621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196422+0000","last_change":"2024-08-17T02:46:58.195312+0000","last_active":"2024-08-17T02:46:58.196422+0000","last_peered":"2024-08-17T02:46:58.196422+0000","last_clean":"2024-08-17T02:46:58.196422+0000","last_became_active":"2024-08-17T02:46:58.195014+0000","last_became_peered":"2024-08-17T02:46:58.195014+0000","last_unstale":"2024-08-17T02:46:58.196422+0000","last_undegraded":"2024-08-17T02:46:58.196422+0000","last_fullsized":"2024-08-17T02:46:58.196422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:08.556818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.170788+0000","last_change":"2024-08-17T02:46:57.184842+0000","last_active":"2024-08-17T02:46:58.170788+0000","last_peered":"2024-08-17T02:46:58.170788+0000","last_clean":"2024-08-17T02:46:58.170788+0000","last_became_active":"2024-08-17T02:46:57.184291+0000","last_became_peered":"2024-08-17T02:46:57.184291+0000","last_unstale":"2024-08-17T02:46:58.170788+0000","last_undegraded":"2024-08-17T02:46:58.170788+0000","last_fullsized":"2024-08-17T02:46:58.170788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.183117+0000","last_change":"2024-08-17T02:46:58.180783+0000","last_active":"2024-08-17T02:46:58.183117+0000","last_peered":"2024-08-17T02:46:58.183117+0000","last_clean":"2024-08-17T02:46:58.183117+0000","last_became_active":"2024-08-17T02:46:58.174973+0000","last_became_peered":"2024-08-17T02:46:58.174973+0000","last_unstale":"2024-08-17T02:46:58.183117+0000","last_undegraded":"2024-08-17T02:46:58.183117+0000","last_fullsized":"2024-08-17T02:46:58.183117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.176827+0000","last_change":"2024-08-17T02:46:57.184122+0000","last_active":"2024-08-17T02:46:58.176827+0000","last_peered":"2024-08-17T02:46:58.176827+0000","last_clean":"2024-08-17T02:46:58.176827+0000","last_became_active":"2024-08-17T02:46:57.183807+0000","last_became_peered":"2024-08-17T02:46:57.183807+0000","last_unstale":"2024-08-17T02:46:58.176827+0000","last_undegraded":"2024-08-17T02:46:58.176827+0000","last_fullsized":"2024-08-17T02:46:58.176827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.203872+0000","last_change":"2024-08-17T02:46:58.202695+0000","last_active":"2024-08-17T02:46:58.203872+0000","last_peered":"2024-08-17T02:46:58.203872+0000","last_clean":"2024-08-17T02:46:58.203872+0000","last_became_active":"2024-08-17T02:46:58.201153+0000","last_became_peered":"2024-08-17T02:46:58.201153+0000","last_unstale":"2024-08-17T02:46:58.203872+0000","last_undegraded":"2024-08-17T02:46:58.203872+0000","last_fullsized":"2024-08-17T02:46:58.203872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:34.299927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.175573+0000","last_change":"2024-08-17T02:46:57.172754+0000","last_active":"2024-08-17T02:46:58.175573+0000","last_peered":"2024-08-17T02:46:58.175573+0000","last_clean":"2024-08-17T02:46:58.175573+0000","last_became_active":"2024-08-17T02:46:57.172534+0000","last_became_peered":"2024-08-17T02:46:57.172534+0000","last_unstale":"2024-08-17T02:46:58.175573+0000","last_undegraded":"2024-08-17T02:46:58.175573+0000","last_fullsized":"2024-08-17T02:46:58.175573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192797+0000","last_change":"2024-08-17T02:46:58.184673+0000","last_active":"2024-08-17T02:46:58.192797+0000","last_peered":"2024-08-17T02:46:58.192797+0000","last_clean":"2024-08-17T02:46:58.192797+0000","last_became_active":"2024-08-17T02:46:58.184365+0000","last_became_peered":"2024-08-17T02:46:58.184365+0000","last_unstale":"2024-08-17T02:46:58.192797+0000","last_undegraded":"2024-08-17T02:46:58.192797+0000","last_fullsized":"2024-08-17T02:46:58.192797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:18.212612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.165816+0000","last_change":"2024-08-17T02:46:57.172721+0000","last_active":"2024-08-17T02:46:58.165816+0000","last_peered":"2024-08-17T02:46:58.165816+0000","last_clean":"2024-08-17T02:46:58.165816+0000","last_became_active":"2024-08-17T02:46:57.172414+0000","last_became_peered":"2024-08-17T02:46:57.172414+0000","last_unstale":"2024-08-17T02:46:58.165816+0000","last_undegraded":"2024-08-17T02:46:58.165816+0000","last_fullsized":"2024-08-17T02:46:58.165816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204268+0000","last_change":"2024-08-17T02:46:58.199050+0000","last_active":"2024-08-17T02:46:58.204268+0000","last_peered":"2024-08-17T02:46:58.204268+0000","last_clean":"2024-08-17T02:46:58.204268+0000","last_became_active":"2024-08-17T02:46:58.198795+0000","last_became_peered":"2024-08-17T02:46:58.198795+0000","last_unstale":"2024-08-17T02:46:58.204268+0000","last_undegraded":"2024-08-17T02:46:58.204268+0000","last_fullsized":"2024-08-17T02:46:58.204268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.181818+0000","last_change":"2024-08-17T02:46:57.186077+0000","last_active":"2024-08-17T02:46:58.181818+0000","last_peered":"2024-08-17T02:46:58.181818+0000","last_clean":"2024-08-17T02:46:58.181818+0000","last_became_active":"2024-08-17T02:46:57.185671+0000","last_became_peered":"2024-08-17T02:46:57.185671+0000","last_unstale":"2024-08-17T02:46:58.181818+0000","last_undegraded":"2024-08-17T02:46:58.181818+0000","last_fullsized":"2024-08-17T02:46:58.181818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:37.118045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.201382+0000","last_change":"2024-08-17T02:46:58.199398+0000","last_active":"2024-08-17T02:46:58.201382+0000","last_peered":"2024-08-17T02:46:58.201382+0000","last_clean":"2024-08-17T02:46:58.201382+0000","last_became_active":"2024-08-17T02:46:58.199075+0000","last_became_peered":"2024-08-17T02:46:58.199075+0000","last_unstale":"2024-08-17T02:46:58.201382+0000","last_undegraded":"2024-08-17T02:46:58.201382+0000","last_fullsized":"2024-08-17T02:46:58.201382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:59.180451+0000","last_change":"2024-08-17T02:46:57.175247+0000","last_active":"2024-08-17T02:46:59.180451+0000","last_peered":"2024-08-17T02:46:59.180451+0000","last_clean":"2024-08-17T02:46:59.180451+0000","last_became_active":"2024-08-17T02:46:57.174995+0000","last_became_peered":"2024-08-17T02:46:57.174995+0000","last_unstale":"2024-08-17T02:46:59.180451+0000","last_undegraded":"2024-08-17T02:46:59.180451+0000","last_fullsized":"2024-08-17T02:46:59.180451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195582+0000","last_change":"2024-08-17T02:46:58.194264+0000","last_active":"2024-08-17T02:46:58.195582+0000","last_peered":"2024-08-17T02:46:58.195582+0000","last_clean":"2024-08-17T02:46:58.195582+0000","last_became_active":"2024-08-17T02:46:58.193989+0000","last_became_peered":"2024-08-17T02:46:58.193989+0000","last_unstale":"2024-08-17T02:46:58.195582+0000","last_undegraded":"2024-08-17T02:46:58.195582+0000","last_fullsized":"2024-08-17T02:46:58.195582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:15.650114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193128+0000","last_change":"2024-08-17T02:46:57.183203+0000","last_active":"2024-08-17T02:46:58.193128+0000","last_peered":"2024-08-17T02:46:58.193128+0000","last_clean":"2024-08-17T02:46:58.193128+0000","last_became_active":"2024-08-17T02:46:57.182911+0000","last_became_peered":"2024-08-17T02:46:57.182911+0000","last_unstale":"2024-08-17T02:46:58.193128+0000","last_undegraded":"2024-08-17T02:46:58.193128+0000","last_fullsized":"2024-08-17T02:46:58.193128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.180870+0000","last_change":"2024-08-17T02:46:58.176398+0000","last_active":"2024-08-17T02:46:58.180870+0000","last_peered":"2024-08-17T02:46:58.180870+0000","last_clean":"2024-08-17T02:46:58.180870+0000","last_became_active":"2024-08-17T02:46:58.175994+0000","last_became_peered":"2024-08-17T02:46:58.175994+0000","last_unstale":"2024-08-17T02:46:58.180870+0000","last_undegraded":"2024-08-17T02:46:58.180870+0000","last_fullsized":"2024-08-17T02:46:58.180870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:38.320238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.170599+0000","last_change":"2024-08-17T02:46:57.186114+0000","last_active":"2024-08-17T02:46:58.170599+0000","last_peered":"2024-08-17T02:46:58.170599+0000","last_clean":"2024-08-17T02:46:58.170599+0000","last_became_active":"2024-08-17T02:46:57.185841+0000","last_became_peered":"2024-08-17T02:46:57.185841+0000","last_unstale":"2024-08-17T02:46:58.170599+0000","last_undegraded":"2024-08-17T02:46:58.170599+0000","last_fullsized":"2024-08-17T02:46:58.170599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193621+0000","last_change":"2024-08-17T02:46:58.184905+0000","last_active":"2024-08-17T02:46:58.193621+0000","last_peered":"2024-08-17T02:46:58.193621+0000","last_clean":"2024-08-17T02:46:58.193621+0000","last_became_active":"2024-08-17T02:46:58.184603+0000","last_became_peered":"2024-08-17T02:46:58.184603+0000","last_unstale":"2024-08-17T02:46:58.193621+0000","last_undegraded":"2024-08-17T02:46:58.193621+0000","last_fullsized":"2024-08-17T02:46:58.193621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:38.127688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.163704+0000","last_change":"2024-08-17T02:46:57.172885+0000","last_active":"2024-08-17T02:46:58.163704+0000","last_peered":"2024-08-17T02:46:58.163704+0000","last_clean":"2024-08-17T02:46:58.163704+0000","last_became_active":"2024-08-17T02:46:57.172559+0000","last_became_peered":"2024-08-17T02:46:57.172559+0000","last_unstale":"2024-08-17T02:46:58.163704+0000","last_undegraded":"2024-08-17T02:46:58.163704+0000","last_fullsized":"2024-08-17T02:46:58.163704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.188438+0000","last_change":"2024-08-17T02:46:58.179610+0000","last_active":"2024-08-17T02:46:58.188438+0000","last_peered":"2024-08-17T02:46:58.188438+0000","last_clean":"2024-08-17T02:46:58.188438+0000","last_became_active":"2024-08-17T02:46:58.179261+0000","last_became_peered":"2024-08-17T02:46:58.179261+0000","last_unstale":"2024-08-17T02:46:58.188438+0000","last_undegraded":"2024-08-17T02:46:58.188438+0000","last_fullsized":"2024-08-17T02:46:58.188438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.164164+0000","last_change":"2024-08-17T02:46:57.180623+0000","last_active":"2024-08-17T02:46:58.164164+0000","last_peered":"2024-08-17T02:46:58.164164+0000","last_clean":"2024-08-17T02:46:58.164164+0000","last_became_active":"2024-08-17T02:46:57.180314+0000","last_became_peered":"2024-08-17T02:46:57.180314+0000","last_unstale":"2024-08-17T02:46:58.164164+0000","last_undegraded":"2024-08-17T02:46:58.164164+0000","last_fullsized":"2024-08-17T02:46:58.164164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191197+0000","last_change":"2024-08-17T02:46:58.185876+0000","last_active":"2024-08-17T02:46:58.191197+0000","last_peered":"2024-08-17T02:46:58.191197+0000","last_clean":"2024-08-17T02:46:58.191197+0000","last_became_active":"2024-08-17T02:46:58.184142+0000","last_became_peered":"2024-08-17T02:46:58.184142+0000","last_unstale":"2024-08-17T02:46:58.191197+0000","last_undegraded":"2024-08-17T02:46:58.191197+0000","last_fullsized":"2024-08-17T02:46:58.191197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:28.627999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195140+0000","last_change":"2024-08-17T02:46:57.189083+0000","last_active":"2024-08-17T02:46:58.195140+0000","last_peered":"2024-08-17T02:46:58.195140+0000","last_clean":"2024-08-17T02:46:58.195140+0000","last_became_active":"2024-08-17T02:46:57.188780+0000","last_became_peered":"2024-08-17T02:46:57.188780+0000","last_unstale":"2024-08-17T02:46:58.195140+0000","last_undegraded":"2024-08-17T02:46:58.195140+0000","last_fullsized":"2024-08-17T02:46:58.195140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:51.586751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193431+0000","last_change":"2024-08-17T02:46:58.189014+0000","last_active":"2024-08-17T02:46:58.193431+0000","last_peered":"2024-08-17T02:46:58.193431+0000","last_clean":"2024-08-17T02:46:58.193431+0000","last_became_active":"2024-08-17T02:46:58.187210+0000","last_became_peered":"2024-08-17T02:46:58.187210+0000","last_unstale":"2024-08-17T02:46:58.193431+0000","last_undegraded":"2024-08-17T02:46:58.193431+0000","last_fullsized":"2024-08-17T02:46:58.193431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.198105+0000","last_change":"2024-08-17T02:46:58.184782+0000","last_active":"2024-08-17T02:46:58.198105+0000","last_peered":"2024-08-17T02:46:58.198105+0000","last_clean":"2024-08-17T02:46:58.198105+0000","last_became_active":"2024-08-17T02:46:58.184533+0000","last_became_peered":"2024-08-17T02:46:58.184533+0000","last_unstale":"2024-08-17T02:46:58.198105+0000","last_undegraded":"2024-08-17T02:46:58.198105+0000","last_fullsized":"2024-08-17T02:46:58.198105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.202042+0000","last_change":"2024-08-17T02:46:57.189298+0000","last_active":"2024-08-17T02:46:58.202042+0000","last_peered":"2024-08-17T02:46:58.202042+0000","last_clean":"2024-08-17T02:46:58.202042+0000","last_became_active":"2024-08-17T02:46:57.188971+0000","last_became_peered":"2024-08-17T02:46:57.188971+0000","last_unstale":"2024-08-17T02:46:58.202042+0000","last_undegraded":"2024-08-17T02:46:58.202042+0000","last_fullsized":"2024-08-17T02:46:58.202042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:22.700908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200097+0000","last_change":"2024-08-17T02:46:58.189815+0000","last_active":"2024-08-17T02:46:58.200097+0000","last_peered":"2024-08-17T02:46:58.200097+0000","last_clean":"2024-08-17T02:46:58.200097+0000","last_became_active":"2024-08-17T02:46:58.189556+0000","last_became_peered":"2024-08-17T02:46:58.189556+0000","last_unstale":"2024-08-17T02:46:58.200097+0000","last_undegraded":"2024-08-17T02:46:58.200097+0000","last_fullsized":"2024-08-17T02:46:58.200097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:08.556818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.194232+0000","last_change":"2024-08-17T02:46:57.188201+0000","last_active":"2024-08-17T02:46:58.194232+0000","last_peered":"2024-08-17T02:46:58.194232+0000","last_clean":"2024-08-17T02:46:58.194232+0000","last_became_active":"2024-08-17T02:46:57.187942+0000","last_became_peered":"2024-08-17T02:46:57.187942+0000","last_unstale":"2024-08-17T02:46:58.194232+0000","last_undegraded":"2024-08-17T02:46:58.194232+0000","last_fullsized":"2024-08-17T02:46:58.194232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191573+0000","last_change":"2024-08-17T02:46:58.185979+0000","last_active":"2024-08-17T02:46:58.191573+0000","last_peered":"2024-08-17T02:46:58.191573+0000","last_clean":"2024-08-17T02:46:58.191573+0000","last_became_active":"2024-08-17T02:46:58.185692+0000","last_became_peered":"2024-08-17T02:46:58.185692+0000","last_unstale":"2024-08-17T02:46:58.191573+0000","last_undegraded":"2024-08-17T02:46:58.191573+0000","last_fullsized":"2024-08-17T02:46:58.191573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:31.536609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196531+0000","last_change":"2024-08-17T02:46:57.181312+0000","last_active":"2024-08-17T02:46:58.196531+0000","last_peered":"2024-08-17T02:46:58.196531+0000","last_clean":"2024-08-17T02:46:58.196531+0000","last_became_active":"2024-08-17T02:46:57.181041+0000","last_became_peered":"2024-08-17T02:46:57.181041+0000","last_unstale":"2024-08-17T02:46:58.196531+0000","last_undegraded":"2024-08-17T02:46:58.196531+0000","last_fullsized":"2024-08-17T02:46:58.196531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:21.241911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191018+0000","last_change":"2024-08-17T02:46:58.187913+0000","last_active":"2024-08-17T02:46:58.191018+0000","last_peered":"2024-08-17T02:46:58.191018+0000","last_clean":"2024-08-17T02:46:58.191018+0000","last_became_active":"2024-08-17T02:46:58.187627+0000","last_became_peered":"2024-08-17T02:46:58.187627+0000","last_unstale":"2024-08-17T02:46:58.191018+0000","last_undegraded":"2024-08-17T02:46:58.191018+0000","last_fullsized":"2024-08-17T02:46:58.191018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:11.578823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.194605+0000","last_change":"2024-08-17T02:46:57.183697+0000","last_active":"2024-08-17T02:46:58.194605+0000","last_peered":"2024-08-17T02:46:58.194605+0000","last_clean":"2024-08-17T02:46:58.194605+0000","last_became_active":"2024-08-17T02:46:57.183438+0000","last_became_peered":"2024-08-17T02:46:57.183438+0000","last_unstale":"2024-08-17T02:46:58.194605+0000","last_undegraded":"2024-08-17T02:46:58.194605+0000","last_fullsized":"2024-08-17T02:46:58.194605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:01:09.175011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":802816,"data_stored":661592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301728,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070112,"statfs":{"total":96636764160,"available":96327794688,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301716,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070124,"statfs":{"total":96636764160,"available":96327806976,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1339999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301724,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070116,"statfs":{"total":96636764160,"available":96327798784,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302316,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069524,"statfs":{"total":96636764160,"available":96327192576,"internally_reserved":0,"allocated":811008,"data_stored":661648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:47:10.279 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:47:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.462+0000 7f1528a00640 1 Processor -- start 2024-08-17T02:47:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.462+0000 7f1528a00640 1 -- start start 2024-08-17T02:47:10.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.463+0000 7f1528a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15240b0e30 0x7f15240b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.463+0000 7f1528a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1524156f90 0x7f15240cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.463+0000 7f1528a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152406d7c0 con 0x7f152415a590 2024-08-17T02:47:10.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.463+0000 7f1528a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15240cb5b0 con 0x7f15240b0e30 2024-08-17T02:47:10.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.463+0000 7f1528a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152415ab30 con 0x7f1524156f90 2024-08-17T02:47:10.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.463+0000 7f1523400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15240b0e30 0x7f15240b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.463+0000 7f1523400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15240b0e30 0x7f15240b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33570/0 (socket says 172.21.15.5:33570) 2024-08-17T02:47:10.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.463+0000 7f1523e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f152415a590 0x7f152413fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42168/0 (socket says 172.21.15.5:42168) 2024-08-17T02:47:10.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.463+0000 7f1523400640 1 -- 172.21.15.5:0/453693821 learned_addr learned my addr 172.21.15.5:0/453693821 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:10.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.463+0000 7f151aa00640 1 --2- 172.21.15.5:0/453693821 >> v2:172.21.15.107:3300/0 conn(0x7f1524156f90 0x7f15240cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.464+0000 7f1523400640 1 -- 172.21.15.5:0/453693821 >> v2:172.21.15.107:3300/0 conn(0x7f1524156f90 msgr2=0x7f15240cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:10.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.464+0000 7f1523400640 1 --2- 172.21.15.5:0/453693821 >> v2:172.21.15.107:3300/0 conn(0x7f1524156f90 0x7f15240cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.464+0000 7f1523400640 1 -- 172.21.15.5:0/453693821 >> v1:172.21.15.5:6789/0 conn(0x7f152415a590 legacy=0x7f152413fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.464+0000 7f1523400640 1 -- 172.21.15.5:0/453693821 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152415ae10 con 0x7f15240b0e30 2024-08-17T02:47:10.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.465+0000 7f1523400640 1 --2- 172.21.15.5:0/453693821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15240b0e30 0x7f15240b1200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f15240c8180 tx=0x7f15140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ba77ad5524b584 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:10.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.465+0000 7f1522a00640 1 -- 172.21.15.5:0/453693821 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151402acc0 con 0x7f15240b0e30 2024-08-17T02:47:10.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.465+0000 7f1522a00640 1 -- 172.21.15.5:0/453693821 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151402ae20 con 0x7f15240b0e30 2024-08-17T02:47:10.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.465+0000 7f1522a00640 1 -- 172.21.15.5:0/453693821 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514032670 con 0x7f15240b0e30 2024-08-17T02:47:10.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.466+0000 7f1528a00640 1 -- 172.21.15.5:0/453693821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15240b0e30 msgr2=0x7f15240b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.466+0000 7f1528a00640 1 --2- 172.21.15.5:0/453693821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15240b0e30 0x7f15240b1200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f15240c8180 tx=0x7f15140091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.466+0000 7f1528a00640 1 -- 172.21.15.5:0/453693821 shutdown_connections 2024-08-17T02:47:10.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.466+0000 7f1528a00640 1 --2- 172.21.15.5:0/453693821 >> v2:172.21.15.107:3300/0 conn(0x7f1524156f90 0x7f15240cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.466+0000 7f1528a00640 1 --2- 172.21.15.5:0/453693821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15240b0e30 0x7f15240b1200 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.466+0000 7f1528a00640 1 -- 172.21.15.5:0/453693821 >> 172.21.15.5:0/453693821 conn(0x7f1524062af0 msgr2=0x7f1524062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:10.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.466+0000 7f1528a00640 1 -- 172.21.15.5:0/453693821 shutdown_connections 2024-08-17T02:47:10.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.466+0000 7f1528a00640 1 -- 172.21.15.5:0/453693821 wait complete. 2024-08-17T02:47:10.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.467+0000 7f1528a00640 1 Processor -- start 2024-08-17T02:47:10.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.467+0000 7f1528a00640 1 -- start start 2024-08-17T02:47:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.468+0000 7f1528a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15240b0e30 0x7f15240c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.468+0000 7f1528a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1524156f90 0x7f15240c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.468+0000 7f1528a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152415a590 0x7f15241360c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.468+0000 7f1528a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15240c2d80 con 0x7f152415a590 2024-08-17T02:47:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.468+0000 7f1528a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15240c1770 con 0x7f15240b0e30 2024-08-17T02:47:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.468+0000 7f1528a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15240c19b0 con 0x7f1524156f90 2024-08-17T02:47:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.469+0000 7f1523e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152415a590 0x7f15241360c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.469+0000 7f1523e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152415a590 0x7f15241360c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33580/0 (socket says 172.21.15.5:33580) 2024-08-17T02:47:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.469+0000 7f1523e00640 1 -- 172.21.15.5:0/3110711199 learned_addr learned my addr 172.21.15.5:0/3110711199 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.469+0000 7f1523400640 1 --2- 172.21.15.5:0/3110711199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15240b0e30 0x7f15240c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.469+0000 7f151aa00640 1 --2- 172.21.15.5:0/3110711199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1524156f90 0x7f15240c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.469+0000 7f1523e00640 1 -- 172.21.15.5:0/3110711199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1524156f90 msgr2=0x7f15240c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.469+0000 7f1523e00640 1 --2- 172.21.15.5:0/3110711199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1524156f90 0x7f15240c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.469+0000 7f1523e00640 1 -- 172.21.15.5:0/3110711199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15240b0e30 msgr2=0x7f15240c2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.469+0000 7f1523e00640 1 --2- 172.21.15.5:0/3110711199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15240b0e30 0x7f15240c2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.469+0000 7f1523e00640 1 -- 172.21.15.5:0/3110711199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1514009450 con 0x7f152415a590 2024-08-17T02:47:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.469+0000 7f1523e00640 1 --2- 172.21.15.5:0/3110711199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152415a590 0x7f15241360c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f151c00cb90 tx=0x7f151c0017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.469+0000 7f151b400640 1 -- 172.21.15.5:0/3110711199 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c005d60 con 0x7f152415a590 2024-08-17T02:47:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.470+0000 7f151b400640 1 -- 172.21.15.5:0/3110711199 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c00a6b0 con 0x7f152415a590 2024-08-17T02:47:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.470+0000 7f151b400640 1 -- 172.21.15.5:0/3110711199 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00aab0 con 0x7f152415a590 2024-08-17T02:47:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.470+0000 7f1528a00640 1 -- 172.21.15.5:0/3110711199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15240af3c0 con 0x7f152415a590 2024-08-17T02:47:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.470+0000 7f1528a00640 1 -- 172.21.15.5:0/3110711199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15240aed70 con 0x7f152415a590 2024-08-17T02:47:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.471+0000 7f1528a00640 1 -- 172.21.15.5:0/3110711199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15240af550 con 0x7f152415a590 2024-08-17T02:47:10.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.472+0000 7f151b400640 1 -- 172.21.15.5:0/3110711199 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f151c0070f0 con 0x7f152415a590 2024-08-17T02:47:10.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.473+0000 7f151b400640 1 --2- 172.21.15.5:0/3110711199 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1500065150 0x7f1500067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.473+0000 7f151b400640 1 -- 172.21.15.5:0/3110711199 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f151c0823b0 con 0x7f152415a590 2024-08-17T02:47:10.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.473+0000 7f1523400640 1 --2- 172.21.15.5:0/3110711199 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1500065150 0x7f1500067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.474+0000 7f1523400640 1 --2- 172.21.15.5:0/3110711199 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1500065150 0x7f1500067600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1514034000 tx=0x7f1514032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:10.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.476+0000 7f151b400640 1 -- 172.21.15.5:0/3110711199 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f151c050510 con 0x7f152415a590 2024-08-17T02:47:10.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.657+0000 7f1528a00640 1 -- 172.21.15.5:0/3110711199 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1524070720 con 0x7f1500065150 2024-08-17T02:47:10.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.664+0000 7f151b400640 1 -- 172.21.15.5:0/3110711199 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264510 (secure 0 0 0) 0x7f1524070720 con 0x7f1500065150 2024-08-17T02:47:10.669 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:47:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.668+0000 7f1528a00640 1 -- 172.21.15.5:0/3110711199 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1500065150 msgr2=0x7f1500067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.668+0000 7f1528a00640 1 --2- 172.21.15.5:0/3110711199 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1500065150 0x7f1500067600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1514034000 tx=0x7f1514032000 comp rx=0 tx=0).stop 2024-08-17T02:47:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.668+0000 7f1528a00640 1 -- 172.21.15.5:0/3110711199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152415a590 msgr2=0x7f15241360c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.668+0000 7f1528a00640 1 --2- 172.21.15.5:0/3110711199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152415a590 0x7f15241360c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f151c00cb90 tx=0x7f151c0017f0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.668+0000 7f1528a00640 1 -- 172.21.15.5:0/3110711199 shutdown_connections 2024-08-17T02:47:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.668+0000 7f1528a00640 1 --2- 172.21.15.5:0/3110711199 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1500065150 0x7f1500067600 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.668+0000 7f1528a00640 1 --2- 172.21.15.5:0/3110711199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f152415a590 0x7f15241360c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.668+0000 7f1528a00640 1 --2- 172.21.15.5:0/3110711199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1524156f90 0x7f15240c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.668+0000 7f1528a00640 1 --2- 172.21.15.5:0/3110711199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15240b0e30 0x7f15240c2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.668+0000 7f1528a00640 1 -- 172.21.15.5:0/3110711199 >> 172.21.15.5:0/3110711199 conn(0x7f1524062af0 msgr2=0x7f152413eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.668+0000 7f1528a00640 1 -- 172.21.15.5:0/3110711199 shutdown_connections 2024-08-17T02:47:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.668+0000 7f1528a00640 1 -- 172.21.15.5:0/3110711199 wait complete. 2024-08-17T02:47:10.683 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-08-17T02:47:09.055753+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398352,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576368,"statfs":{"total":773094113280,"available":770638200832,"internally_reserved":0,"allocated":2891776,"data_stored":1750644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002032"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200708+0000","last_change":"2024-08-17T02:46:58.194762+0000","last_active":"2024-08-17T02:46:58.200708+0000","last_peered":"2024-08-17T02:46:58.200708+0000","last_clean":"2024-08-17T02:46:58.200708+0000","last_became_active":"2024-08-17T02:46:58.194202+0000","last_became_peered":"2024-08-17T02:46:58.194202+0000","last_unstale":"2024-08-17T02:46:58.200708+0000","last_undegraded":"2024-08-17T02:46:58.200708+0000","last_fullsized":"2024-08-17T02:46:58.200708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:32.670412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192679+0000","last_change":"2024-08-17T02:46:58.187726+0000","last_active":"2024-08-17T02:46:58.192679+0000","last_peered":"2024-08-17T02:46:58.192679+0000","last_clean":"2024-08-17T02:46:58.192679+0000","last_became_active":"2024-08-17T02:46:58.186807+0000","last_became_peered":"2024-08-17T02:46:58.186807+0000","last_unstale":"2024-08-17T02:46:58.192679+0000","last_undegraded":"2024-08-17T02:46:58.192679+0000","last_fullsized":"2024-08-17T02:46:58.192679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.186858+0000","last_change":"2024-08-17T02:46:58.185460+0000","last_active":"2024-08-17T02:46:58.186858+0000","last_peered":"2024-08-17T02:46:58.186858+0000","last_clean":"2024-08-17T02:46:58.186858+0000","last_became_active":"2024-08-17T02:46:58.185174+0000","last_became_peered":"2024-08-17T02:46:58.185174+0000","last_unstale":"2024-08-17T02:46:58.186858+0000","last_undegraded":"2024-08-17T02:46:58.186858+0000","last_fullsized":"2024-08-17T02:46:58.186858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:38.127688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204315+0000","last_change":"2024-08-17T02:46:58.199149+0000","last_active":"2024-08-17T02:46:58.204315+0000","last_peered":"2024-08-17T02:46:58.204315+0000","last_clean":"2024-08-17T02:46:58.204315+0000","last_became_active":"2024-08-17T02:46:58.198846+0000","last_became_peered":"2024-08-17T02:46:58.198846+0000","last_unstale":"2024-08-17T02:46:58.204315+0000","last_undegraded":"2024-08-17T02:46:58.204315+0000","last_fullsized":"2024-08-17T02:46:58.204315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:32.670412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205421+0000","last_change":"2024-08-17T02:46:58.202653+0000","last_active":"2024-08-17T02:46:58.205421+0000","last_peered":"2024-08-17T02:46:58.205421+0000","last_clean":"2024-08-17T02:46:58.205421+0000","last_became_active":"2024-08-17T02:46:58.202358+0000","last_became_peered":"2024-08-17T02:46:58.202358+0000","last_unstale":"2024-08-17T02:46:58.205421+0000","last_undegraded":"2024-08-17T02:46:58.205421+0000","last_fullsized":"2024-08-17T02:46:58.205421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199883+0000","last_change":"2024-08-17T02:46:58.181154+0000","last_active":"2024-08-17T02:46:58.199883+0000","last_peered":"2024-08-17T02:46:58.199883+0000","last_clean":"2024-08-17T02:46:58.199883+0000","last_became_active":"2024-08-17T02:46:58.180861+0000","last_became_peered":"2024-08-17T02:46:58.180861+0000","last_unstale":"2024-08-17T02:46:58.199883+0000","last_undegraded":"2024-08-17T02:46:58.199883+0000","last_fullsized":"2024-08-17T02:46:58.199883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:27:30.743267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193720+0000","last_change":"2024-08-17T02:46:58.190386+0000","last_active":"2024-08-17T02:46:58.193720+0000","last_peered":"2024-08-17T02:46:58.193720+0000","last_clean":"2024-08-17T02:46:58.193720+0000","last_became_active":"2024-08-17T02:46:58.189738+0000","last_became_peered":"2024-08-17T02:46:58.189738+0000","last_unstale":"2024-08-17T02:46:58.193720+0000","last_undegraded":"2024-08-17T02:46:58.193720+0000","last_fullsized":"2024-08-17T02:46:58.193720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:15.650114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190737+0000","last_change":"2024-08-17T02:46:58.182527+0000","last_active":"2024-08-17T02:46:58.190737+0000","last_peered":"2024-08-17T02:46:58.190737+0000","last_clean":"2024-08-17T02:46:58.190737+0000","last_became_active":"2024-08-17T02:46:58.182258+0000","last_became_peered":"2024-08-17T02:46:58.182258+0000","last_unstale":"2024-08-17T02:46:58.190737+0000","last_undegraded":"2024-08-17T02:46:58.190737+0000","last_fullsized":"2024-08-17T02:46:58.190737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:27:30.743267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205404+0000","last_change":"2024-08-17T02:46:58.201855+0000","last_active":"2024-08-17T02:46:58.205404+0000","last_peered":"2024-08-17T02:46:58.205404+0000","last_clean":"2024-08-17T02:46:58.205404+0000","last_became_active":"2024-08-17T02:46:58.201590+0000","last_became_peered":"2024-08-17T02:46:58.201590+0000","last_unstale":"2024-08-17T02:46:58.205404+0000","last_undegraded":"2024-08-17T02:46:58.205404+0000","last_fullsized":"2024-08-17T02:46:58.205404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:13:53.828518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199385+0000","last_change":"2024-08-17T02:46:58.193865+0000","last_active":"2024-08-17T02:46:58.199385+0000","last_peered":"2024-08-17T02:46:58.199385+0000","last_clean":"2024-08-17T02:46:58.199385+0000","last_became_active":"2024-08-17T02:46:58.190621+0000","last_became_peered":"2024-08-17T02:46:58.190621+0000","last_unstale":"2024-08-17T02:46:58.199385+0000","last_undegraded":"2024-08-17T02:46:58.199385+0000","last_fullsized":"2024-08-17T02:46:58.199385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:31.536609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190368+0000","last_change":"2024-08-17T02:46:58.185266+0000","last_active":"2024-08-17T02:46:58.190368+0000","last_peered":"2024-08-17T02:46:58.190368+0000","last_clean":"2024-08-17T02:46:58.190368+0000","last_became_active":"2024-08-17T02:46:58.182572+0000","last_became_peered":"2024-08-17T02:46:58.182572+0000","last_unstale":"2024-08-17T02:46:58.190368+0000","last_undegraded":"2024-08-17T02:46:58.190368+0000","last_fullsized":"2024-08-17T02:46:58.190368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195597+0000","last_change":"2024-08-17T02:46:58.187586+0000","last_active":"2024-08-17T02:46:58.195597+0000","last_peered":"2024-08-17T02:46:58.195597+0000","last_clean":"2024-08-17T02:46:58.195597+0000","last_became_active":"2024-08-17T02:46:58.187335+0000","last_became_peered":"2024-08-17T02:46:58.187335+0000","last_unstale":"2024-08-17T02:46:58.195597+0000","last_undegraded":"2024-08-17T02:46:58.195597+0000","last_fullsized":"2024-08-17T02:46:58.195597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:55.602794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193574+0000","last_change":"2024-08-17T02:46:58.191084+0000","last_active":"2024-08-17T02:46:58.193574+0000","last_peered":"2024-08-17T02:46:58.193574+0000","last_clean":"2024-08-17T02:46:58.193574+0000","last_became_active":"2024-08-17T02:46:58.190785+0000","last_became_peered":"2024-08-17T02:46:58.190785+0000","last_unstale":"2024-08-17T02:46:58.193574+0000","last_undegraded":"2024-08-17T02:46:58.193574+0000","last_fullsized":"2024-08-17T02:46:58.193574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.178552+0000","last_change":"2024-08-17T02:46:58.171881+0000","last_active":"2024-08-17T02:46:58.178552+0000","last_peered":"2024-08-17T02:46:58.178552+0000","last_clean":"2024-08-17T02:46:58.178552+0000","last_became_active":"2024-08-17T02:46:58.171501+0000","last_became_peered":"2024-08-17T02:46:58.171501+0000","last_unstale":"2024-08-17T02:46:58.178552+0000","last_undegraded":"2024-08-17T02:46:58.178552+0000","last_fullsized":"2024-08-17T02:46:58.178552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:33.640796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182891+0000","last_change":"2024-08-17T02:46:58.177768+0000","last_active":"2024-08-17T02:46:58.182891+0000","last_peered":"2024-08-17T02:46:58.182891+0000","last_clean":"2024-08-17T02:46:58.182891+0000","last_became_active":"2024-08-17T02:46:58.177477+0000","last_became_peered":"2024-08-17T02:46:58.177477+0000","last_unstale":"2024-08-17T02:46:58.182891+0000","last_undegraded":"2024-08-17T02:46:58.182891+0000","last_fullsized":"2024-08-17T02:46:58.182891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:31.536609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199278+0000","last_change":"2024-08-17T02:46:58.185626+0000","last_active":"2024-08-17T02:46:58.199278+0000","last_peered":"2024-08-17T02:46:58.199278+0000","last_clean":"2024-08-17T02:46:58.199278+0000","last_became_active":"2024-08-17T02:46:58.185229+0000","last_became_peered":"2024-08-17T02:46:58.185229+0000","last_unstale":"2024-08-17T02:46:58.199278+0000","last_undegraded":"2024-08-17T02:46:58.199278+0000","last_fullsized":"2024-08-17T02:46:58.199278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:05.343969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204193+0000","last_change":"2024-08-17T02:46:58.198656+0000","last_active":"2024-08-17T02:46:58.204193+0000","last_peered":"2024-08-17T02:46:58.204193+0000","last_clean":"2024-08-17T02:46:58.204193+0000","last_became_active":"2024-08-17T02:46:58.198359+0000","last_became_peered":"2024-08-17T02:46:58.198359+0000","last_unstale":"2024-08-17T02:46:58.204193+0000","last_undegraded":"2024-08-17T02:46:58.204193+0000","last_fullsized":"2024-08-17T02:46:58.204193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:11.578823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.201567+0000","last_change":"2024-08-17T02:46:58.199727+0000","last_active":"2024-08-17T02:46:58.201567+0000","last_peered":"2024-08-17T02:46:58.201567+0000","last_clean":"2024-08-17T02:46:58.201567+0000","last_became_active":"2024-08-17T02:46:58.197375+0000","last_became_peered":"2024-08-17T02:46:58.197375+0000","last_unstale":"2024-08-17T02:46:58.201567+0000","last_undegraded":"2024-08-17T02:46:58.201567+0000","last_fullsized":"2024-08-17T02:46:58.201567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:23.710551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205376+0000","last_change":"2024-08-17T02:46:58.201834+0000","last_active":"2024-08-17T02:46:58.205376+0000","last_peered":"2024-08-17T02:46:58.205376+0000","last_clean":"2024-08-17T02:46:58.205376+0000","last_became_active":"2024-08-17T02:46:58.201441+0000","last_became_peered":"2024-08-17T02:46:58.201441+0000","last_unstale":"2024-08-17T02:46:58.205376+0000","last_undegraded":"2024-08-17T02:46:58.205376+0000","last_fullsized":"2024-08-17T02:46:58.205376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:27:30.743267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.186476+0000","last_change":"2024-08-17T02:46:58.183993+0000","last_active":"2024-08-17T02:46:58.186476+0000","last_peered":"2024-08-17T02:46:58.186476+0000","last_clean":"2024-08-17T02:46:58.186476+0000","last_became_active":"2024-08-17T02:46:58.183062+0000","last_became_peered":"2024-08-17T02:46:58.183062+0000","last_unstale":"2024-08-17T02:46:58.186476+0000","last_undegraded":"2024-08-17T02:46:58.186476+0000","last_fullsized":"2024-08-17T02:46:58.186476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182024+0000","last_change":"2024-08-17T02:46:58.179197+0000","last_active":"2024-08-17T02:46:58.182024+0000","last_peered":"2024-08-17T02:46:58.182024+0000","last_clean":"2024-08-17T02:46:58.182024+0000","last_became_active":"2024-08-17T02:46:58.178943+0000","last_became_peered":"2024-08-17T02:46:58.178943+0000","last_unstale":"2024-08-17T02:46:58.182024+0000","last_undegraded":"2024-08-17T02:46:58.182024+0000","last_fullsized":"2024-08-17T02:46:58.182024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:28.627999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200146+0000","last_change":"2024-08-17T02:46:58.193621+0000","last_active":"2024-08-17T02:46:58.200146+0000","last_peered":"2024-08-17T02:46:58.200146+0000","last_clean":"2024-08-17T02:46:58.200146+0000","last_became_active":"2024-08-17T02:46:58.193367+0000","last_became_peered":"2024-08-17T02:46:58.193367+0000","last_unstale":"2024-08-17T02:46:58.200146+0000","last_undegraded":"2024-08-17T02:46:58.200146+0000","last_fullsized":"2024-08-17T02:46:58.200146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:15.650114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.197851+0000","last_change":"2024-08-17T02:46:58.196187+0000","last_active":"2024-08-17T02:46:58.197851+0000","last_peered":"2024-08-17T02:46:58.197851+0000","last_clean":"2024-08-17T02:46:58.197851+0000","last_became_active":"2024-08-17T02:46:58.195945+0000","last_became_peered":"2024-08-17T02:46:58.195945+0000","last_unstale":"2024-08-17T02:46:58.197851+0000","last_undegraded":"2024-08-17T02:46:58.197851+0000","last_fullsized":"2024-08-17T02:46:58.197851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:33.640796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199480+0000","last_change":"2024-08-17T02:46:58.186302+0000","last_active":"2024-08-17T02:46:58.199480+0000","last_peered":"2024-08-17T02:46:58.199480+0000","last_clean":"2024-08-17T02:46:58.199480+0000","last_became_active":"2024-08-17T02:46:58.185991+0000","last_became_peered":"2024-08-17T02:46:58.185991+0000","last_unstale":"2024-08-17T02:46:58.199480+0000","last_undegraded":"2024-08-17T02:46:58.199480+0000","last_fullsized":"2024-08-17T02:46:58.199480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:27.700709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190838+0000","last_change":"2024-08-17T02:46:58.182905+0000","last_active":"2024-08-17T02:46:58.190838+0000","last_peered":"2024-08-17T02:46:58.190838+0000","last_clean":"2024-08-17T02:46:58.190838+0000","last_became_active":"2024-08-17T02:46:58.180544+0000","last_became_peered":"2024-08-17T02:46:58.180544+0000","last_unstale":"2024-08-17T02:46:58.190838+0000","last_undegraded":"2024-08-17T02:46:58.190838+0000","last_fullsized":"2024-08-17T02:46:58.190838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:34.299927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199367+0000","last_change":"2024-08-17T02:46:58.192607+0000","last_active":"2024-08-17T02:46:58.199367+0000","last_peered":"2024-08-17T02:46:58.199367+0000","last_clean":"2024-08-17T02:46:58.199367+0000","last_became_active":"2024-08-17T02:46:58.192400+0000","last_became_peered":"2024-08-17T02:46:58.192400+0000","last_unstale":"2024-08-17T02:46:58.199367+0000","last_undegraded":"2024-08-17T02:46:58.199367+0000","last_fullsized":"2024-08-17T02:46:58.199367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196626+0000","last_change":"2024-08-17T02:46:58.180251+0000","last_active":"2024-08-17T02:46:58.196626+0000","last_peered":"2024-08-17T02:46:58.196626+0000","last_clean":"2024-08-17T02:46:58.196626+0000","last_became_active":"2024-08-17T02:46:58.179999+0000","last_became_peered":"2024-08-17T02:46:58.179999+0000","last_unstale":"2024-08-17T02:46:58.196626+0000","last_undegraded":"2024-08-17T02:46:58.196626+0000","last_fullsized":"2024-08-17T02:46:58.196626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191065+0000","last_change":"2024-08-17T02:46:58.187641+0000","last_active":"2024-08-17T02:46:58.191065+0000","last_peered":"2024-08-17T02:46:58.191065+0000","last_clean":"2024-08-17T02:46:58.191065+0000","last_became_active":"2024-08-17T02:46:58.183623+0000","last_became_peered":"2024-08-17T02:46:58.183623+0000","last_unstale":"2024-08-17T02:46:58.191065+0000","last_undegraded":"2024-08-17T02:46:58.191065+0000","last_fullsized":"2024-08-17T02:46:58.191065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182583+0000","last_change":"2024-08-17T02:46:58.179841+0000","last_active":"2024-08-17T02:46:58.182583+0000","last_peered":"2024-08-17T02:46:58.182583+0000","last_clean":"2024-08-17T02:46:58.182583+0000","last_became_active":"2024-08-17T02:46:58.179424+0000","last_became_peered":"2024-08-17T02:46:58.179424+0000","last_unstale":"2024-08-17T02:46:58.182583+0000","last_undegraded":"2024-08-17T02:46:58.182583+0000","last_fullsized":"2024-08-17T02:46:58.182583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205064+0000","last_change":"2024-08-17T02:46:58.199295+0000","last_active":"2024-08-17T02:46:58.205064+0000","last_peered":"2024-08-17T02:46:58.205064+0000","last_clean":"2024-08-17T02:46:58.205064+0000","last_became_active":"2024-08-17T02:46:58.198388+0000","last_became_peered":"2024-08-17T02:46:58.198388+0000","last_unstale":"2024-08-17T02:46:58.205064+0000","last_undegraded":"2024-08-17T02:46:58.205064+0000","last_fullsized":"2024-08-17T02:46:58.205064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:20.281407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.189531+0000","last_change":"2024-08-17T02:46:58.185183+0000","last_active":"2024-08-17T02:46:58.189531+0000","last_peered":"2024-08-17T02:46:58.189531+0000","last_clean":"2024-08-17T02:46:58.189531+0000","last_became_active":"2024-08-17T02:46:58.184850+0000","last_became_peered":"2024-08-17T02:46:58.184850+0000","last_unstale":"2024-08-17T02:46:58.189531+0000","last_undegraded":"2024-08-17T02:46:58.189531+0000","last_fullsized":"2024-08-17T02:46:58.189531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:52.596395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192369+0000","last_change":"2024-08-17T02:46:58.187380+0000","last_active":"2024-08-17T02:46:58.192369+0000","last_peered":"2024-08-17T02:46:58.192369+0000","last_clean":"2024-08-17T02:46:58.192369+0000","last_became_active":"2024-08-17T02:46:58.187091+0000","last_became_peered":"2024-08-17T02:46:58.187091+0000","last_unstale":"2024-08-17T02:46:58.192369+0000","last_undegraded":"2024-08-17T02:46:58.192369+0000","last_fullsized":"2024-08-17T02:46:58.192369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:28.627999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.179200+0000","last_change":"2024-08-17T02:46:58.174376+0000","last_active":"2024-08-17T02:46:58.179200+0000","last_peered":"2024-08-17T02:46:58.179200+0000","last_clean":"2024-08-17T02:46:58.179200+0000","last_became_active":"2024-08-17T02:46:58.173432+0000","last_became_peered":"2024-08-17T02:46:58.173432+0000","last_unstale":"2024-08-17T02:46:58.179200+0000","last_undegraded":"2024-08-17T02:46:58.179200+0000","last_fullsized":"2024-08-17T02:46:58.179200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:28.364147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193762+0000","last_change":"2024-08-17T02:46:57.189925+0000","last_active":"2024-08-17T02:46:58.193762+0000","last_peered":"2024-08-17T02:46:58.193762+0000","last_clean":"2024-08-17T02:46:58.193762+0000","last_became_active":"2024-08-17T02:46:57.189656+0000","last_became_peered":"2024-08-17T02:46:57.189656+0000","last_unstale":"2024-08-17T02:46:58.193762+0000","last_undegraded":"2024-08-17T02:46:58.193762+0000","last_fullsized":"2024-08-17T02:46:58.193762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182005+0000","last_change":"2024-08-17T02:46:58.178720+0000","last_active":"2024-08-17T02:46:58.182005+0000","last_peered":"2024-08-17T02:46:58.182005+0000","last_clean":"2024-08-17T02:46:58.182005+0000","last_became_active":"2024-08-17T02:46:58.177772+0000","last_became_peered":"2024-08-17T02:46:58.177772+0000","last_unstale":"2024-08-17T02:46:58.182005+0000","last_undegraded":"2024-08-17T02:46:58.182005+0000","last_fullsized":"2024-08-17T02:46:58.182005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:34.299927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.187850+0000","last_change":"2024-08-17T02:46:57.172726+0000","last_active":"2024-08-17T02:46:58.187850+0000","last_peered":"2024-08-17T02:46:58.187850+0000","last_clean":"2024-08-17T02:46:58.187850+0000","last_became_active":"2024-08-17T02:46:57.172399+0000","last_became_peered":"2024-08-17T02:46:57.172399+0000","last_unstale":"2024-08-17T02:46:58.187850+0000","last_undegraded":"2024-08-17T02:46:58.187850+0000","last_fullsized":"2024-08-17T02:46:58.187850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.171412+0000","last_change":"2024-08-17T02:46:57.183195+0000","last_active":"2024-08-17T02:46:58.171412+0000","last_peered":"2024-08-17T02:46:58.171412+0000","last_clean":"2024-08-17T02:46:58.171412+0000","last_became_active":"2024-08-17T02:46:57.182892+0000","last_became_peered":"2024-08-17T02:46:57.182892+0000","last_unstale":"2024-08-17T02:46:58.171412+0000","last_undegraded":"2024-08-17T02:46:58.171412+0000","last_fullsized":"2024-08-17T02:46:58.171412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:03.559127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.190912+0000","last_change":"2024-08-17T02:46:58.186355+0000","last_active":"2024-08-17T02:46:58.190912+0000","last_peered":"2024-08-17T02:46:58.190912+0000","last_clean":"2024-08-17T02:46:58.190912+0000","last_became_active":"2024-08-17T02:46:58.184770+0000","last_became_peered":"2024-08-17T02:46:58.184770+0000","last_unstale":"2024-08-17T02:46:58.190912+0000","last_undegraded":"2024-08-17T02:46:58.190912+0000","last_fullsized":"2024-08-17T02:46:58.190912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.174256+0000","last_change":"2024-08-17T02:46:57.182999+0000","last_active":"2024-08-17T02:46:58.174256+0000","last_peered":"2024-08-17T02:46:58.174256+0000","last_clean":"2024-08-17T02:46:58.174256+0000","last_became_active":"2024-08-17T02:46:57.182704+0000","last_became_peered":"2024-08-17T02:46:57.182704+0000","last_unstale":"2024-08-17T02:46:58.174256+0000","last_undegraded":"2024-08-17T02:46:58.174256+0000","last_fullsized":"2024-08-17T02:46:58.174256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.182901+0000","last_change":"2024-08-17T02:46:58.178469+0000","last_active":"2024-08-17T02:46:58.182901+0000","last_peered":"2024-08-17T02:46:58.182901+0000","last_clean":"2024-08-17T02:46:58.182901+0000","last_became_active":"2024-08-17T02:46:58.178131+0000","last_became_peered":"2024-08-17T02:46:58.178131+0000","last_unstale":"2024-08-17T02:46:58.182901+0000","last_undegraded":"2024-08-17T02:46:58.182901+0000","last_fullsized":"2024-08-17T02:46:58.182901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.164211+0000","last_change":"2024-08-17T02:46:57.186233+0000","last_active":"2024-08-17T02:46:58.164211+0000","last_peered":"2024-08-17T02:46:58.164211+0000","last_clean":"2024-08-17T02:46:58.164211+0000","last_became_active":"2024-08-17T02:46:57.185870+0000","last_became_peered":"2024-08-17T02:46:57.185870+0000","last_unstale":"2024-08-17T02:46:58.164211+0000","last_undegraded":"2024-08-17T02:46:58.164211+0000","last_fullsized":"2024-08-17T02:46:58.164211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200162+0000","last_change":"2024-08-17T02:46:58.193886+0000","last_active":"2024-08-17T02:46:58.200162+0000","last_peered":"2024-08-17T02:46:58.200162+0000","last_clean":"2024-08-17T02:46:58.200162+0000","last_became_active":"2024-08-17T02:46:58.193601+0000","last_became_peered":"2024-08-17T02:46:58.193601+0000","last_unstale":"2024-08-17T02:46:58.200162+0000","last_undegraded":"2024-08-17T02:46:58.200162+0000","last_fullsized":"2024-08-17T02:46:58.200162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:36.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.176488+0000","last_change":"2024-08-17T02:46:57.178427+0000","last_active":"2024-08-17T02:46:58.176488+0000","last_peered":"2024-08-17T02:46:58.176488+0000","last_clean":"2024-08-17T02:46:58.176488+0000","last_became_active":"2024-08-17T02:46:57.178055+0000","last_became_peered":"2024-08-17T02:46:57.178055+0000","last_unstale":"2024-08-17T02:46:58.176488+0000","last_undegraded":"2024-08-17T02:46:58.176488+0000","last_fullsized":"2024-08-17T02:46:58.176488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.186843+0000","last_change":"2024-08-17T02:46:58.185244+0000","last_active":"2024-08-17T02:46:58.186843+0000","last_peered":"2024-08-17T02:46:58.186843+0000","last_clean":"2024-08-17T02:46:58.186843+0000","last_became_active":"2024-08-17T02:46:58.184932+0000","last_became_peered":"2024-08-17T02:46:58.184932+0000","last_unstale":"2024-08-17T02:46:58.186843+0000","last_undegraded":"2024-08-17T02:46:58.186843+0000","last_fullsized":"2024-08-17T02:46:58.186843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:03.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200246+0000","last_change":"2024-08-17T02:46:57.185013+0000","last_active":"2024-08-17T02:46:58.200246+0000","last_peered":"2024-08-17T02:46:58.200246+0000","last_clean":"2024-08-17T02:46:58.200246+0000","last_became_active":"2024-08-17T02:46:57.184784+0000","last_became_peered":"2024-08-17T02:46:57.184784+0000","last_unstale":"2024-08-17T02:46:58.200246+0000","last_undegraded":"2024-08-17T02:46:58.200246+0000","last_fullsized":"2024-08-17T02:46:58.200246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:22.700908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200848+0000","last_change":"2024-08-17T02:46:58.195407+0000","last_active":"2024-08-17T02:46:58.200848+0000","last_peered":"2024-08-17T02:46:58.200848+0000","last_clean":"2024-08-17T02:46:58.200848+0000","last_became_active":"2024-08-17T02:46:58.195124+0000","last_became_peered":"2024-08-17T02:46:58.195124+0000","last_unstale":"2024-08-17T02:46:58.200848+0000","last_undegraded":"2024-08-17T02:46:58.200848+0000","last_fullsized":"2024-08-17T02:46:58.200848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:52.596395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.202448+0000","last_change":"2024-08-17T02:46:57.187357+0000","last_active":"2024-08-17T02:46:58.202448+0000","last_peered":"2024-08-17T02:46:58.202448+0000","last_clean":"2024-08-17T02:46:58.202448+0000","last_became_active":"2024-08-17T02:46:57.187009+0000","last_became_peered":"2024-08-17T02:46:57.187009+0000","last_unstale":"2024-08-17T02:46:58.202448+0000","last_undegraded":"2024-08-17T02:46:58.202448+0000","last_fullsized":"2024-08-17T02:46:58.202448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.197087+0000","last_change":"2024-08-17T02:46:58.192814+0000","last_active":"2024-08-17T02:46:58.197087+0000","last_peered":"2024-08-17T02:46:58.197087+0000","last_clean":"2024-08-17T02:46:58.197087+0000","last_became_active":"2024-08-17T02:46:58.192555+0000","last_became_peered":"2024-08-17T02:46:58.192555+0000","last_unstale":"2024-08-17T02:46:58.197087+0000","last_undegraded":"2024-08-17T02:46:58.197087+0000","last_fullsized":"2024-08-17T02:46:58.197087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:27.700709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195065+0000","last_change":"2024-08-17T02:46:57.173067+0000","last_active":"2024-08-17T02:46:58.195065+0000","last_peered":"2024-08-17T02:46:58.195065+0000","last_clean":"2024-08-17T02:46:58.195065+0000","last_became_active":"2024-08-17T02:46:57.172758+0000","last_became_peered":"2024-08-17T02:46:57.172758+0000","last_unstale":"2024-08-17T02:46:58.195065+0000","last_undegraded":"2024-08-17T02:46:58.195065+0000","last_fullsized":"2024-08-17T02:46:58.195065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:03.559127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195519+0000","last_change":"2024-08-17T02:46:58.193978+0000","last_active":"2024-08-17T02:46:58.195519+0000","last_peered":"2024-08-17T02:46:58.195519+0000","last_clean":"2024-08-17T02:46:58.195519+0000","last_became_active":"2024-08-17T02:46:58.193769+0000","last_became_peered":"2024-08-17T02:46:58.193769+0000","last_unstale":"2024-08-17T02:46:58.195519+0000","last_undegraded":"2024-08-17T02:46:58.195519+0000","last_fullsized":"2024-08-17T02:46:58.195519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.176328+0000","last_change":"2024-08-17T02:46:57.184989+0000","last_active":"2024-08-17T02:46:58.176328+0000","last_peered":"2024-08-17T02:46:58.176328+0000","last_clean":"2024-08-17T02:46:58.176328+0000","last_became_active":"2024-08-17T02:46:57.184687+0000","last_became_peered":"2024-08-17T02:46:57.184687+0000","last_unstale":"2024-08-17T02:46:58.176328+0000","last_undegraded":"2024-08-17T02:46:58.176328+0000","last_fullsized":"2024-08-17T02:46:58.176328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195058+0000","last_change":"2024-08-17T02:46:58.190873+0000","last_active":"2024-08-17T02:46:58.195058+0000","last_peered":"2024-08-17T02:46:58.195058+0000","last_clean":"2024-08-17T02:46:58.195058+0000","last_became_active":"2024-08-17T02:46:58.190322+0000","last_became_peered":"2024-08-17T02:46:58.190322+0000","last_unstale":"2024-08-17T02:46:58.195058+0000","last_undegraded":"2024-08-17T02:46:58.195058+0000","last_fullsized":"2024-08-17T02:46:58.195058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:05.343969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.164482+0000","last_change":"2024-08-17T02:46:57.180474+0000","last_active":"2024-08-17T02:46:58.164482+0000","last_peered":"2024-08-17T02:46:58.164482+0000","last_clean":"2024-08-17T02:46:58.164482+0000","last_became_active":"2024-08-17T02:46:57.180126+0000","last_became_peered":"2024-08-17T02:46:57.180126+0000","last_unstale":"2024-08-17T02:46:58.164482+0000","last_undegraded":"2024-08-17T02:46:58.164482+0000","last_fullsized":"2024-08-17T02:46:58.164482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192352+0000","last_change":"2024-08-17T02:46:58.187354+0000","last_active":"2024-08-17T02:46:58.192352+0000","last_peered":"2024-08-17T02:46:58.192352+0000","last_clean":"2024-08-17T02:46:58.192352+0000","last_became_active":"2024-08-17T02:46:58.187061+0000","last_became_peered":"2024-08-17T02:46:58.187061+0000","last_unstale":"2024-08-17T02:46:58.192352+0000","last_undegraded":"2024-08-17T02:46:58.192352+0000","last_fullsized":"2024-08-17T02:46:58.192352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:33.640796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204507+0000","last_change":"2024-08-17T02:46:57.173178+0000","last_active":"2024-08-17T02:46:58.204507+0000","last_peered":"2024-08-17T02:46:58.204507+0000","last_clean":"2024-08-17T02:46:58.204507+0000","last_became_active":"2024-08-17T02:46:57.171399+0000","last_became_peered":"2024-08-17T02:46:57.171399+0000","last_unstale":"2024-08-17T02:46:58.204507+0000","last_undegraded":"2024-08-17T02:46:58.204507+0000","last_fullsized":"2024-08-17T02:46:58.204507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:00.900636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200463+0000","last_change":"2024-08-17T02:46:58.195024+0000","last_active":"2024-08-17T02:46:58.200463+0000","last_peered":"2024-08-17T02:46:58.200463+0000","last_clean":"2024-08-17T02:46:58.200463+0000","last_became_active":"2024-08-17T02:46:58.194058+0000","last_became_peered":"2024-08-17T02:46:58.194058+0000","last_unstale":"2024-08-17T02:46:58.200463+0000","last_undegraded":"2024-08-17T02:46:58.200463+0000","last_fullsized":"2024-08-17T02:46:58.200463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:36.032582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193533+0000","last_change":"2024-08-17T02:46:57.179217+0000","last_active":"2024-08-17T02:46:58.193533+0000","last_peered":"2024-08-17T02:46:58.193533+0000","last_clean":"2024-08-17T02:46:58.193533+0000","last_became_active":"2024-08-17T02:46:57.178894+0000","last_became_peered":"2024-08-17T02:46:57.178894+0000","last_unstale":"2024-08-17T02:46:58.193533+0000","last_undegraded":"2024-08-17T02:46:58.193533+0000","last_fullsized":"2024-08-17T02:46:58.193533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:29:23.466288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200370+0000","last_change":"2024-08-17T02:46:58.195478+0000","last_active":"2024-08-17T02:46:58.200370+0000","last_peered":"2024-08-17T02:46:58.200370+0000","last_clean":"2024-08-17T02:46:58.200370+0000","last_became_active":"2024-08-17T02:46:58.195223+0000","last_became_peered":"2024-08-17T02:46:58.195223+0000","last_unstale":"2024-08-17T02:46:58.200370+0000","last_undegraded":"2024-08-17T02:46:58.200370+0000","last_fullsized":"2024-08-17T02:46:58.200370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:20.281407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.197709+0000","last_change":"2024-08-17T02:46:57.188113+0000","last_active":"2024-08-17T02:46:58.197709+0000","last_peered":"2024-08-17T02:46:58.197709+0000","last_clean":"2024-08-17T02:46:58.197709+0000","last_became_active":"2024-08-17T02:46:57.187801+0000","last_became_peered":"2024-08-17T02:46:57.187801+0000","last_unstale":"2024-08-17T02:46:58.197709+0000","last_undegraded":"2024-08-17T02:46:58.197709+0000","last_fullsized":"2024-08-17T02:46:58.197709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:21.241911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204810+0000","last_change":"2024-08-17T02:46:58.198647+0000","last_active":"2024-08-17T02:46:58.204810+0000","last_peered":"2024-08-17T02:46:58.204810+0000","last_clean":"2024-08-17T02:46:58.204810+0000","last_became_active":"2024-08-17T02:46:58.198406+0000","last_became_peered":"2024-08-17T02:46:58.198406+0000","last_unstale":"2024-08-17T02:46:58.204810+0000","last_undegraded":"2024-08-17T02:46:58.204810+0000","last_fullsized":"2024-08-17T02:46:58.204810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:49.067728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196700+0000","last_change":"2024-08-17T02:46:57.177253+0000","last_active":"2024-08-17T02:46:58.196700+0000","last_peered":"2024-08-17T02:46:58.196700+0000","last_clean":"2024-08-17T02:46:58.196700+0000","last_became_active":"2024-08-17T02:46:57.176994+0000","last_became_peered":"2024-08-17T02:46:57.176994+0000","last_unstale":"2024-08-17T02:46:58.196700+0000","last_undegraded":"2024-08-17T02:46:58.196700+0000","last_fullsized":"2024-08-17T02:46:58.196700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:51.586751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.199394+0000","last_change":"2024-08-17T02:46:58.186086+0000","last_active":"2024-08-17T02:46:58.199394+0000","last_peered":"2024-08-17T02:46:58.199394+0000","last_clean":"2024-08-17T02:46:58.199394+0000","last_became_active":"2024-08-17T02:46:58.185889+0000","last_became_peered":"2024-08-17T02:46:58.185889+0000","last_unstale":"2024-08-17T02:46:58.199394+0000","last_undegraded":"2024-08-17T02:46:58.199394+0000","last_fullsized":"2024-08-17T02:46:58.199394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:31:49.067728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.175925+0000","last_change":"2024-08-17T02:46:57.181595+0000","last_active":"2024-08-17T02:46:58.175925+0000","last_peered":"2024-08-17T02:46:58.175925+0000","last_clean":"2024-08-17T02:46:58.175925+0000","last_became_active":"2024-08-17T02:46:57.181288+0000","last_became_peered":"2024-08-17T02:46:57.181288+0000","last_unstale":"2024-08-17T02:46:58.175925+0000","last_undegraded":"2024-08-17T02:46:58.175925+0000","last_fullsized":"2024-08-17T02:46:58.175925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:03.559127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.205392+0000","last_change":"2024-08-17T02:46:58.202092+0000","last_active":"2024-08-17T02:46:58.205392+0000","last_peered":"2024-08-17T02:46:58.205392+0000","last_clean":"2024-08-17T02:46:58.205392+0000","last_became_active":"2024-08-17T02:46:58.201265+0000","last_became_peered":"2024-08-17T02:46:58.201265+0000","last_unstale":"2024-08-17T02:46:58.205392+0000","last_undegraded":"2024-08-17T02:46:58.205392+0000","last_fullsized":"2024-08-17T02:46:58.205392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:57.772457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.170897+0000","last_change":"2024-08-17T02:46:48.424689+0000","last_active":"2024-08-17T02:46:58.170897+0000","last_peered":"2024-08-17T02:46:58.170897+0000","last_clean":"2024-08-17T02:46:58.170897+0000","last_became_active":"2024-08-17T02:46:48.423437+0000","last_became_peered":"2024-08-17T02:46:48.423437+0000","last_unstale":"2024-08-17T02:46:58.170897+0000","last_undegraded":"2024-08-17T02:46:58.170897+0000","last_fullsized":"2024-08-17T02:46:58.170897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.106569+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:50.533980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.168621+0000","last_change":"2024-08-17T02:46:57.171177+0000","last_active":"2024-08-17T02:46:58.168621+0000","last_peered":"2024-08-17T02:46:58.168621+0000","last_clean":"2024-08-17T02:46:58.168621+0000","last_became_active":"2024-08-17T02:46:57.170458+0000","last_became_peered":"2024-08-17T02:46:57.170458+0000","last_unstale":"2024-08-17T02:46:58.168621+0000","last_undegraded":"2024-08-17T02:46:58.168621+0000","last_fullsized":"2024-08-17T02:46:58.168621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196422+0000","last_change":"2024-08-17T02:46:58.195312+0000","last_active":"2024-08-17T02:46:58.196422+0000","last_peered":"2024-08-17T02:46:58.196422+0000","last_clean":"2024-08-17T02:46:58.196422+0000","last_became_active":"2024-08-17T02:46:58.195014+0000","last_became_peered":"2024-08-17T02:46:58.195014+0000","last_unstale":"2024-08-17T02:46:58.196422+0000","last_undegraded":"2024-08-17T02:46:58.196422+0000","last_fullsized":"2024-08-17T02:46:58.196422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:08.556818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.170788+0000","last_change":"2024-08-17T02:46:57.184842+0000","last_active":"2024-08-17T02:46:58.170788+0000","last_peered":"2024-08-17T02:46:58.170788+0000","last_clean":"2024-08-17T02:46:58.170788+0000","last_became_active":"2024-08-17T02:46:57.184291+0000","last_became_peered":"2024-08-17T02:46:57.184291+0000","last_unstale":"2024-08-17T02:46:58.170788+0000","last_undegraded":"2024-08-17T02:46:58.170788+0000","last_fullsized":"2024-08-17T02:46:58.170788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.183117+0000","last_change":"2024-08-17T02:46:58.180783+0000","last_active":"2024-08-17T02:46:58.183117+0000","last_peered":"2024-08-17T02:46:58.183117+0000","last_clean":"2024-08-17T02:46:58.183117+0000","last_became_active":"2024-08-17T02:46:58.174973+0000","last_became_peered":"2024-08-17T02:46:58.174973+0000","last_unstale":"2024-08-17T02:46:58.183117+0000","last_undegraded":"2024-08-17T02:46:58.183117+0000","last_fullsized":"2024-08-17T02:46:58.183117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.176827+0000","last_change":"2024-08-17T02:46:57.184122+0000","last_active":"2024-08-17T02:46:58.176827+0000","last_peered":"2024-08-17T02:46:58.176827+0000","last_clean":"2024-08-17T02:46:58.176827+0000","last_became_active":"2024-08-17T02:46:57.183807+0000","last_became_peered":"2024-08-17T02:46:57.183807+0000","last_unstale":"2024-08-17T02:46:58.176827+0000","last_undegraded":"2024-08-17T02:46:58.176827+0000","last_fullsized":"2024-08-17T02:46:58.176827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.203872+0000","last_change":"2024-08-17T02:46:58.202695+0000","last_active":"2024-08-17T02:46:58.203872+0000","last_peered":"2024-08-17T02:46:58.203872+0000","last_clean":"2024-08-17T02:46:58.203872+0000","last_became_active":"2024-08-17T02:46:58.201153+0000","last_became_peered":"2024-08-17T02:46:58.201153+0000","last_unstale":"2024-08-17T02:46:58.203872+0000","last_undegraded":"2024-08-17T02:46:58.203872+0000","last_fullsized":"2024-08-17T02:46:58.203872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:35:34.299927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.175573+0000","last_change":"2024-08-17T02:46:57.172754+0000","last_active":"2024-08-17T02:46:58.175573+0000","last_peered":"2024-08-17T02:46:58.175573+0000","last_clean":"2024-08-17T02:46:58.175573+0000","last_became_active":"2024-08-17T02:46:57.172534+0000","last_became_peered":"2024-08-17T02:46:57.172534+0000","last_unstale":"2024-08-17T02:46:58.175573+0000","last_undegraded":"2024-08-17T02:46:58.175573+0000","last_fullsized":"2024-08-17T02:46:58.175573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.192797+0000","last_change":"2024-08-17T02:46:58.184673+0000","last_active":"2024-08-17T02:46:58.192797+0000","last_peered":"2024-08-17T02:46:58.192797+0000","last_clean":"2024-08-17T02:46:58.192797+0000","last_became_active":"2024-08-17T02:46:58.184365+0000","last_became_peered":"2024-08-17T02:46:58.184365+0000","last_unstale":"2024-08-17T02:46:58.192797+0000","last_undegraded":"2024-08-17T02:46:58.192797+0000","last_fullsized":"2024-08-17T02:46:58.192797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:18.212612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.165816+0000","last_change":"2024-08-17T02:46:57.172721+0000","last_active":"2024-08-17T02:46:58.165816+0000","last_peered":"2024-08-17T02:46:58.165816+0000","last_clean":"2024-08-17T02:46:58.165816+0000","last_became_active":"2024-08-17T02:46:57.172414+0000","last_became_peered":"2024-08-17T02:46:57.172414+0000","last_unstale":"2024-08-17T02:46:58.165816+0000","last_undegraded":"2024-08-17T02:46:58.165816+0000","last_fullsized":"2024-08-17T02:46:58.165816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.204268+0000","last_change":"2024-08-17T02:46:58.199050+0000","last_active":"2024-08-17T02:46:58.204268+0000","last_peered":"2024-08-17T02:46:58.204268+0000","last_clean":"2024-08-17T02:46:58.204268+0000","last_became_active":"2024-08-17T02:46:58.198795+0000","last_became_peered":"2024-08-17T02:46:58.198795+0000","last_unstale":"2024-08-17T02:46:58.204268+0000","last_undegraded":"2024-08-17T02:46:58.204268+0000","last_fullsized":"2024-08-17T02:46:58.204268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.181818+0000","last_change":"2024-08-17T02:46:57.186077+0000","last_active":"2024-08-17T02:46:58.181818+0000","last_peered":"2024-08-17T02:46:58.181818+0000","last_clean":"2024-08-17T02:46:58.181818+0000","last_became_active":"2024-08-17T02:46:57.185671+0000","last_became_peered":"2024-08-17T02:46:57.185671+0000","last_unstale":"2024-08-17T02:46:58.181818+0000","last_undegraded":"2024-08-17T02:46:58.181818+0000","last_fullsized":"2024-08-17T02:46:58.181818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:37.118045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.201382+0000","last_change":"2024-08-17T02:46:58.199398+0000","last_active":"2024-08-17T02:46:58.201382+0000","last_peered":"2024-08-17T02:46:58.201382+0000","last_clean":"2024-08-17T02:46:58.201382+0000","last_became_active":"2024-08-17T02:46:58.199075+0000","last_became_peered":"2024-08-17T02:46:58.199075+0000","last_unstale":"2024-08-17T02:46:58.201382+0000","last_undegraded":"2024-08-17T02:46:58.201382+0000","last_fullsized":"2024-08-17T02:46:58.201382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:37.068207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:59.180451+0000","last_change":"2024-08-17T02:46:57.175247+0000","last_active":"2024-08-17T02:46:59.180451+0000","last_peered":"2024-08-17T02:46:59.180451+0000","last_clean":"2024-08-17T02:46:59.180451+0000","last_became_active":"2024-08-17T02:46:57.174995+0000","last_became_peered":"2024-08-17T02:46:57.174995+0000","last_unstale":"2024-08-17T02:46:59.180451+0000","last_undegraded":"2024-08-17T02:46:59.180451+0000","last_fullsized":"2024-08-17T02:46:59.180451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195582+0000","last_change":"2024-08-17T02:46:58.194264+0000","last_active":"2024-08-17T02:46:58.195582+0000","last_peered":"2024-08-17T02:46:58.195582+0000","last_clean":"2024-08-17T02:46:58.195582+0000","last_became_active":"2024-08-17T02:46:58.193989+0000","last_became_peered":"2024-08-17T02:46:58.193989+0000","last_unstale":"2024-08-17T02:46:58.195582+0000","last_undegraded":"2024-08-17T02:46:58.195582+0000","last_fullsized":"2024-08-17T02:46:58.195582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:15.650114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193128+0000","last_change":"2024-08-17T02:46:57.183203+0000","last_active":"2024-08-17T02:46:58.193128+0000","last_peered":"2024-08-17T02:46:58.193128+0000","last_clean":"2024-08-17T02:46:58.193128+0000","last_became_active":"2024-08-17T02:46:57.182911+0000","last_became_peered":"2024-08-17T02:46:57.182911+0000","last_unstale":"2024-08-17T02:46:58.193128+0000","last_undegraded":"2024-08-17T02:46:58.193128+0000","last_fullsized":"2024-08-17T02:46:58.193128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.180870+0000","last_change":"2024-08-17T02:46:58.176398+0000","last_active":"2024-08-17T02:46:58.180870+0000","last_peered":"2024-08-17T02:46:58.180870+0000","last_clean":"2024-08-17T02:46:58.180870+0000","last_became_active":"2024-08-17T02:46:58.175994+0000","last_became_peered":"2024-08-17T02:46:58.175994+0000","last_unstale":"2024-08-17T02:46:58.180870+0000","last_undegraded":"2024-08-17T02:46:58.180870+0000","last_fullsized":"2024-08-17T02:46:58.180870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:01:38.320238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.170599+0000","last_change":"2024-08-17T02:46:57.186114+0000","last_active":"2024-08-17T02:46:58.170599+0000","last_peered":"2024-08-17T02:46:58.170599+0000","last_clean":"2024-08-17T02:46:58.170599+0000","last_became_active":"2024-08-17T02:46:57.185841+0000","last_became_peered":"2024-08-17T02:46:57.185841+0000","last_unstale":"2024-08-17T02:46:58.170599+0000","last_undegraded":"2024-08-17T02:46:58.170599+0000","last_fullsized":"2024-08-17T02:46:58.170599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:12:17.202968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193621+0000","last_change":"2024-08-17T02:46:58.184905+0000","last_active":"2024-08-17T02:46:58.193621+0000","last_peered":"2024-08-17T02:46:58.193621+0000","last_clean":"2024-08-17T02:46:58.193621+0000","last_became_active":"2024-08-17T02:46:58.184603+0000","last_became_peered":"2024-08-17T02:46:58.184603+0000","last_unstale":"2024-08-17T02:46:58.193621+0000","last_undegraded":"2024-08-17T02:46:58.193621+0000","last_fullsized":"2024-08-17T02:46:58.193621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:38.127688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.163704+0000","last_change":"2024-08-17T02:46:57.172885+0000","last_active":"2024-08-17T02:46:58.163704+0000","last_peered":"2024-08-17T02:46:58.163704+0000","last_clean":"2024-08-17T02:46:58.163704+0000","last_became_active":"2024-08-17T02:46:57.172559+0000","last_became_peered":"2024-08-17T02:46:57.172559+0000","last_unstale":"2024-08-17T02:46:58.163704+0000","last_undegraded":"2024-08-17T02:46:58.163704+0000","last_fullsized":"2024-08-17T02:46:58.163704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:54.593150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.188438+0000","last_change":"2024-08-17T02:46:58.179610+0000","last_active":"2024-08-17T02:46:58.188438+0000","last_peered":"2024-08-17T02:46:58.188438+0000","last_clean":"2024-08-17T02:46:58.188438+0000","last_became_active":"2024-08-17T02:46:58.179261+0000","last_became_peered":"2024-08-17T02:46:58.179261+0000","last_unstale":"2024-08-17T02:46:58.188438+0000","last_undegraded":"2024-08-17T02:46:58.188438+0000","last_fullsized":"2024-08-17T02:46:58.188438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.164164+0000","last_change":"2024-08-17T02:46:57.180623+0000","last_active":"2024-08-17T02:46:58.164164+0000","last_peered":"2024-08-17T02:46:58.164164+0000","last_clean":"2024-08-17T02:46:58.164164+0000","last_became_active":"2024-08-17T02:46:57.180314+0000","last_became_peered":"2024-08-17T02:46:57.180314+0000","last_unstale":"2024-08-17T02:46:58.164164+0000","last_undegraded":"2024-08-17T02:46:58.164164+0000","last_fullsized":"2024-08-17T02:46:58.164164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:27.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191197+0000","last_change":"2024-08-17T02:46:58.185876+0000","last_active":"2024-08-17T02:46:58.191197+0000","last_peered":"2024-08-17T02:46:58.191197+0000","last_clean":"2024-08-17T02:46:58.191197+0000","last_became_active":"2024-08-17T02:46:58.184142+0000","last_became_peered":"2024-08-17T02:46:58.184142+0000","last_unstale":"2024-08-17T02:46:58.191197+0000","last_undegraded":"2024-08-17T02:46:58.191197+0000","last_fullsized":"2024-08-17T02:46:58.191197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:28.627999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.195140+0000","last_change":"2024-08-17T02:46:57.189083+0000","last_active":"2024-08-17T02:46:58.195140+0000","last_peered":"2024-08-17T02:46:58.195140+0000","last_clean":"2024-08-17T02:46:58.195140+0000","last_became_active":"2024-08-17T02:46:57.188780+0000","last_became_peered":"2024-08-17T02:46:57.188780+0000","last_unstale":"2024-08-17T02:46:58.195140+0000","last_undegraded":"2024-08-17T02:46:58.195140+0000","last_fullsized":"2024-08-17T02:46:58.195140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:51.586751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.193431+0000","last_change":"2024-08-17T02:46:58.189014+0000","last_active":"2024-08-17T02:46:58.193431+0000","last_peered":"2024-08-17T02:46:58.193431+0000","last_clean":"2024-08-17T02:46:58.193431+0000","last_became_active":"2024-08-17T02:46:58.187210+0000","last_became_peered":"2024-08-17T02:46:58.187210+0000","last_unstale":"2024-08-17T02:46:58.193431+0000","last_undegraded":"2024-08-17T02:46:58.193431+0000","last_fullsized":"2024-08-17T02:46:58.193431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:07.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.198105+0000","last_change":"2024-08-17T02:46:58.184782+0000","last_active":"2024-08-17T02:46:58.198105+0000","last_peered":"2024-08-17T02:46:58.198105+0000","last_clean":"2024-08-17T02:46:58.198105+0000","last_became_active":"2024-08-17T02:46:58.184533+0000","last_became_peered":"2024-08-17T02:46:58.184533+0000","last_unstale":"2024-08-17T02:46:58.198105+0000","last_undegraded":"2024-08-17T02:46:58.198105+0000","last_fullsized":"2024-08-17T02:46:58.198105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:02.858405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.202042+0000","last_change":"2024-08-17T02:46:57.189298+0000","last_active":"2024-08-17T02:46:58.202042+0000","last_peered":"2024-08-17T02:46:58.202042+0000","last_clean":"2024-08-17T02:46:58.202042+0000","last_became_active":"2024-08-17T02:46:57.188971+0000","last_became_peered":"2024-08-17T02:46:57.188971+0000","last_unstale":"2024-08-17T02:46:58.202042+0000","last_undegraded":"2024-08-17T02:46:58.202042+0000","last_fullsized":"2024-08-17T02:46:58.202042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:22.700908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.200097+0000","last_change":"2024-08-17T02:46:58.189815+0000","last_active":"2024-08-17T02:46:58.200097+0000","last_peered":"2024-08-17T02:46:58.200097+0000","last_clean":"2024-08-17T02:46:58.200097+0000","last_became_active":"2024-08-17T02:46:58.189556+0000","last_became_peered":"2024-08-17T02:46:58.189556+0000","last_unstale":"2024-08-17T02:46:58.200097+0000","last_undegraded":"2024-08-17T02:46:58.200097+0000","last_fullsized":"2024-08-17T02:46:58.200097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:14:08.556818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.194232+0000","last_change":"2024-08-17T02:46:57.188201+0000","last_active":"2024-08-17T02:46:58.194232+0000","last_peered":"2024-08-17T02:46:58.194232+0000","last_clean":"2024-08-17T02:46:58.194232+0000","last_became_active":"2024-08-17T02:46:57.187942+0000","last_became_peered":"2024-08-17T02:46:57.187942+0000","last_unstale":"2024-08-17T02:46:58.194232+0000","last_undegraded":"2024-08-17T02:46:58.194232+0000","last_fullsized":"2024-08-17T02:46:58.194232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:13:11.147202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191573+0000","last_change":"2024-08-17T02:46:58.185979+0000","last_active":"2024-08-17T02:46:58.191573+0000","last_peered":"2024-08-17T02:46:58.191573+0000","last_clean":"2024-08-17T02:46:58.191573+0000","last_became_active":"2024-08-17T02:46:58.185692+0000","last_became_peered":"2024-08-17T02:46:58.185692+0000","last_unstale":"2024-08-17T02:46:58.191573+0000","last_undegraded":"2024-08-17T02:46:58.191573+0000","last_fullsized":"2024-08-17T02:46:58.191573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:31.536609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.196531+0000","last_change":"2024-08-17T02:46:57.181312+0000","last_active":"2024-08-17T02:46:58.196531+0000","last_peered":"2024-08-17T02:46:58.196531+0000","last_clean":"2024-08-17T02:46:58.196531+0000","last_became_active":"2024-08-17T02:46:57.181041+0000","last_became_peered":"2024-08-17T02:46:57.181041+0000","last_unstale":"2024-08-17T02:46:58.196531+0000","last_undegraded":"2024-08-17T02:46:58.196531+0000","last_fullsized":"2024-08-17T02:46:58.196531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:21.241911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.191018+0000","last_change":"2024-08-17T02:46:58.187913+0000","last_active":"2024-08-17T02:46:58.191018+0000","last_peered":"2024-08-17T02:46:58.191018+0000","last_clean":"2024-08-17T02:46:58.191018+0000","last_became_active":"2024-08-17T02:46:58.187627+0000","last_became_peered":"2024-08-17T02:46:58.187627+0000","last_unstale":"2024-08-17T02:46:58.191018+0000","last_undegraded":"2024-08-17T02:46:58.191018+0000","last_fullsized":"2024-08-17T02:46:58.191018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:57.149489+0000","last_clean_scrub_stamp":"2024-08-17T02:46:57.149489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:13:11.578823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:46:58.194605+0000","last_change":"2024-08-17T02:46:57.183697+0000","last_active":"2024-08-17T02:46:58.194605+0000","last_peered":"2024-08-17T02:46:58.194605+0000","last_clean":"2024-08-17T02:46:58.194605+0000","last_became_active":"2024-08-17T02:46:57.183438+0000","last_became_peered":"2024-08-17T02:46:57.183438+0000","last_unstale":"2024-08-17T02:46:58.194605+0000","last_undegraded":"2024-08-17T02:46:58.194605+0000","last_fullsized":"2024-08-17T02:46:58.194605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:56.139845+0000","last_clean_scrub_stamp":"2024-08-17T02:46:56.139845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:01:09.175011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":802816,"data_stored":661592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301728,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070112,"statfs":{"total":96636764160,"available":96327794688,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301716,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070124,"statfs":{"total":96636764160,"available":96327806976,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1339999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301724,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070116,"statfs":{"total":96636764160,"available":96327798784,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302316,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069524,"statfs":{"total":96636764160,"available":96327192576,"internally_reserved":0,"allocated":811008,"data_stored":661648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:47:10.687 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:47:10.687 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:47:10.687 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:47:10.688 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:47:10.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.872+0000 7f7b4fc00640 1 Processor -- start 2024-08-17T02:47:10.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.872+0000 7f7b4fc00640 1 -- start start 2024-08-17T02:47:10.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.873+0000 7f7b4fc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7b481590b0 0x7f7b480b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.874+0000 7f7b4fc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b480acf10 0x7f7b48159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.874+0000 7f7b4fc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4815a4e0 con 0x7f7b480afca0 2024-08-17T02:47:10.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.874+0000 7f7b4fc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b480b0980 con 0x7f7b481590b0 2024-08-17T02:47:10.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.874+0000 7f7b4fc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480c92b0 con 0x7f7b480acf10 2024-08-17T02:47:10.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.874+0000 7f7b4dc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b480acf10 0x7f7b48159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.874+0000 7f7b4dc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b480acf10 0x7f7b48159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:59338/0 (socket says 172.21.15.5:59338) 2024-08-17T02:47:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.874+0000 7f7b4dc00640 1 -- 172.21.15.5:0/29930813 learned_addr learned my addr 172.21.15.5:0/29930813 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.874+0000 7f7b4d200640 1 --1- 172.21.15.5:0/29930813 >> v1:172.21.15.107:6789/0 conn(0x7f7b480afca0 0x7f7b481589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:60644/0 (socket says 172.21.15.5:60644) 2024-08-17T02:47:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.874+0000 7f7b47e00640 1 --2- 172.21.15.5:0/29930813 >> v2:172.21.15.107:3300/0 conn(0x7f7b481590b0 0x7f7b480b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.875+0000 7f7b47400640 1 -- 172.21.15.5:0/29930813 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102608062 0 0) 0x7f7b3c001110 con 0x7f7b480afca0 2024-08-17T02:47:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.875+0000 7f7b47400640 1 -- 172.21.15.5:0/29930813 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b300034e0 con 0x7f7b480afca0 2024-08-17T02:47:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.875+0000 7f7b47e00640 1 -- 172.21.15.5:0/29930813 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b480acf10 msgr2=0x7f7b48159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.875+0000 7f7b47e00640 1 --2- 172.21.15.5:0/29930813 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b480acf10 0x7f7b48159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.875+0000 7f7b47e00640 1 -- 172.21.15.5:0/29930813 >> v1:172.21.15.107:6789/0 conn(0x7f7b480afca0 legacy=0x7f7b481589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.875+0000 7f7b47e00640 1 -- 172.21.15.5:0/29930813 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b480ad480 con 0x7f7b481590b0 2024-08-17T02:47:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.875+0000 7f7b4dc00640 1 --2- 172.21.15.5:0/29930813 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b480acf10 0x7f7b48159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:10.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.876+0000 7f7b47e00640 1 --2- 172.21.15.5:0/29930813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b481590b0 0x7f7b480b0070 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009850 tx=0x7f7b340090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2963402bc0bfa5e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:10.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.876+0000 7f7b47400640 1 -- 172.21.15.5:0/29930813 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3402ad90 con 0x7f7b481590b0 2024-08-17T02:47:10.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.876+0000 7f7b47400640 1 -- 172.21.15.5:0/29930813 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b34032440 con 0x7f7b481590b0 2024-08-17T02:47:10.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.876+0000 7f7b47400640 1 -- 172.21.15.5:0/29930813 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34032820 con 0x7f7b481590b0 2024-08-17T02:47:10.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.877+0000 7f7b4fc00640 1 -- 172.21.15.5:0/29930813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b481590b0 msgr2=0x7f7b480b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.877+0000 7f7b4fc00640 1 --2- 172.21.15.5:0/29930813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b481590b0 0x7f7b480b0070 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009850 tx=0x7f7b340090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.877+0000 7f7b4fc00640 1 -- 172.21.15.5:0/29930813 shutdown_connections 2024-08-17T02:47:10.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.877+0000 7f7b4fc00640 1 --2- 172.21.15.5:0/29930813 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b480acf10 0x7f7b48159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.877+0000 7f7b4fc00640 1 --2- 172.21.15.5:0/29930813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b481590b0 0x7f7b480b0070 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.877+0000 7f7b4fc00640 1 -- 172.21.15.5:0/29930813 >> 172.21.15.5:0/29930813 conn(0x7f7b48066e60 msgr2=0x7f7b48067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:10.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.877+0000 7f7b4fc00640 1 -- 172.21.15.5:0/29930813 shutdown_connections 2024-08-17T02:47:10.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.877+0000 7f7b4fc00640 1 -- 172.21.15.5:0/29930813 wait complete. 2024-08-17T02:47:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.878+0000 7f7b4fc00640 1 Processor -- start 2024-08-17T02:47:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.878+0000 7f7b4fc00640 1 -- start start 2024-08-17T02:47:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.879+0000 7f7b4fc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b480acf10 0x7f7b480c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.879+0000 7f7b4fc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b480afca0 0x7f7b48151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.879+0000 7f7b4fc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b481590b0 0x7f7b480c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.879+0000 7f7b4fc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480c1d60 con 0x7f7b480afca0 2024-08-17T02:47:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.879+0000 7f7b4fc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480c1150 con 0x7f7b480acf10 2024-08-17T02:47:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.879+0000 7f7b4fc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480c1430 con 0x7f7b481590b0 2024-08-17T02:47:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.879+0000 7f7b47e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b480afca0 0x7f7b48151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.879+0000 7f7b47e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b480afca0 0x7f7b48151500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33588/0 (socket says 172.21.15.5:33588) 2024-08-17T02:47:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.879+0000 7f7b47e00640 1 -- 172.21.15.5:0/1669786870 learned_addr learned my addr 172.21.15.5:0/1669786870 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.879+0000 7f7b4d200640 1 --2- 172.21.15.5:0/1669786870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b480acf10 0x7f7b480c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.880+0000 7f7b4dc00640 1 --2- 172.21.15.5:0/1669786870 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b481590b0 0x7f7b480c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.880+0000 7f7b47e00640 1 -- 172.21.15.5:0/1669786870 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b481590b0 msgr2=0x7f7b480c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.880+0000 7f7b47e00640 1 --2- 172.21.15.5:0/1669786870 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b481590b0 0x7f7b480c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.880+0000 7f7b47e00640 1 -- 172.21.15.5:0/1669786870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b480acf10 msgr2=0x7f7b480c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.880+0000 7f7b47e00640 1 --2- 172.21.15.5:0/1669786870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b480acf10 0x7f7b480c07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.880+0000 7f7b47e00640 1 -- 172.21.15.5:0/1669786870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b40009ae0 con 0x7f7b480afca0 2024-08-17T02:47:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.880+0000 7f7b4d200640 1 --2- 172.21.15.5:0/1669786870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b480acf10 0x7f7b480c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.880+0000 7f7b47e00640 1 --2- 172.21.15.5:0/1669786870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b480afca0 0x7f7b48151500 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7b34035040 tx=0x7f7b34032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.880+0000 7f7b3be00640 1 -- 172.21.15.5:0/1669786870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34031ca0 con 0x7f7b480afca0 2024-08-17T02:47:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.880+0000 7f7b3be00640 1 -- 172.21.15.5:0/1669786870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b34031e00 con 0x7f7b480afca0 2024-08-17T02:47:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.880+0000 7f7b3be00640 1 -- 172.21.15.5:0/1669786870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3403e6a0 con 0x7f7b480afca0 2024-08-17T02:47:10.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.881+0000 7f7b4fc00640 1 -- 172.21.15.5:0/1669786870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b34009390 con 0x7f7b480afca0 2024-08-17T02:47:10.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.881+0000 7f7b4fc00640 1 -- 172.21.15.5:0/1669786870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b480c19f0 con 0x7f7b480afca0 2024-08-17T02:47:10.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.882+0000 7f7b4fc00640 1 -- 172.21.15.5:0/1669786870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b48063fb0 con 0x7f7b480afca0 2024-08-17T02:47:10.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.882+0000 7f7b3be00640 1 -- 172.21.15.5:0/1669786870 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7b3403c400 con 0x7f7b480afca0 2024-08-17T02:47:10.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.883+0000 7f7b3be00640 1 --2- 172.21.15.5:0/1669786870 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7b28065150 0x7f7b28067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.883+0000 7f7b3be00640 1 -- 172.21.15.5:0/1669786870 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b340a28f0 con 0x7f7b480afca0 2024-08-17T02:47:10.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.883+0000 7f7b4d200640 1 --2- 172.21.15.5:0/1669786870 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7b28065150 0x7f7b28067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.884+0000 7f7b4d200640 1 --2- 172.21.15.5:0/1669786870 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7b28065150 0x7f7b28067600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c007fd0 tx=0x7f7b3c007b20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:10.887+0000 7f7b3be00640 1 -- 172.21.15.5:0/1669786870 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7b340709c0 con 0x7f7b480afca0 2024-08-17T02:47:11.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.105+0000 7f7b4fc00640 1 -- 172.21.15.5:0/1669786870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7b48067b70 con 0x7f7b480afca0 2024-08-17T02:47:11.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.105+0000 7f7b3be00640 1 -- 172.21.15.5:0/1669786870 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7b34043080 con 0x7f7b480afca0 2024-08-17T02:47:11.106 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:11.106 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:47:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.108+0000 7f7b4fc00640 1 -- 172.21.15.5:0/1669786870 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7b28065150 msgr2=0x7f7b28067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.108+0000 7f7b4fc00640 1 --2- 172.21.15.5:0/1669786870 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7b28065150 0x7f7b28067600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c007fd0 tx=0x7f7b3c007b20 comp rx=0 tx=0).stop 2024-08-17T02:47:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.108+0000 7f7b4fc00640 1 -- 172.21.15.5:0/1669786870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b480afca0 msgr2=0x7f7b48151500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.108+0000 7f7b4fc00640 1 --2- 172.21.15.5:0/1669786870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b480afca0 0x7f7b48151500 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7b34035040 tx=0x7f7b34032000 comp rx=0 tx=0).stop 2024-08-17T02:47:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.108+0000 7f7b4fc00640 1 -- 172.21.15.5:0/1669786870 shutdown_connections 2024-08-17T02:47:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.108+0000 7f7b4fc00640 1 --2- 172.21.15.5:0/1669786870 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7b28065150 0x7f7b28067600 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.108+0000 7f7b4fc00640 1 --2- 172.21.15.5:0/1669786870 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7b481590b0 0x7f7b480c21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.108+0000 7f7b4fc00640 1 --2- 172.21.15.5:0/1669786870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b480afca0 0x7f7b48151500 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.108+0000 7f7b4fc00640 1 --2- 172.21.15.5:0/1669786870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b480acf10 0x7f7b480c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.108+0000 7f7b4fc00640 1 -- 172.21.15.5:0/1669786870 >> 172.21.15.5:0/1669786870 conn(0x7f7b48066e60 msgr2=0x7f7b481597a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.108+0000 7f7b4fc00640 1 -- 172.21.15.5:0/1669786870 shutdown_connections 2024-08-17T02:47:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.108+0000 7f7b4fc00640 1 -- 172.21.15.5:0/1669786870 wait complete. 2024-08-17T02:47:11.124 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:47:11.124 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:11.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.277+0000 7f98a9400640 1 Processor -- start 2024-08-17T02:47:11.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.277+0000 7f98a9400640 1 -- start start 2024-08-17T02:47:11.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.278+0000 7f98a9400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98a41589e0 0x7f98a4158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.278+0000 7f98a9400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98a40ca9c0 0x7f98a40cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.278+0000 7f98a9400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a40af9a0 con 0x7f98a40cda30 2024-08-17T02:47:11.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.278+0000 7f98a9400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a40af810 con 0x7f98a41589e0 2024-08-17T02:47:11.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.278+0000 7f98a9400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a40cb310 con 0x7f98a40ca9c0 2024-08-17T02:47:11.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.278+0000 7f98a2800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98a41589e0 0x7f98a4158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.278+0000 7f98a2800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f98a41589e0 0x7f98a4158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33602/0 (socket says 172.21.15.5:33602) 2024-08-17T02:47:11.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.278+0000 7f98a2800640 1 -- 172.21.15.5:0/931353743 learned_addr learned my addr 172.21.15.5:0/931353743 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:11.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.278+0000 7f989be00640 1 --2- 172.21.15.5:0/931353743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98a40ca9c0 0x7f98a40cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.279+0000 7f98a2800640 1 -- 172.21.15.5:0/931353743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98a40ca9c0 msgr2=0x7f98a40cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.279+0000 7f98a2800640 1 --2- 172.21.15.5:0/931353743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98a40ca9c0 0x7f98a40cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.279+0000 7f98a2800640 1 -- 172.21.15.5:0/931353743 >> v1:172.21.15.107:6789/0 conn(0x7f98a40cda30 legacy=0x7f98a40cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.279+0000 7f98a2800640 1 -- 172.21.15.5:0/931353743 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a40ce740 con 0x7f98a41589e0 2024-08-17T02:47:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.280+0000 7f98a2800640 1 --2- 172.21.15.5:0/931353743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98a41589e0 0x7f98a4158db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9894009910 tx=0x7f98940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4c435c4a84e06d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.280+0000 7f98a1e00640 1 -- 172.21.15.5:0/931353743 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989402ae40 con 0x7f98a41589e0 2024-08-17T02:47:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.280+0000 7f98a1e00640 1 -- 172.21.15.5:0/931353743 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9894032440 con 0x7f98a41589e0 2024-08-17T02:47:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.280+0000 7f98a1e00640 1 -- 172.21.15.5:0/931353743 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894032820 con 0x7f98a41589e0 2024-08-17T02:47:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.280+0000 7f98a9400640 1 -- 172.21.15.5:0/931353743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98a41589e0 msgr2=0x7f98a4158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.280+0000 7f98a9400640 1 --2- 172.21.15.5:0/931353743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98a41589e0 0x7f98a4158db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9894009910 tx=0x7f98940091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.281+0000 7f98a9400640 1 -- 172.21.15.5:0/931353743 shutdown_connections 2024-08-17T02:47:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.281+0000 7f98a9400640 1 --2- 172.21.15.5:0/931353743 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98a40ca9c0 0x7f98a40cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.281+0000 7f98a9400640 1 --2- 172.21.15.5:0/931353743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98a41589e0 0x7f98a4158db0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.281+0000 7f98a9400640 1 -- 172.21.15.5:0/931353743 >> 172.21.15.5:0/931353743 conn(0x7f98a406e590 msgr2=0x7f98a406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.281+0000 7f98a9400640 1 -- 172.21.15.5:0/931353743 shutdown_connections 2024-08-17T02:47:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.281+0000 7f98a9400640 1 -- 172.21.15.5:0/931353743 wait complete. 2024-08-17T02:47:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.282+0000 7f98a9400640 1 Processor -- start 2024-08-17T02:47:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.282+0000 7f98a9400640 1 -- start start 2024-08-17T02:47:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.283+0000 7f98a9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98a40ca9c0 0x7f98a40c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.283+0000 7f98a9400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98a40cda30 0x7f98a40c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.283+0000 7f98a9400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98a41589e0 0x7f98a40c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.283+0000 7f98a9400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a41540e0 con 0x7f98a40ca9c0 2024-08-17T02:47:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.283+0000 7f98a9400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a41534d0 con 0x7f98a41589e0 2024-08-17T02:47:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.283+0000 7f98a9400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a41537b0 con 0x7f98a40cda30 2024-08-17T02:47:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.283+0000 7f98a2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98a40ca9c0 0x7f98a40c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.283+0000 7f98a2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98a40ca9c0 0x7f98a40c6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33606/0 (socket says 172.21.15.5:33606) 2024-08-17T02:47:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.283+0000 7f98a2800640 1 -- 172.21.15.5:0/1075914981 learned_addr learned my addr 172.21.15.5:0/1075914981 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.284+0000 7f989be00640 1 --2- 172.21.15.5:0/1075914981 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98a40cda30 0x7f98a40c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.284+0000 7f98a3200640 1 --2- 172.21.15.5:0/1075914981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98a41589e0 0x7f98a40c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.284+0000 7f98a2800640 1 -- 172.21.15.5:0/1075914981 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98a40cda30 msgr2=0x7f98a40c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.284+0000 7f98a2800640 1 --2- 172.21.15.5:0/1075914981 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98a40cda30 0x7f98a40c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.284+0000 7f98a2800640 1 -- 172.21.15.5:0/1075914981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98a41589e0 msgr2=0x7f98a40c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.284+0000 7f98a2800640 1 --2- 172.21.15.5:0/1075914981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98a41589e0 0x7f98a40c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.284+0000 7f98a2800640 1 -- 172.21.15.5:0/1075914981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9894009450 con 0x7f98a40ca9c0 2024-08-17T02:47:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.284+0000 7f98a2800640 1 --2- 172.21.15.5:0/1075914981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98a40ca9c0 0x7f98a40c6dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9894035040 tx=0x7f9894032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.284+0000 7f989a000640 1 -- 172.21.15.5:0/1075914981 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894031c80 con 0x7f98a40ca9c0 2024-08-17T02:47:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.284+0000 7f989a000640 1 -- 172.21.15.5:0/1075914981 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9894031e00 con 0x7f98a40ca9c0 2024-08-17T02:47:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.284+0000 7f989a000640 1 -- 172.21.15.5:0/1075914981 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989403d670 con 0x7f98a40ca9c0 2024-08-17T02:47:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.284+0000 7f98a9400640 1 -- 172.21.15.5:0/1075914981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a4153a90 con 0x7f98a40ca9c0 2024-08-17T02:47:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.285+0000 7f98a9400640 1 -- 172.21.15.5:0/1075914981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a41531a0 con 0x7f98a40ca9c0 2024-08-17T02:47:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.286+0000 7f98a9400640 1 -- 172.21.15.5:0/1075914981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a4063fb0 con 0x7f98a40ca9c0 2024-08-17T02:47:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.286+0000 7f989a000640 1 -- 172.21.15.5:0/1075914981 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9894039040 con 0x7f98a40ca9c0 2024-08-17T02:47:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.287+0000 7f989a000640 1 --2- 172.21.15.5:0/1075914981 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9880065150 0x7f9880067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.287+0000 7f989a000640 1 -- 172.21.15.5:0/1075914981 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f989402ae40 con 0x7f98a40ca9c0 2024-08-17T02:47:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.287+0000 7f989be00640 1 --2- 172.21.15.5:0/1075914981 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9880065150 0x7f9880067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.288+0000 7f989be00640 1 --2- 172.21.15.5:0/1075914981 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9880065150 0x7f9880067600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f98a40b0270 tx=0x7f988c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.291+0000 7f989a000640 1 -- 172.21.15.5:0/1075914981 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f98940704c0 con 0x7f98a40ca9c0 2024-08-17T02:47:11.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.475+0000 7f98a9400640 1 -- 172.21.15.5:0/1075914981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98a4067620 con 0x7f98a40ca9c0 2024-08-17T02:47:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.476+0000 7f989a000640 1 -- 172.21.15.5:0/1075914981 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f9894073ae0 con 0x7f98a40ca9c0 2024-08-17T02:47:11.476 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:11.476 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:59.170637+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:55.543347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:56.571235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.478+0000 7f98a9400640 1 -- 172.21.15.5:0/1075914981 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9880065150 msgr2=0x7f9880067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.478+0000 7f98a9400640 1 --2- 172.21.15.5:0/1075914981 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9880065150 0x7f9880067600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f98a40b0270 tx=0x7f988c008040 comp rx=0 tx=0).stop 2024-08-17T02:47:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.478+0000 7f98a9400640 1 -- 172.21.15.5:0/1075914981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98a40ca9c0 msgr2=0x7f98a40c6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.478+0000 7f98a9400640 1 --2- 172.21.15.5:0/1075914981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98a40ca9c0 0x7f98a40c6dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9894035040 tx=0x7f9894032000 comp rx=0 tx=0).stop 2024-08-17T02:47:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.478+0000 7f98a9400640 1 -- 172.21.15.5:0/1075914981 shutdown_connections 2024-08-17T02:47:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.478+0000 7f98a9400640 1 --2- 172.21.15.5:0/1075914981 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9880065150 0x7f9880067600 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.478+0000 7f98a9400640 1 --2- 172.21.15.5:0/1075914981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98a41589e0 0x7f98a40c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.478+0000 7f98a9400640 1 --2- 172.21.15.5:0/1075914981 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f98a40cda30 0x7f98a40c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.478+0000 7f98a9400640 1 --2- 172.21.15.5:0/1075914981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98a40ca9c0 0x7f98a40c6dc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.478+0000 7f98a9400640 1 -- 172.21.15.5:0/1075914981 >> 172.21.15.5:0/1075914981 conn(0x7f98a406e590 msgr2=0x7f98a4155d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.478+0000 7f98a9400640 1 -- 172.21.15.5:0/1075914981 shutdown_connections 2024-08-17T02:47:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.478+0000 7f98a9400640 1 -- 172.21.15.5:0/1075914981 wait complete. 2024-08-17T02:47:11.493 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:47.106425+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:55.543347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:56.571235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:47:11.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:11.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.646+0000 7fd381600640 1 Processor -- start 2024-08-17T02:47:11.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.647+0000 7fd381600640 1 -- start start 2024-08-17T02:47:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.648+0000 7fd381600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd37c09a7f0 0x7fd37c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.648+0000 7fd381600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37c0abe60 con 0x7fd37c158ab0 2024-08-17T02:47:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.648+0000 7fd381600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37c0ab530 con 0x7fd37c158e80 2024-08-17T02:47:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.648+0000 7fd381600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37c0ab810 con 0x7fd37c09a7f0 2024-08-17T02:47:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.648+0000 7fd37be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd37c158ab0 0x7fd37c09a0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42176/0 (socket says 172.21.15.5:42176) 2024-08-17T02:47:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.648+0000 7fd37be00640 1 -- 172.21.15.5:0/2144651899 learned_addr learned my addr 172.21.15.5:0/2144651899 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.648+0000 7fd380c00640 1 --2- 172.21.15.5:0/2144651899 >> v2:172.21.15.107:3300/0 conn(0x7fd37c09a7f0 0x7fd37c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.648+0000 7fd37b400640 1 -- 172.21.15.5:0/2144651899 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005772487 0 0) 0x7fd37c0abe60 con 0x7fd37c158ab0 2024-08-17T02:47:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.648+0000 7fd37b400640 1 -- 172.21.15.5:0/2144651899 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3600034e0 con 0x7fd37c158ab0 2024-08-17T02:47:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.649+0000 7fd380c00640 1 -- 172.21.15.5:0/2144651899 >> v1:172.21.15.107:6789/0 conn(0x7fd37c158e80 legacy=0x7fd37c068cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.649+0000 7fd380c00640 1 -- 172.21.15.5:0/2144651899 >> v1:172.21.15.5:6789/0 conn(0x7fd37c158ab0 legacy=0x7fd37c09a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.649+0000 7fd380c00640 1 -- 172.21.15.5:0/2144651899 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c0abaf0 con 0x7fd37c09a7f0 2024-08-17T02:47:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.650+0000 7fd380c00640 1 --2- 172.21.15.5:0/2144651899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd37c09a7f0 0x7fd37c0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd374009e60 tx=0x7fd374009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=615baa760cbb5438 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.650+0000 7fd37b400640 1 -- 172.21.15.5:0/2144651899 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd374007550 con 0x7fd37c09a7f0 2024-08-17T02:47:11.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.650+0000 7fd37b400640 1 -- 172.21.15.5:0/2144651899 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37402d050 con 0x7fd37c09a7f0 2024-08-17T02:47:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.650+0000 7fd37b400640 1 -- 172.21.15.5:0/2144651899 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3740078e0 con 0x7fd37c09a7f0 2024-08-17T02:47:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.651+0000 7fd381600640 1 -- 172.21.15.5:0/2144651899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd37c09a7f0 msgr2=0x7fd37c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.651+0000 7fd381600640 1 --2- 172.21.15.5:0/2144651899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd37c09a7f0 0x7fd37c0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd374009e60 tx=0x7fd374009780 comp rx=0 tx=0).stop 2024-08-17T02:47:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.651+0000 7fd381600640 1 -- 172.21.15.5:0/2144651899 shutdown_connections 2024-08-17T02:47:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.651+0000 7fd381600640 1 --2- 172.21.15.5:0/2144651899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd37c09a7f0 0x7fd37c0693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.651+0000 7fd381600640 1 -- 172.21.15.5:0/2144651899 >> 172.21.15.5:0/2144651899 conn(0x7fd37c066e60 msgr2=0x7fd37c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.651+0000 7fd381600640 1 -- 172.21.15.5:0/2144651899 shutdown_connections 2024-08-17T02:47:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.651+0000 7fd381600640 1 -- 172.21.15.5:0/2144651899 wait complete. 2024-08-17T02:47:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.652+0000 7fd381600640 1 Processor -- start 2024-08-17T02:47:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.652+0000 7fd381600640 1 -- start start 2024-08-17T02:47:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.653+0000 7fd381600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd37c09a7f0 0x7fd37c159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.653+0000 7fd381600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd37c158ab0 0x7fd37c15b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.653+0000 7fd381600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd37c158e80 0x7fd37c154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.653+0000 7fd381600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c16a360 con 0x7fd37c158e80 2024-08-17T02:47:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.653+0000 7fd381600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c15ba70 con 0x7fd37c158ab0 2024-08-17T02:47:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.653+0000 7fd381600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c15a340 con 0x7fd37c09a7f0 2024-08-17T02:47:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.653+0000 7fd380c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd37c158e80 0x7fd37c154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.654+0000 7fd380c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd37c158e80 0x7fd37c154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33620/0 (socket says 172.21.15.5:33620) 2024-08-17T02:47:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.654+0000 7fd380c00640 1 -- 172.21.15.5:0/4022814320 learned_addr learned my addr 172.21.15.5:0/4022814320 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.654+0000 7fd37be00640 1 --2- 172.21.15.5:0/4022814320 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd37c09a7f0 0x7fd37c159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.654+0000 7fd373e00640 1 --2- 172.21.15.5:0/4022814320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd37c158ab0 0x7fd37c15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.654+0000 7fd380c00640 1 -- 172.21.15.5:0/4022814320 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd37c09a7f0 msgr2=0x7fd37c159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.654+0000 7fd380c00640 1 --2- 172.21.15.5:0/4022814320 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd37c09a7f0 0x7fd37c159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.654+0000 7fd380c00640 1 -- 172.21.15.5:0/4022814320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd37c158ab0 msgr2=0x7fd37c15b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.654+0000 7fd380c00640 1 --2- 172.21.15.5:0/4022814320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd37c158ab0 0x7fd37c15b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.654+0000 7fd380c00640 1 -- 172.21.15.5:0/4022814320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd374009a20 con 0x7fd37c158e80 2024-08-17T02:47:11.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.654+0000 7fd37be00640 1 --2- 172.21.15.5:0/4022814320 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd37c09a7f0 0x7fd37c159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.654+0000 7fd373e00640 1 --2- 172.21.15.5:0/4022814320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd37c158ab0 0x7fd37c15b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.654+0000 7fd380c00640 1 --2- 172.21.15.5:0/4022814320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd37c158e80 0x7fd37c154580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd3740099f0 tx=0x7fd374037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.654+0000 7fd373400640 1 -- 172.21.15.5:0/4022814320 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd374031890 con 0x7fd37c158e80 2024-08-17T02:47:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.655+0000 7fd373400640 1 -- 172.21.15.5:0/4022814320 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd374040070 con 0x7fd37c158e80 2024-08-17T02:47:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.655+0000 7fd373400640 1 -- 172.21.15.5:0/4022814320 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd374031c40 con 0x7fd37c158e80 2024-08-17T02:47:11.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.655+0000 7fd381600640 1 -- 172.21.15.5:0/4022814320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c15a620 con 0x7fd37c158e80 2024-08-17T02:47:11.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.655+0000 7fd381600640 1 -- 172.21.15.5:0/4022814320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c15abe0 con 0x7fd37c158e80 2024-08-17T02:47:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.656+0000 7fd381600640 1 -- 172.21.15.5:0/4022814320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c16a4d0 con 0x7fd37c158e80 2024-08-17T02:47:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.656+0000 7fd373400640 1 -- 172.21.15.5:0/4022814320 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd374042030 con 0x7fd37c158e80 2024-08-17T02:47:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.657+0000 7fd373400640 1 --2- 172.21.15.5:0/4022814320 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd358065180 0x7fd358067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.657+0000 7fd373400640 1 -- 172.21.15.5:0/4022814320 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3740a3dc0 con 0x7fd37c158e80 2024-08-17T02:47:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.658+0000 7fd37be00640 1 --2- 172.21.15.5:0/4022814320 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd358065180 0x7fd358067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.658+0000 7fd37be00640 1 --2- 172.21.15.5:0/4022814320 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd358065180 0x7fd358067630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd36c005840 tx=0x7fd36c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.661+0000 7fd373400640 1 -- 172.21.15.5:0/4022814320 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd37c16a4d0 con 0x7fd37c158e80 2024-08-17T02:47:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.842+0000 7fd381600640 1 -- 172.21.15.5:0/4022814320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd37c16a4a0 con 0x7fd37c158e80 2024-08-17T02:47:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.842+0000 7fd373400640 1 -- 172.21.15.5:0/4022814320 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd374071de0 con 0x7fd37c158e80 2024-08-17T02:47:11.843 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:47:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.844+0000 7fd381600640 1 -- 172.21.15.5:0/4022814320 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd358065180 msgr2=0x7fd358067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.844+0000 7fd381600640 1 --2- 172.21.15.5:0/4022814320 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd358065180 0x7fd358067630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd36c005840 tx=0x7fd36c009040 comp rx=0 tx=0).stop 2024-08-17T02:47:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.844+0000 7fd381600640 1 -- 172.21.15.5:0/4022814320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd37c158e80 msgr2=0x7fd37c154580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.844+0000 7fd381600640 1 --2- 172.21.15.5:0/4022814320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd37c158e80 0x7fd37c154580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd3740099f0 tx=0x7fd374037000 comp rx=0 tx=0).stop 2024-08-17T02:47:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.844+0000 7fd381600640 1 -- 172.21.15.5:0/4022814320 shutdown_connections 2024-08-17T02:47:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.844+0000 7fd381600640 1 --2- 172.21.15.5:0/4022814320 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd358065180 0x7fd358067630 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.844+0000 7fd381600640 1 --2- 172.21.15.5:0/4022814320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd37c158e80 0x7fd37c154580 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.844+0000 7fd381600640 1 --2- 172.21.15.5:0/4022814320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd37c158ab0 0x7fd37c15b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.844+0000 7fd381600640 1 --2- 172.21.15.5:0/4022814320 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd37c09a7f0 0x7fd37c159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.844+0000 7fd381600640 1 -- 172.21.15.5:0/4022814320 >> 172.21.15.5:0/4022814320 conn(0x7fd37c066e60 msgr2=0x7fd37c0b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:11.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.844+0000 7fd381600640 1 -- 172.21.15.5:0/4022814320 shutdown_connections 2024-08-17T02:47:11.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:11.845+0000 7fd381600640 1 -- 172.21.15.5:0/4022814320 wait complete. 2024-08-17T02:47:11.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:47:12.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.012+0000 7fbc3be00640 1 Processor -- start 2024-08-17T02:47:12.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.012+0000 7fbc3be00640 1 -- start start 2024-08-17T02:47:12.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.014+0000 7fbc3be00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbc3c0acfa0 0x7fbc3c0a9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.014+0000 7fbc3be00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c0abb00 con 0x7fbc3c158b50 2024-08-17T02:47:12.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.014+0000 7fbc3be00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c0ae180 con 0x7fbc3c06dcf0 2024-08-17T02:47:12.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.014+0000 7fbc3be00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c0ab4b0 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.014+0000 7fbc3aa00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbc3c158b50 0x7fbc3c06d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42186/0 (socket says 172.21.15.5:42186) 2024-08-17T02:47:12.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.014+0000 7fbc3aa00640 1 -- 172.21.15.5:0/2926756115 learned_addr learned my addr 172.21.15.5:0/2926756115 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:12.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.014+0000 7fbc3b400640 1 --2- 172.21.15.5:0/2926756115 >> v2:172.21.15.107:3300/0 conn(0x7fbc3c0acfa0 0x7fbc3c0a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.014+0000 7fbc3a000640 1 -- 172.21.15.5:0/2926756115 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970377381 0 0) 0x7fbc3c0abb00 con 0x7fbc3c158b50 2024-08-17T02:47:12.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.014+0000 7fbc3a000640 1 -- 172.21.15.5:0/2926756115 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc200034e0 con 0x7fbc3c158b50 2024-08-17T02:47:12.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.015+0000 7fbc3a000640 1 -- 172.21.15.5:0/2926756115 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482971357 0 0) 0x7fbc3c0ae180 con 0x7fbc3c06dcf0 2024-08-17T02:47:12.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.015+0000 7fbc3a000640 1 -- 172.21.15.5:0/2926756115 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc3c0abb00 con 0x7fbc3c06dcf0 2024-08-17T02:47:12.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.015+0000 7fbc3b400640 1 -- 172.21.15.5:0/2926756115 >> v1:172.21.15.107:6789/0 conn(0x7fbc3c06dcf0 legacy=0x7fbc3c1609e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.015+0000 7fbc3b400640 1 -- 172.21.15.5:0/2926756115 >> v1:172.21.15.5:6789/0 conn(0x7fbc3c158b50 legacy=0x7fbc3c06d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.015+0000 7fbc3a000640 1 -- 172.21.15.5:0/2926756115 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1832965282 0 0) 0x7fbc200034e0 con 0x7fbc3c158b50 2024-08-17T02:47:12.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.015+0000 7fbc3b400640 1 -- 172.21.15.5:0/2926756115 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c0ab790 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.016+0000 7fbc3b400640 1 --2- 172.21.15.5:0/2926756115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc3c0acfa0 0x7fbc3c0a9770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009e60 tx=0x7fbc34009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73ea8945860bfdbc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:12.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.016+0000 7fbc3a000640 1 -- 172.21.15.5:0/2926756115 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c001470 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.016+0000 7fbc3a000640 1 -- 172.21.15.5:0/2926756115 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3402d050 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.016+0000 7fbc3a000640 1 -- 172.21.15.5:0/2926756115 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34031630 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.016+0000 7fbc3be00640 1 -- 172.21.15.5:0/2926756115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc3c0acfa0 msgr2=0x7fbc3c0a9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.016+0000 7fbc3be00640 1 --2- 172.21.15.5:0/2926756115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc3c0acfa0 0x7fbc3c0a9770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009e60 tx=0x7fbc34009780 comp rx=0 tx=0).stop 2024-08-17T02:47:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.017+0000 7fbc3be00640 1 -- 172.21.15.5:0/2926756115 shutdown_connections 2024-08-17T02:47:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.017+0000 7fbc3be00640 1 --2- 172.21.15.5:0/2926756115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc3c0acfa0 0x7fbc3c0a9770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.017+0000 7fbc3be00640 1 -- 172.21.15.5:0/2926756115 >> 172.21.15.5:0/2926756115 conn(0x7fbc3c067930 msgr2=0x7fbc3c0cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.017+0000 7fbc3be00640 1 -- 172.21.15.5:0/2926756115 shutdown_connections 2024-08-17T02:47:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.017+0000 7fbc3be00640 1 -- 172.21.15.5:0/2926756115 wait complete. 2024-08-17T02:47:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.018+0000 7fbc3be00640 1 Processor -- start 2024-08-17T02:47:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.018+0000 7fbc3be00640 1 -- start start 2024-08-17T02:47:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.019+0000 7fbc3be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc3c06dcf0 0x7fbc3c1531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.019+0000 7fbc3be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc3c0acfa0 0x7fbc3c15d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.019+0000 7fbc3be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc3c158b50 0x7fbc3c15d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.019+0000 7fbc3be00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c156310 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.019+0000 7fbc3be00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c15de60 con 0x7fbc3c06dcf0 2024-08-17T02:47:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.019+0000 7fbc3be00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c15e140 con 0x7fbc3c158b50 2024-08-17T02:47:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.019+0000 7fbc33e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc3c0acfa0 0x7fbc3c15d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.019+0000 7fbc33e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc3c0acfa0 0x7fbc3c15d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33632/0 (socket says 172.21.15.5:33632) 2024-08-17T02:47:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.019+0000 7fbc33e00640 1 -- 172.21.15.5:0/1990242507 learned_addr learned my addr 172.21.15.5:0/1990242507 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.019+0000 7fbc3aa00640 1 --2- 172.21.15.5:0/1990242507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc3c06dcf0 0x7fbc3c1531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.019+0000 7fbc3b400640 1 --2- 172.21.15.5:0/1990242507 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc3c158b50 0x7fbc3c15d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.020+0000 7fbc33e00640 1 -- 172.21.15.5:0/1990242507 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc3c158b50 msgr2=0x7fbc3c15d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.020+0000 7fbc33e00640 1 --2- 172.21.15.5:0/1990242507 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc3c158b50 0x7fbc3c15d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.020+0000 7fbc33e00640 1 -- 172.21.15.5:0/1990242507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc3c06dcf0 msgr2=0x7fbc3c1531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.020+0000 7fbc33e00640 1 --2- 172.21.15.5:0/1990242507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc3c06dcf0 0x7fbc3c1531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.020+0000 7fbc33e00640 1 -- 172.21.15.5:0/1990242507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc34009a20 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.020+0000 7fbc33e00640 1 --2- 172.21.15.5:0/1990242507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc3c0acfa0 0x7fbc3c15d310 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400c4e0 tx=0x7fbc24007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:12.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.020+0000 7fbc32000640 1 -- 172.21.15.5:0/1990242507 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc24016070 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.020+0000 7fbc32000640 1 -- 172.21.15.5:0/1990242507 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc24011590 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.020+0000 7fbc32000640 1 -- 172.21.15.5:0/1990242507 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc240119d0 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.020+0000 7fbc3be00640 1 -- 172.21.15.5:0/1990242507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3c155fa0 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.020+0000 7fbc3be00640 1 -- 172.21.15.5:0/1990242507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3c15a660 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.022+0000 7fbc3be00640 1 -- 172.21.15.5:0/1990242507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3c156480 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.022+0000 7fbc32000640 1 -- 172.21.15.5:0/1990242507 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbc24012420 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.023+0000 7fbc32000640 1 --2- 172.21.15.5:0/1990242507 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbc18065150 0x7fbc18067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.023+0000 7fbc32000640 1 -- 172.21.15.5:0/1990242507 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc24081de0 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.023+0000 7fbc3aa00640 1 --2- 172.21.15.5:0/1990242507 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbc18065150 0x7fbc18067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.024+0000 7fbc3aa00640 1 --2- 172.21.15.5:0/1990242507 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbc18065150 0x7fbc18067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c001380 tx=0x7fbc2c001b00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:12.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.027+0000 7fbc32000640 1 -- 172.21.15.5:0/1990242507 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbc2404feb0 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.213+0000 7fbc3be00640 1 -- 172.21.15.5:0/1990242507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc3c070720 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.214+0000 7fbc32000640 1 -- 172.21.15.5:0/1990242507 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc240534d0 con 0x7fbc3c0acfa0 2024-08-17T02:47:12.214 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:47:12.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.215+0000 7fbc3be00640 1 -- 172.21.15.5:0/1990242507 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbc18065150 msgr2=0x7fbc18067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.215+0000 7fbc3be00640 1 --2- 172.21.15.5:0/1990242507 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbc18065150 0x7fbc18067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c001380 tx=0x7fbc2c001b00 comp rx=0 tx=0).stop 2024-08-17T02:47:12.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.215+0000 7fbc3be00640 1 -- 172.21.15.5:0/1990242507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc3c0acfa0 msgr2=0x7fbc3c15d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.215+0000 7fbc3be00640 1 --2- 172.21.15.5:0/1990242507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc3c0acfa0 0x7fbc3c15d310 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400c4e0 tx=0x7fbc24007d80 comp rx=0 tx=0).stop 2024-08-17T02:47:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.216+0000 7fbc3be00640 1 -- 172.21.15.5:0/1990242507 shutdown_connections 2024-08-17T02:47:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.216+0000 7fbc3be00640 1 --2- 172.21.15.5:0/1990242507 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbc18065150 0x7fbc18067600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.216+0000 7fbc3be00640 1 --2- 172.21.15.5:0/1990242507 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc3c158b50 0x7fbc3c15d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.216+0000 7fbc3be00640 1 --2- 172.21.15.5:0/1990242507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc3c0acfa0 0x7fbc3c15d310 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.216+0000 7fbc3be00640 1 --2- 172.21.15.5:0/1990242507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc3c06dcf0 0x7fbc3c1531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.216+0000 7fbc3be00640 1 -- 172.21.15.5:0/1990242507 >> 172.21.15.5:0/1990242507 conn(0x7fbc3c067930 msgr2=0x7fbc3c06b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.216+0000 7fbc3be00640 1 -- 172.21.15.5:0/1990242507 shutdown_connections 2024-08-17T02:47:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.216+0000 7fbc3be00640 1 -- 172.21.15.5:0/1990242507 wait complete. 2024-08-17T02:47:12.232 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:47:12.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.386+0000 7fea4cc00640 1 Processor -- start 2024-08-17T02:47:12.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.386+0000 7fea4cc00640 1 -- start start 2024-08-17T02:47:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.387+0000 7fea4cc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea480afca0 0x7fea480b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.387+0000 7fea4cc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fea480acf10 0x7fea48159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.387+0000 7fea4cc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea4815a4e0 con 0x7fea481589a0 2024-08-17T02:47:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.387+0000 7fea4cc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea480b0980 con 0x7fea480afca0 2024-08-17T02:47:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.387+0000 7fea4cc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea480c92b0 con 0x7fea480acf10 2024-08-17T02:47:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.388+0000 7fea45e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea480afca0 0x7fea480b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.388+0000 7fea45e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea480afca0 0x7fea480b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33644/0 (socket says 172.21.15.5:33644) 2024-08-17T02:47:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.388+0000 7fea45e00640 1 -- 172.21.15.5:0/729539580 learned_addr learned my addr 172.21.15.5:0/729539580 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.388+0000 7fea3fe00640 1 --2- 172.21.15.5:0/729539580 >> v2:172.21.15.107:3300/0 conn(0x7fea480acf10 0x7fea48159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.388+0000 7fea45e00640 1 -- 172.21.15.5:0/729539580 >> v2:172.21.15.107:3300/0 conn(0x7fea480acf10 msgr2=0x7fea48159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.388+0000 7fea45e00640 1 --2- 172.21.15.5:0/729539580 >> v2:172.21.15.107:3300/0 conn(0x7fea480acf10 0x7fea48159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.388+0000 7fea45e00640 1 -- 172.21.15.5:0/729539580 >> v1:172.21.15.107:6789/0 conn(0x7fea481589a0 legacy=0x7fea48158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.388+0000 7fea45e00640 1 -- 172.21.15.5:0/729539580 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea480ad480 con 0x7fea480afca0 2024-08-17T02:47:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.389+0000 7fea45e00640 1 --2- 172.21.15.5:0/729539580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea480afca0 0x7fea480b0070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea480c83b0 tx=0x7fea380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2ce0ee1a158fac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.389+0000 7fea45400640 1 -- 172.21.15.5:0/729539580 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3802ae80 con 0x7fea480afca0 2024-08-17T02:47:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.390+0000 7fea45400640 1 -- 172.21.15.5:0/729539580 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea38032440 con 0x7fea480afca0 2024-08-17T02:47:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.390+0000 7fea45400640 1 -- 172.21.15.5:0/729539580 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea38032800 con 0x7fea480afca0 2024-08-17T02:47:12.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.390+0000 7fea4cc00640 1 -- 172.21.15.5:0/729539580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea480afca0 msgr2=0x7fea480b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.390+0000 7fea4cc00640 1 --2- 172.21.15.5:0/729539580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea480afca0 0x7fea480b0070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea480c83b0 tx=0x7fea380091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.390+0000 7fea4cc00640 1 -- 172.21.15.5:0/729539580 shutdown_connections 2024-08-17T02:47:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.390+0000 7fea4cc00640 1 --2- 172.21.15.5:0/729539580 >> v2:172.21.15.107:3300/0 conn(0x7fea480acf10 0x7fea48159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.390+0000 7fea4cc00640 1 --2- 172.21.15.5:0/729539580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea480afca0 0x7fea480b0070 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.390+0000 7fea4cc00640 1 -- 172.21.15.5:0/729539580 >> 172.21.15.5:0/729539580 conn(0x7fea48066e60 msgr2=0x7fea48067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.390+0000 7fea4cc00640 1 -- 172.21.15.5:0/729539580 shutdown_connections 2024-08-17T02:47:12.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.390+0000 7fea4cc00640 1 -- 172.21.15.5:0/729539580 wait complete. 2024-08-17T02:47:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.392+0000 7fea4cc00640 1 Processor -- start 2024-08-17T02:47:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.392+0000 7fea4cc00640 1 -- start start 2024-08-17T02:47:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea4cc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea480acf10 0x7fea4814f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea4cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea480afca0 0x7fea48159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea4cc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea481589a0 0x7fea48159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea4cc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea48157f50 con 0x7fea480afca0 2024-08-17T02:47:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea4cc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea481572d0 con 0x7fea480acf10 2024-08-17T02:47:12.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea4cc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea481575b0 con 0x7fea481589a0 2024-08-17T02:47:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea3fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea480afca0 0x7fea48159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea3fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea480afca0 0x7fea48159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33660/0 (socket says 172.21.15.5:33660) 2024-08-17T02:47:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea3fe00640 1 -- 172.21.15.5:0/1812209910 learned_addr learned my addr 172.21.15.5:0/1812209910 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea46800640 1 --2- 172.21.15.5:0/1812209910 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea481589a0 0x7fea48159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea3fe00640 1 -- 172.21.15.5:0/1812209910 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea481589a0 msgr2=0x7fea48159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea45e00640 1 --2- 172.21.15.5:0/1812209910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea480acf10 0x7fea4814f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea3fe00640 1 --2- 172.21.15.5:0/1812209910 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea481589a0 0x7fea48159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea3fe00640 1 -- 172.21.15.5:0/1812209910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea480acf10 msgr2=0x7fea4814f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea3fe00640 1 --2- 172.21.15.5:0/1812209910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea480acf10 0x7fea4814f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea3fe00640 1 -- 172.21.15.5:0/1812209910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38009450 con 0x7fea480afca0 2024-08-17T02:47:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea46800640 1 --2- 172.21.15.5:0/1812209910 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea481589a0 0x7fea48159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.393+0000 7fea45e00640 1 --2- 172.21.15.5:0/1812209910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea480acf10 0x7fea4814f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.394+0000 7fea3fe00640 1 --2- 172.21.15.5:0/1812209910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea480afca0 0x7fea48159520 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fea3000d890 tx=0x7fea30008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.394+0000 7fea3d600640 1 -- 172.21.15.5:0/1812209910 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3000de20 con 0x7fea480afca0 2024-08-17T02:47:12.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.394+0000 7fea3d600640 1 -- 172.21.15.5:0/1812209910 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea300098b0 con 0x7fea480afca0 2024-08-17T02:47:12.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.394+0000 7fea3d600640 1 -- 172.21.15.5:0/1812209910 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30009c70 con 0x7fea480afca0 2024-08-17T02:47:12.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.394+0000 7fea4cc00640 1 -- 172.21.15.5:0/1812209910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea48157890 con 0x7fea480afca0 2024-08-17T02:47:12.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.394+0000 7fea4cc00640 1 -- 172.21.15.5:0/1812209910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4814f910 con 0x7fea480afca0 2024-08-17T02:47:12.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.395+0000 7fea4cc00640 1 -- 172.21.15.5:0/1812209910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea48063fb0 con 0x7fea480afca0 2024-08-17T02:47:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.396+0000 7fea3d600640 1 -- 172.21.15.5:0/1812209910 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fea30014410 con 0x7fea480afca0 2024-08-17T02:47:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.397+0000 7fea3d600640 1 --2- 172.21.15.5:0/1812209910 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fea24065180 0x7fea24067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.397+0000 7fea3d600640 1 -- 172.21.15.5:0/1812209910 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea30082e00 con 0x7fea480afca0 2024-08-17T02:47:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.397+0000 7fea45e00640 1 --2- 172.21.15.5:0/1812209910 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fea24065180 0x7fea24067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.398+0000 7fea45e00640 1 --2- 172.21.15.5:0/1812209910 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fea24065180 0x7fea24067630 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fea38034000 tx=0x7fea38032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:12.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.401+0000 7fea3d600640 1 -- 172.21.15.5:0/1812209910 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fea30050ee0 con 0x7fea480afca0 2024-08-17T02:47:12.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.585+0000 7fea4cc00640 1 -- 172.21.15.5:0/1812209910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea48067b70 con 0x7fea480afca0 2024-08-17T02:47:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.585+0000 7fea3d600640 1 -- 172.21.15.5:0/1812209910 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea30054500 con 0x7fea480afca0 2024-08-17T02:47:12.586 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:47:12.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.588+0000 7fea4cc00640 1 -- 172.21.15.5:0/1812209910 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fea24065180 msgr2=0x7fea24067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.588+0000 7fea4cc00640 1 --2- 172.21.15.5:0/1812209910 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fea24065180 0x7fea24067630 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fea38034000 tx=0x7fea38032000 comp rx=0 tx=0).stop 2024-08-17T02:47:12.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.588+0000 7fea4cc00640 1 -- 172.21.15.5:0/1812209910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea480afca0 msgr2=0x7fea48159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.588+0000 7fea4cc00640 1 --2- 172.21.15.5:0/1812209910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea480afca0 0x7fea48159520 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fea3000d890 tx=0x7fea30008040 comp rx=0 tx=0).stop 2024-08-17T02:47:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.588+0000 7fea4cc00640 1 -- 172.21.15.5:0/1812209910 shutdown_connections 2024-08-17T02:47:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.588+0000 7fea4cc00640 1 --2- 172.21.15.5:0/1812209910 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fea24065180 0x7fea24067630 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.588+0000 7fea4cc00640 1 --2- 172.21.15.5:0/1812209910 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea481589a0 0x7fea48159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.588+0000 7fea4cc00640 1 --2- 172.21.15.5:0/1812209910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea480afca0 0x7fea48159520 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.588+0000 7fea4cc00640 1 --2- 172.21.15.5:0/1812209910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea480acf10 0x7fea4814f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.588+0000 7fea4cc00640 1 -- 172.21.15.5:0/1812209910 >> 172.21.15.5:0/1812209910 conn(0x7fea48066e60 msgr2=0x7fea480698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.588+0000 7fea4cc00640 1 -- 172.21.15.5:0/1812209910 shutdown_connections 2024-08-17T02:47:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.588+0000 7fea4cc00640 1 -- 172.21.15.5:0/1812209910 wait complete. 2024-08-17T02:47:12.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:12.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.752+0000 7fc120c00640 1 Processor -- start 2024-08-17T02:47:12.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.752+0000 7fc120c00640 1 -- start start 2024-08-17T02:47:12.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.753+0000 7fc120c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc11c1590b0 0x7fc11c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.753+0000 7fc120c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc11c0acf10 0x7fc11c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.753+0000 7fc120c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c15a4e0 con 0x7fc11c0afca0 2024-08-17T02:47:12.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.753+0000 7fc120c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11c0b0980 con 0x7fc11c0acf10 2024-08-17T02:47:12.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.753+0000 7fc120c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c0c92b0 con 0x7fc11c1590b0 2024-08-17T02:47:12.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.753+0000 7fc119e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc11c0afca0 0x7fc11c1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42192/0 (socket says 172.21.15.5:42192) 2024-08-17T02:47:12.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.754+0000 7fc119e00640 1 -- 172.21.15.5:0/3932362555 learned_addr learned my addr 172.21.15.5:0/3932362555 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.754+0000 7fc11a800640 1 --2- 172.21.15.5:0/3932362555 >> v2:172.21.15.107:3300/0 conn(0x7fc11c0acf10 0x7fc11c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.754+0000 7fc119400640 1 --2- 172.21.15.5:0/3932362555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc11c1590b0 0x7fc11c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.754+0000 7fc118a00640 1 -- 172.21.15.5:0/3932362555 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138512320 0 0) 0x7fc10c001110 con 0x7fc11c0afca0 2024-08-17T02:47:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.754+0000 7fc118a00640 1 -- 172.21.15.5:0/3932362555 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1000034e0 con 0x7fc11c0afca0 2024-08-17T02:47:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.754+0000 7fc118a00640 1 -- 172.21.15.5:0/3932362555 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2944696222 0 0) 0x7fc1000034e0 con 0x7fc11c0afca0 2024-08-17T02:47:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.754+0000 7fc118a00640 1 -- 172.21.15.5:0/3932362555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc11c1590b0 msgr2=0x7fc11c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.754+0000 7fc118a00640 1 --2- 172.21.15.5:0/3932362555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc11c1590b0 0x7fc11c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.754+0000 7fc118a00640 1 -- 172.21.15.5:0/3932362555 >> v2:172.21.15.107:3300/0 conn(0x7fc11c0acf10 msgr2=0x7fc11c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.754+0000 7fc118a00640 1 --2- 172.21.15.5:0/3932362555 >> v2:172.21.15.107:3300/0 conn(0x7fc11c0acf10 0x7fc11c159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.754+0000 7fc118a00640 1 -- 172.21.15.5:0/3932362555 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c0ad480 con 0x7fc11c0afca0 2024-08-17T02:47:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.754+0000 7fc118a00640 1 -- 172.21.15.5:0/3932362555 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7fc10c001600 con 0x7fc11c0afca0 2024-08-17T02:47:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.754+0000 7fc118a00640 1 -- 172.21.15.5:0/3932362555 >> v1:172.21.15.5:6789/0 conn(0x7fc11c0afca0 legacy=0x7fc11c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.754+0000 7fc118a00640 1 --2- 172.21.15.5:0/3932362555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc11c1590b0 0x7fc1000039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.755+0000 7fc118a00640 1 --2- 172.21.15.5:0/3932362555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc100003f50 0x7fc100004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.755+0000 7fc118a00640 1 --2- 172.21.15.5:0/3932362555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc100004cc0 0x7fc100005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.755+0000 7fc118a00640 1 -- 172.21.15.5:0/3932362555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c0c92b0 con 0x7fc100003f50 2024-08-17T02:47:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.755+0000 7fc118a00640 1 -- 172.21.15.5:0/3932362555 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10000dbe0 con 0x7fc100004cc0 2024-08-17T02:47:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.755+0000 7fc118a00640 1 -- 172.21.15.5:0/3932362555 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10000dd50 con 0x7fc11c1590b0 2024-08-17T02:47:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.755+0000 7fc119400640 1 --2- 172.21.15.5:0/3932362555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc100003f50 0x7fc100004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.755+0000 7fc119e00640 1 --2- 172.21.15.5:0/3932362555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc11c1590b0 0x7fc1000039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.755+0000 7fc11a800640 1 --2- 172.21.15.5:0/3932362555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc100004cc0 0x7fc100005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.755+0000 7fc119400640 1 -- 172.21.15.5:0/3932362555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc11c1590b0 msgr2=0x7fc1000039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.755+0000 7fc119400640 1 --2- 172.21.15.5:0/3932362555 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc11c1590b0 0x7fc1000039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.755+0000 7fc119400640 1 -- 172.21.15.5:0/3932362555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc100004cc0 msgr2=0x7fc100005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.755+0000 7fc119400640 1 --2- 172.21.15.5:0/3932362555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc100004cc0 0x7fc100005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.755+0000 7fc119400640 1 -- 172.21.15.5:0/3932362555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1000034e0 con 0x7fc100003f50 2024-08-17T02:47:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.756+0000 7fc119400640 1 --2- 172.21.15.5:0/3932362555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc100003f50 0x7fc100004780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc108009b70 tx=0x7fc1080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7aa45abd8fdb3c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.756+0000 7fc118a00640 1 -- 172.21.15.5:0/3932362555 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108031400 con 0x7fc100003f50 2024-08-17T02:47:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.756+0000 7fc118a00640 1 -- 172.21.15.5:0/3932362555 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10802d050 con 0x7fc100003f50 2024-08-17T02:47:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.756+0000 7fc118a00640 1 -- 172.21.15.5:0/3932362555 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108031790 con 0x7fc100003f50 2024-08-17T02:47:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.757+0000 7fc120c00640 1 -- 172.21.15.5:0/3932362555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc100003f50 msgr2=0x7fc100004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.757+0000 7fc120c00640 1 --2- 172.21.15.5:0/3932362555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc100003f50 0x7fc100004780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc108009b70 tx=0x7fc1080090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.757+0000 7fc11a800640 1 -- 172.21.15.5:0/3932362555 reap_dead start 2024-08-17T02:47:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.757+0000 7fc120c00640 1 -- 172.21.15.5:0/3932362555 shutdown_connections 2024-08-17T02:47:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.757+0000 7fc120c00640 1 -- 172.21.15.5:0/3932362555 >> 172.21.15.5:0/3932362555 conn(0x7fc11c066e60 msgr2=0x7fc11c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.757+0000 7fc120c00640 1 -- 172.21.15.5:0/3932362555 shutdown_connections 2024-08-17T02:47:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.757+0000 7fc120c00640 1 -- 172.21.15.5:0/3932362555 wait complete. 2024-08-17T02:47:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.758+0000 7fc120c00640 1 Processor -- start 2024-08-17T02:47:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.758+0000 7fc120c00640 1 -- start start 2024-08-17T02:47:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.759+0000 7fc120c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc100003f50 0x7fc11c0c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.759+0000 7fc120c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc11c0c4ac0 0x7fc11c157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.759+0000 7fc120c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc11c1578b0 0x7fc11c13f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.759+0000 7fc120c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c0c1930 con 0x7fc100003f50 2024-08-17T02:47:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.759+0000 7fc120c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c0c6a00 con 0x7fc11c1578b0 2024-08-17T02:47:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.759+0000 7fc120c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c157ce0 con 0x7fc11c0c4ac0 2024-08-17T02:47:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.759+0000 7fc119e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc100003f50 0x7fc11c0c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.759+0000 7fc119e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc100003f50 0x7fc11c0c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33684/0 (socket says 172.21.15.5:33684) 2024-08-17T02:47:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.760+0000 7fc119e00640 1 -- 172.21.15.5:0/2199837674 learned_addr learned my addr 172.21.15.5:0/2199837674 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.760+0000 7fc11a800640 1 --2- 172.21.15.5:0/2199837674 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc11c1578b0 0x7fc11c13f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.760+0000 7fc119400640 1 --2- 172.21.15.5:0/2199837674 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc11c0c4ac0 0x7fc11c157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.760+0000 7fc119e00640 1 -- 172.21.15.5:0/2199837674 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc11c0c4ac0 msgr2=0x7fc11c157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.760+0000 7fc119e00640 1 --2- 172.21.15.5:0/2199837674 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc11c0c4ac0 0x7fc11c157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.760+0000 7fc119e00640 1 -- 172.21.15.5:0/2199837674 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc11c1578b0 msgr2=0x7fc11c13f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.760+0000 7fc119e00640 1 --2- 172.21.15.5:0/2199837674 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc11c1578b0 0x7fc11c13f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.760+0000 7fc119e00640 1 -- 172.21.15.5:0/2199837674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c1528c0 con 0x7fc100003f50 2024-08-17T02:47:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.760+0000 7fc119e00640 1 --2- 172.21.15.5:0/2199837674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc100003f50 0x7fc11c0c4580 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc10c001050 tx=0x7fc11c0683f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.760+0000 7fc111600640 1 -- 172.21.15.5:0/2199837674 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c018030 con 0x7fc100003f50 2024-08-17T02:47:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.760+0000 7fc111600640 1 -- 172.21.15.5:0/2199837674 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c0011e0 con 0x7fc100003f50 2024-08-17T02:47:12.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.760+0000 7fc111600640 1 -- 172.21.15.5:0/2199837674 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c00fc10 con 0x7fc100003f50 2024-08-17T02:47:12.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.760+0000 7fc120c00640 1 -- 172.21.15.5:0/2199837674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c157f60 con 0x7fc100003f50 2024-08-17T02:47:12.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.761+0000 7fc120c00640 1 -- 172.21.15.5:0/2199837674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11c0c6690 con 0x7fc100003f50 2024-08-17T02:47:12.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.762+0000 7fc120c00640 1 -- 172.21.15.5:0/2199837674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11c063fb0 con 0x7fc100003f50 2024-08-17T02:47:12.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.762+0000 7fc111600640 1 -- 172.21.15.5:0/2199837674 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc10c01b070 con 0x7fc100003f50 2024-08-17T02:47:12.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.763+0000 7fc111600640 1 --2- 172.21.15.5:0/2199837674 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc0fc065150 0x7fc0fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.763+0000 7fc111600640 1 -- 172.21.15.5:0/2199837674 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc10c019070 con 0x7fc100003f50 2024-08-17T02:47:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.763+0000 7fc119400640 1 --2- 172.21.15.5:0/2199837674 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc0fc065150 0x7fc0fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.764+0000 7fc119400640 1 --2- 172.21.15.5:0/2199837674 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc0fc065150 0x7fc0fc067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc108034000 tx=0x7fc108035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.767+0000 7fc111600640 1 -- 172.21.15.5:0/2199837674 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc10c053d00 con 0x7fc100003f50 2024-08-17T02:47:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.986+0000 7fc120c00640 1 -- 172.21.15.5:0/2199837674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc11c15a4e0 con 0x7fc100003f50 2024-08-17T02:47:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.987+0000 7fc111600640 1 -- 172.21.15.5:0/2199837674 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4591 (secure 0 0 0) 0x7fc11c15a4e0 con 0x7fc100003f50 2024-08-17T02:47:12.987 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:12.987 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/3624354828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3624354828},{"type":"v1","addr":"172.21.15.5:6836","nonce":3624354828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2614098803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2614098803},{"type":"v1","addr":"172.21.15.107:6835","nonce":2614098803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1090239725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1090239725},{"type":"v1","addr":"172.21.15.5:6837","nonce":1090239725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:57.590268+0000","modified":"2024-08-17T02:47:01.184380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6834/2631760450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2631760450},{"type":"v1","addr":"172.21.15.107:6834","nonce":2631760450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:47:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-08-17T02:47:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.989+0000 7fc120c00640 1 -- 172.21.15.5:0/2199837674 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc0fc065150 msgr2=0x7fc0fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.989+0000 7fc120c00640 1 --2- 172.21.15.5:0/2199837674 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc0fc065150 0x7fc0fc067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc108034000 tx=0x7fc108035000 comp rx=0 tx=0).stop 2024-08-17T02:47:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.989+0000 7fc120c00640 1 -- 172.21.15.5:0/2199837674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc100003f50 msgr2=0x7fc11c0c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.989+0000 7fc120c00640 1 --2- 172.21.15.5:0/2199837674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc100003f50 0x7fc11c0c4580 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc10c001050 tx=0x7fc11c0683f0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.989+0000 7fc120c00640 1 -- 172.21.15.5:0/2199837674 shutdown_connections 2024-08-17T02:47:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.989+0000 7fc120c00640 1 --2- 172.21.15.5:0/2199837674 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc0fc065150 0x7fc0fc067600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.989+0000 7fc120c00640 1 --2- 172.21.15.5:0/2199837674 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc11c1578b0 0x7fc11c13f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.989+0000 7fc120c00640 1 --2- 172.21.15.5:0/2199837674 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc11c0c4ac0 0x7fc11c157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.989+0000 7fc120c00640 1 --2- 172.21.15.5:0/2199837674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc100003f50 0x7fc11c0c4580 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.989+0000 7fc120c00640 1 -- 172.21.15.5:0/2199837674 >> 172.21.15.5:0/2199837674 conn(0x7fc11c066e60 msgr2=0x7fc11c0ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.989+0000 7fc120c00640 1 -- 172.21.15.5:0/2199837674 shutdown_connections 2024-08-17T02:47:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:12.989+0000 7fc120c00640 1 -- 172.21.15.5:0/2199837674 wait complete. 2024-08-17T02:47:13.004 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:13.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.155+0000 7fd736c00640 1 Processor -- start 2024-08-17T02:47:13.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.155+0000 7fd736c00640 1 -- start start 2024-08-17T02:47:13.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.156+0000 7fd736c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd730155040 0x7fd730158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.156+0000 7fd736c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd73006e770 0x7fd7300af340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.157+0000 7fd736c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7300aeeb0 con 0x7fd7301591c0 2024-08-17T02:47:13.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.157+0000 7fd736c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd730159610 con 0x7fd730155040 2024-08-17T02:47:13.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.157+0000 7fd736c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7300aadd0 con 0x7fd73006e770 2024-08-17T02:47:13.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.157+0000 7fd72fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd730155040 0x7fd730158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.157+0000 7fd72fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd730155040 0x7fd730158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33694/0 (socket says 172.21.15.5:33694) 2024-08-17T02:47:13.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.157+0000 7fd72fe00640 1 -- 172.21.15.5:0/1684148 learned_addr learned my addr 172.21.15.5:0/1684148 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:13.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.157+0000 7fd72fe00640 1 -- 172.21.15.5:0/1684148 >> v2:172.21.15.107:3300/0 conn(0x7fd73006e770 msgr2=0x7fd7300af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:13.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.157+0000 7fd72fe00640 1 --2- 172.21.15.5:0/1684148 >> v2:172.21.15.107:3300/0 conn(0x7fd73006e770 0x7fd7300af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.157+0000 7fd72fe00640 1 -- 172.21.15.5:0/1684148 >> v1:172.21.15.5:6789/0 conn(0x7fd7301591c0 legacy=0x7fd73006e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.157+0000 7fd72fe00640 1 -- 172.21.15.5:0/1684148 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7301597f0 con 0x7fd730155040 2024-08-17T02:47:13.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.158+0000 7fd72fe00640 1 --2- 172.21.15.5:0/1684148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd730155040 0x7fd730158c80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd7300ad790 tx=0x7fd7200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efba040f7bf6049 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:13.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.158+0000 7fd72f400640 1 -- 172.21.15.5:0/1684148 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72002ad40 con 0x7fd730155040 2024-08-17T02:47:13.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.159+0000 7fd72f400640 1 -- 172.21.15.5:0/1684148 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd720032440 con 0x7fd730155040 2024-08-17T02:47:13.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.159+0000 7fd72f400640 1 -- 172.21.15.5:0/1684148 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72002aea0 con 0x7fd730155040 2024-08-17T02:47:13.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.159+0000 7fd736c00640 1 -- 172.21.15.5:0/1684148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd730155040 msgr2=0x7fd730158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.159+0000 7fd736c00640 1 --2- 172.21.15.5:0/1684148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd730155040 0x7fd730158c80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd7300ad790 tx=0x7fd7200091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.159+0000 7fd736c00640 1 -- 172.21.15.5:0/1684148 shutdown_connections 2024-08-17T02:47:13.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.159+0000 7fd736c00640 1 --2- 172.21.15.5:0/1684148 >> v2:172.21.15.107:3300/0 conn(0x7fd73006e770 0x7fd7300af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.159+0000 7fd736c00640 1 --2- 172.21.15.5:0/1684148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd730155040 0x7fd730158c80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.159+0000 7fd736c00640 1 -- 172.21.15.5:0/1684148 >> 172.21.15.5:0/1684148 conn(0x7fd730066e60 msgr2=0x7fd730067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:13.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.159+0000 7fd736c00640 1 -- 172.21.15.5:0/1684148 shutdown_connections 2024-08-17T02:47:13.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.159+0000 7fd736c00640 1 -- 172.21.15.5:0/1684148 wait complete. 2024-08-17T02:47:13.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.161+0000 7fd736c00640 1 Processor -- start 2024-08-17T02:47:13.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.161+0000 7fd736c00640 1 -- start start 2024-08-17T02:47:13.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.161+0000 7fd736c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd73006e770 0x7fd730153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.161+0000 7fd736c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd730155040 0x7fd7301573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.161+0000 7fd736c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7301591c0 0x7fd730152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.162+0000 7fd736c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd730157900 con 0x7fd730155040 2024-08-17T02:47:13.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.162+0000 7fd736c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd730153bc0 con 0x7fd7301591c0 2024-08-17T02:47:13.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.162+0000 7fd736c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd730157af0 con 0x7fd73006e770 2024-08-17T02:47:13.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.162+0000 7fd727e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd730155040 0x7fd7301573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.162+0000 7fd727e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd730155040 0x7fd7301573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33710/0 (socket says 172.21.15.5:33710) 2024-08-17T02:47:13.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.162+0000 7fd727e00640 1 -- 172.21.15.5:0/2940538486 learned_addr learned my addr 172.21.15.5:0/2940538486 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:13.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.162+0000 7fd72fe00640 1 --2- 172.21.15.5:0/2940538486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd73006e770 0x7fd730153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.162+0000 7fd734c00640 1 --2- 172.21.15.5:0/2940538486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7301591c0 0x7fd730152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.162+0000 7fd727e00640 1 -- 172.21.15.5:0/2940538486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd73006e770 msgr2=0x7fd730153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.162+0000 7fd727e00640 1 --2- 172.21.15.5:0/2940538486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd73006e770 0x7fd730153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.162+0000 7fd727e00640 1 -- 172.21.15.5:0/2940538486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7301591c0 msgr2=0x7fd730152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.162+0000 7fd727e00640 1 --2- 172.21.15.5:0/2940538486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7301591c0 0x7fd730152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.162+0000 7fd727e00640 1 -- 172.21.15.5:0/2940538486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd720009450 con 0x7fd730155040 2024-08-17T02:47:13.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.162+0000 7fd72fe00640 1 --2- 172.21.15.5:0/2940538486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd73006e770 0x7fd730153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:13.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.163+0000 7fd727e00640 1 --2- 172.21.15.5:0/2940538486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd730155040 0x7fd7301573c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd71800c4f0 tx=0x7fd718007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:13.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.163+0000 7fd727400640 1 -- 172.21.15.5:0/2940538486 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718011590 con 0x7fd730155040 2024-08-17T02:47:13.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.163+0000 7fd727400640 1 -- 172.21.15.5:0/2940538486 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd718011710 con 0x7fd730155040 2024-08-17T02:47:13.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.163+0000 7fd736c00640 1 -- 172.21.15.5:0/2940538486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd730169d70 con 0x7fd730155040 2024-08-17T02:47:13.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.163+0000 7fd727400640 1 -- 172.21.15.5:0/2940538486 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718011ad0 con 0x7fd730155040 2024-08-17T02:47:13.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.163+0000 7fd736c00640 1 -- 172.21.15.5:0/2940538486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd730169720 con 0x7fd730155040 2024-08-17T02:47:13.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.164+0000 7fd736c00640 1 -- 172.21.15.5:0/2940538486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd730169f00 con 0x7fd730155040 2024-08-17T02:47:13.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.165+0000 7fd727400640 1 -- 172.21.15.5:0/2940538486 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd71801b3b0 con 0x7fd730155040 2024-08-17T02:47:13.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.166+0000 7fd727400640 1 --2- 172.21.15.5:0/2940538486 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd70c065150 0x7fd70c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.166+0000 7fd727400640 1 -- 172.21.15.5:0/2940538486 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd718081920 con 0x7fd730155040 2024-08-17T02:47:13.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.166+0000 7fd72fe00640 1 --2- 172.21.15.5:0/2940538486 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd70c065150 0x7fd70c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.167+0000 7fd72fe00640 1 --2- 172.21.15.5:0/2940538486 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd70c065150 0x7fd70c067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd720034000 tx=0x7fd720032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.170+0000 7fd727400640 1 -- 172.21.15.5:0/2940538486 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd71804f940 con 0x7fd730155040 2024-08-17T02:47:13.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.355+0000 7fd736c00640 1 -- 172.21.15.5:0/2940538486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd730063fb0 con 0x7fd730155040 2024-08-17T02:47:13.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.356+0000 7fd727400640 1 -- 172.21.15.5:0/2940538486 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fd718017070 con 0x7fd730155040 2024-08-17T02:47:13.356 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:13.357 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:59.170637+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:55.543347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:56.571235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:13.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.358+0000 7fd736c00640 1 -- 172.21.15.5:0/2940538486 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd70c065150 msgr2=0x7fd70c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.358+0000 7fd736c00640 1 --2- 172.21.15.5:0/2940538486 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd70c065150 0x7fd70c067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd720034000 tx=0x7fd720032000 comp rx=0 tx=0).stop 2024-08-17T02:47:13.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.358+0000 7fd736c00640 1 -- 172.21.15.5:0/2940538486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd730155040 msgr2=0x7fd7301573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.358+0000 7fd736c00640 1 --2- 172.21.15.5:0/2940538486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd730155040 0x7fd7301573c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd71800c4f0 tx=0x7fd718007ef0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.358+0000 7fd736c00640 1 -- 172.21.15.5:0/2940538486 shutdown_connections 2024-08-17T02:47:13.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.358+0000 7fd736c00640 1 --2- 172.21.15.5:0/2940538486 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd70c065150 0x7fd70c067600 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.358+0000 7fd736c00640 1 --2- 172.21.15.5:0/2940538486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7301591c0 0x7fd730152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.358+0000 7fd736c00640 1 --2- 172.21.15.5:0/2940538486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd730155040 0x7fd7301573c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.358+0000 7fd736c00640 1 --2- 172.21.15.5:0/2940538486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd73006e770 0x7fd730153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.358+0000 7fd736c00640 1 -- 172.21.15.5:0/2940538486 >> 172.21.15.5:0/2940538486 conn(0x7fd730066e60 msgr2=0x7fd73006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:13.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.358+0000 7fd736c00640 1 -- 172.21.15.5:0/2940538486 shutdown_connections 2024-08-17T02:47:13.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.358+0000 7fd736c00640 1 -- 172.21.15.5:0/2940538486 wait complete. 2024-08-17T02:47:13.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:47.106425+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:55.543347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:56.571235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:47:13.374 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:13.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.527+0000 7fea95200640 1 Processor -- start 2024-08-17T02:47:13.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.528+0000 7fea95200640 1 -- start start 2024-08-17T02:47:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.529+0000 7fea95200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea90156bd0 0x7fea900b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.529+0000 7fea95200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fea900adf90 0x7fea900b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.529+0000 7fea95200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea900ac040 con 0x7fea90156fa0 2024-08-17T02:47:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.529+0000 7fea95200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea90067810 con 0x7fea900adf90 2024-08-17T02:47:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.529+0000 7fea95200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea900ab150 con 0x7fea90156bd0 2024-08-17T02:47:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.529+0000 7fea8e800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fea90156fa0 0x7fea900ac4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42220/0 (socket says 172.21.15.5:42220) 2024-08-17T02:47:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.529+0000 7fea8e800640 1 -- 172.21.15.5:0/4015318246 learned_addr learned my addr 172.21.15.5:0/4015318246 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.529+0000 7fea87e00640 1 --2- 172.21.15.5:0/4015318246 >> v2:172.21.15.107:3300/0 conn(0x7fea900adf90 0x7fea900b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.529+0000 7fea8de00640 1 --2- 172.21.15.5:0/4015318246 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea90156bd0 0x7fea900b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.530+0000 7fea8d400640 1 -- 172.21.15.5:0/4015318246 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970608437 0 0) 0x7fea900ac040 con 0x7fea90156fa0 2024-08-17T02:47:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.530+0000 7fea8d400640 1 -- 172.21.15.5:0/4015318246 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea740034e0 con 0x7fea90156fa0 2024-08-17T02:47:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.530+0000 7fea87e00640 1 -- 172.21.15.5:0/4015318246 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea90156bd0 msgr2=0x7fea900b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.530+0000 7fea87e00640 1 --2- 172.21.15.5:0/4015318246 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea90156bd0 0x7fea900b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.530+0000 7fea87e00640 1 -- 172.21.15.5:0/4015318246 >> v1:172.21.15.5:6789/0 conn(0x7fea90156fa0 legacy=0x7fea900ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.530+0000 7fea87e00640 1 -- 172.21.15.5:0/4015318246 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea900ab430 con 0x7fea900adf90 2024-08-17T02:47:13.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.531+0000 7fea87e00640 1 --2- 172.21.15.5:0/4015318246 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea900adf90 0x7fea900b10b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea78009850 tx=0x7fea780090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14699466ed75f15d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:13.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.531+0000 7fea8d400640 1 -- 172.21.15.5:0/4015318246 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7802ad90 con 0x7fea900adf90 2024-08-17T02:47:13.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.531+0000 7fea8d400640 1 -- 172.21.15.5:0/4015318246 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea78032440 con 0x7fea900adf90 2024-08-17T02:47:13.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.531+0000 7fea8d400640 1 -- 172.21.15.5:0/4015318246 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea78032800 con 0x7fea900adf90 2024-08-17T02:47:13.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.532+0000 7fea95200640 1 -- 172.21.15.5:0/4015318246 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea900adf90 msgr2=0x7fea900b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.532+0000 7fea95200640 1 --2- 172.21.15.5:0/4015318246 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea900adf90 0x7fea900b10b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea78009850 tx=0x7fea780090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.532+0000 7fea95200640 1 -- 172.21.15.5:0/4015318246 shutdown_connections 2024-08-17T02:47:13.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.532+0000 7fea95200640 1 --2- 172.21.15.5:0/4015318246 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea900adf90 0x7fea900b10b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.532+0000 7fea95200640 1 --2- 172.21.15.5:0/4015318246 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea90156bd0 0x7fea900b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.532+0000 7fea95200640 1 -- 172.21.15.5:0/4015318246 >> 172.21.15.5:0/4015318246 conn(0x7fea900cc390 msgr2=0x7fea90066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:13.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.532+0000 7fea95200640 1 -- 172.21.15.5:0/4015318246 shutdown_connections 2024-08-17T02:47:13.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.532+0000 7fea95200640 1 -- 172.21.15.5:0/4015318246 wait complete. 2024-08-17T02:47:13.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.533+0000 7fea95200640 1 Processor -- start 2024-08-17T02:47:13.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.534+0000 7fea95200640 1 -- start start 2024-08-17T02:47:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.534+0000 7fea95200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea900adf90 0x7fea90159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.534+0000 7fea95200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea90156bd0 0x7fea90146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.535+0000 7fea95200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea90156fa0 0x7fea90169290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.535+0000 7fea95200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9015dc90 con 0x7fea90156fa0 2024-08-17T02:47:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.535+0000 7fea95200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea900a9b90 con 0x7fea900adf90 2024-08-17T02:47:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.535+0000 7fea95200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea900a92c0 con 0x7fea90156bd0 2024-08-17T02:47:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.535+0000 7fea8e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea90156fa0 0x7fea90169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.535+0000 7fea8e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea90156fa0 0x7fea90169290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33718/0 (socket says 172.21.15.5:33718) 2024-08-17T02:47:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.535+0000 7fea8e800640 1 -- 172.21.15.5:0/3544090747 learned_addr learned my addr 172.21.15.5:0/3544090747 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.535+0000 7fea8de00640 1 --2- 172.21.15.5:0/3544090747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea900adf90 0x7fea90159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.535+0000 7fea87e00640 1 --2- 172.21.15.5:0/3544090747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea90156bd0 0x7fea90146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.535+0000 7fea8e800640 1 -- 172.21.15.5:0/3544090747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea90156bd0 msgr2=0x7fea90146330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.535+0000 7fea8e800640 1 --2- 172.21.15.5:0/3544090747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea90156bd0 0x7fea90146330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.535+0000 7fea8e800640 1 -- 172.21.15.5:0/3544090747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea900adf90 msgr2=0x7fea90159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.535+0000 7fea8e800640 1 --2- 172.21.15.5:0/3544090747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea900adf90 0x7fea90159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.535+0000 7fea8e800640 1 -- 172.21.15.5:0/3544090747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78009390 con 0x7fea90156fa0 2024-08-17T02:47:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.536+0000 7fea8e800640 1 --2- 172.21.15.5:0/3544090747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea90156fa0 0x7fea90169290 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fea88001460 tx=0x7fea88001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.536+0000 7fea85600640 1 -- 172.21.15.5:0/3544090747 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8800ce30 con 0x7fea90156fa0 2024-08-17T02:47:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.536+0000 7fea85600640 1 -- 172.21.15.5:0/3544090747 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8800a850 con 0x7fea90156fa0 2024-08-17T02:47:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.536+0000 7fea85600640 1 -- 172.21.15.5:0/3544090747 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8800ac50 con 0x7fea90156fa0 2024-08-17T02:47:13.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.536+0000 7fea95200640 1 -- 172.21.15.5:0/3544090747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9015caf0 con 0x7fea90156fa0 2024-08-17T02:47:13.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.536+0000 7fea95200640 1 -- 172.21.15.5:0/3544090747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea900a9820 con 0x7fea90156fa0 2024-08-17T02:47:13.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.537+0000 7fea95200640 1 -- 172.21.15.5:0/3544090747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea900a9d20 con 0x7fea90156fa0 2024-08-17T02:47:13.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.538+0000 7fea85600640 1 -- 172.21.15.5:0/3544090747 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fea88007300 con 0x7fea90156fa0 2024-08-17T02:47:13.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.538+0000 7fea85600640 1 --2- 172.21.15.5:0/3544090747 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fea6c065180 0x7fea6c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.539+0000 7fea85600640 1 -- 172.21.15.5:0/3544090747 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea88082570 con 0x7fea90156fa0 2024-08-17T02:47:13.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.539+0000 7fea8de00640 1 --2- 172.21.15.5:0/3544090747 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fea6c065180 0x7fea6c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.539+0000 7fea8de00640 1 --2- 172.21.15.5:0/3544090747 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fea6c065180 0x7fea6c067630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea80009d20 tx=0x7fea800090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.542+0000 7fea85600640 1 -- 172.21.15.5:0/3544090747 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fea88050630 con 0x7fea90156fa0 2024-08-17T02:47:13.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.724+0000 7fea95200640 1 -- 172.21.15.5:0/3544090747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea90063fb0 con 0x7fea90156fa0 2024-08-17T02:47:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.724+0000 7fea85600640 1 -- 172.21.15.5:0/3544090747 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea88053c50 con 0x7fea90156fa0 2024-08-17T02:47:13.725 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:47:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.727+0000 7fea95200640 1 -- 172.21.15.5:0/3544090747 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fea6c065180 msgr2=0x7fea6c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.727+0000 7fea95200640 1 --2- 172.21.15.5:0/3544090747 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fea6c065180 0x7fea6c067630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea80009d20 tx=0x7fea800090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.727+0000 7fea95200640 1 -- 172.21.15.5:0/3544090747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea90156fa0 msgr2=0x7fea90169290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.727+0000 7fea95200640 1 --2- 172.21.15.5:0/3544090747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea90156fa0 0x7fea90169290 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fea88001460 tx=0x7fea88001a40 comp rx=0 tx=0).stop 2024-08-17T02:47:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.727+0000 7fea95200640 1 -- 172.21.15.5:0/3544090747 shutdown_connections 2024-08-17T02:47:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.727+0000 7fea95200640 1 --2- 172.21.15.5:0/3544090747 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fea6c065180 0x7fea6c067630 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.727+0000 7fea95200640 1 --2- 172.21.15.5:0/3544090747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea90156fa0 0x7fea90169290 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.727+0000 7fea95200640 1 --2- 172.21.15.5:0/3544090747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea90156bd0 0x7fea90146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.727+0000 7fea95200640 1 --2- 172.21.15.5:0/3544090747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea900adf90 0x7fea90159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.727+0000 7fea95200640 1 -- 172.21.15.5:0/3544090747 >> 172.21.15.5:0/3544090747 conn(0x7fea900cc390 msgr2=0x7fea9006b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.727+0000 7fea95200640 1 -- 172.21.15.5:0/3544090747 shutdown_connections 2024-08-17T02:47:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.727+0000 7fea95200640 1 -- 172.21.15.5:0/3544090747 wait complete. 2024-08-17T02:47:13.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:47:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.897+0000 7f0e4a800640 1 Processor -- start 2024-08-17T02:47:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.897+0000 7f0e4a800640 1 -- start start 2024-08-17T02:47:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.898+0000 7f0e4a800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0e441590b0 0x7f0e440b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.899+0000 7f0e4a800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e440c92b0 con 0x7f0e440afca0 2024-08-17T02:47:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.899+0000 7f0e4a800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e440ad480 con 0x7f0e440acf10 2024-08-17T02:47:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.899+0000 7f0e4a800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e440b0980 con 0x7f0e441590b0 2024-08-17T02:47:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.899+0000 7f0e43400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0e440afca0 0x7f0e441589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42224/0 (socket says 172.21.15.5:42224) 2024-08-17T02:47:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.899+0000 7f0e43400640 1 -- 172.21.15.5:0/1350978187 learned_addr learned my addr 172.21.15.5:0/1350978187 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.899+0000 7f0e42a00640 1 -- 172.21.15.5:0/1350978187 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004261679 0 0) 0x7f0e440c92b0 con 0x7f0e440afca0 2024-08-17T02:47:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.899+0000 7f0e3aa00640 1 --2- 172.21.15.5:0/1350978187 >> v2:172.21.15.107:3300/0 conn(0x7f0e441590b0 0x7f0e440b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.899+0000 7f0e42a00640 1 -- 172.21.15.5:0/1350978187 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e280034e0 con 0x7f0e440afca0 2024-08-17T02:47:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e42a00640 1 -- 172.21.15.5:0/1350978187 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 887313346 0 0) 0x7f0e280034e0 con 0x7f0e440afca0 2024-08-17T02:47:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e42a00640 1 -- 172.21.15.5:0/1350978187 >> v2:172.21.15.107:3300/0 conn(0x7f0e441590b0 msgr2=0x7f0e440b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:13.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e42a00640 1 --2- 172.21.15.5:0/1350978187 >> v2:172.21.15.107:3300/0 conn(0x7f0e441590b0 0x7f0e440b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e42a00640 1 -- 172.21.15.5:0/1350978187 >> v1:172.21.15.107:6789/0 conn(0x7f0e440acf10 legacy=0x7f0e440c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e42a00640 1 -- 172.21.15.5:0/1350978187 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e440ad760 con 0x7f0e440afca0 2024-08-17T02:47:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e42a00640 1 -- 172.21.15.5:0/1350978187 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7f0e34001470 con 0x7f0e440afca0 2024-08-17T02:47:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e42a00640 1 -- 172.21.15.5:0/1350978187 >> v1:172.21.15.5:6789/0 conn(0x7f0e440afca0 legacy=0x7f0e441589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e42a00640 1 --2- 172.21.15.5:0/1350978187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e28003a20 0x7f0e28003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e42a00640 1 --2- 172.21.15.5:0/1350978187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e28004780 0x7f0e28004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e42a00640 1 --2- 172.21.15.5:0/1350978187 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e28005180 0x7f0e2800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e42a00640 1 -- 172.21.15.5:0/1350978187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2800c0a0 con 0x7f0e28003a20 2024-08-17T02:47:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e42a00640 1 -- 172.21.15.5:0/1350978187 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2800c1e0 con 0x7f0e28004780 2024-08-17T02:47:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e42a00640 1 -- 172.21.15.5:0/1350978187 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2800c3a0 con 0x7f0e28005180 2024-08-17T02:47:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e43400640 1 --2- 172.21.15.5:0/1350978187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e28003a20 0x7f0e28003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e3aa00640 1 --2- 172.21.15.5:0/1350978187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e28004780 0x7f0e28004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e43e00640 1 --2- 172.21.15.5:0/1350978187 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e28005180 0x7f0e2800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e43400640 1 -- 172.21.15.5:0/1350978187 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e28005180 msgr2=0x7f0e2800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e43400640 1 --2- 172.21.15.5:0/1350978187 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e28005180 0x7f0e2800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e43400640 1 -- 172.21.15.5:0/1350978187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e28004780 msgr2=0x7f0e28004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e43400640 1 --2- 172.21.15.5:0/1350978187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e28004780 0x7f0e28004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e43400640 1 -- 172.21.15.5:0/1350978187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e280034e0 con 0x7f0e28003a20 2024-08-17T02:47:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.900+0000 7f0e43e00640 1 -- 172.21.15.5:0/1350978187 reap_dead start 2024-08-17T02:47:13.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.901+0000 7f0e43400640 1 --2- 172.21.15.5:0/1350978187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e28003a20 0x7f0e28003e30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400c160 tx=0x7f0e440ad370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42834a52e8fcfe2b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:13.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.901+0000 7f0e42a00640 1 -- 172.21.15.5:0/1350978187 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34005890 con 0x7f0e28003a20 2024-08-17T02:47:13.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.902+0000 7f0e42a00640 1 -- 172.21.15.5:0/1350978187 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3402d070 con 0x7f0e28003a20 2024-08-17T02:47:13.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.902+0000 7f0e42a00640 1 -- 172.21.15.5:0/1350978187 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34005a50 con 0x7f0e28003a20 2024-08-17T02:47:13.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.902+0000 7f0e4a800640 1 -- 172.21.15.5:0/1350978187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e28003a20 msgr2=0x7f0e28003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.902+0000 7f0e4a800640 1 --2- 172.21.15.5:0/1350978187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e28003a20 0x7f0e28003e30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400c160 tx=0x7f0e440ad370 comp rx=0 tx=0).stop 2024-08-17T02:47:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.902+0000 7f0e4a800640 1 -- 172.21.15.5:0/1350978187 shutdown_connections 2024-08-17T02:47:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.902+0000 7f0e4a800640 1 --2- 172.21.15.5:0/1350978187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e28003a20 0x7f0e28003e30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.902+0000 7f0e4a800640 1 -- 172.21.15.5:0/1350978187 >> 172.21.15.5:0/1350978187 conn(0x7f0e44066e60 msgr2=0x7f0e44067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.902+0000 7f0e4a800640 1 -- 172.21.15.5:0/1350978187 shutdown_connections 2024-08-17T02:47:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.902+0000 7f0e4a800640 1 -- 172.21.15.5:0/1350978187 wait complete. 2024-08-17T02:47:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.904+0000 7f0e4a800640 1 Processor -- start 2024-08-17T02:47:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.904+0000 7f0e4a800640 1 -- start start 2024-08-17T02:47:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.905+0000 7f0e4a800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e28003a20 0x7f0e4414b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.905+0000 7f0e4a800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e44169a10 0x7f0e44155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.905+0000 7f0e4a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e441572d0 0x7f0e44157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.905+0000 7f0e4a800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44157cb0 con 0x7f0e441572d0 2024-08-17T02:47:13.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.905+0000 7f0e4a800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44156a30 con 0x7f0e28003a20 2024-08-17T02:47:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.905+0000 7f0e4a800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e441565a0 con 0x7f0e44169a10 2024-08-17T02:47:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.905+0000 7f0e43e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e441572d0 0x7f0e44157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.905+0000 7f0e43e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e441572d0 0x7f0e44157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33738/0 (socket says 172.21.15.5:33738) 2024-08-17T02:47:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.905+0000 7f0e43e00640 1 -- 172.21.15.5:0/1477731480 learned_addr learned my addr 172.21.15.5:0/1477731480 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.905+0000 7f0e43400640 1 --2- 172.21.15.5:0/1477731480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e28003a20 0x7f0e4414b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.905+0000 7f0e3aa00640 1 --2- 172.21.15.5:0/1477731480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e44169a10 0x7f0e44155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.905+0000 7f0e43e00640 1 -- 172.21.15.5:0/1477731480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e44169a10 msgr2=0x7f0e44155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.905+0000 7f0e43e00640 1 --2- 172.21.15.5:0/1477731480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e44169a10 0x7f0e44155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.905+0000 7f0e43e00640 1 -- 172.21.15.5:0/1477731480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e28003a20 msgr2=0x7f0e4414b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.905+0000 7f0e43e00640 1 --2- 172.21.15.5:0/1477731480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e28003a20 0x7f0e4414b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.905+0000 7f0e43e00640 1 -- 172.21.15.5:0/1477731480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e44155990 con 0x7f0e441572d0 2024-08-17T02:47:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.906+0000 7f0e43e00640 1 --2- 172.21.15.5:0/1477731480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e441572d0 0x7f0e44157770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0e44159480 tx=0x7f0e3c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.906+0000 7f0e3b400640 1 -- 172.21.15.5:0/1477731480 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0032e0 con 0x7f0e441572d0 2024-08-17T02:47:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.906+0000 7f0e3b400640 1 -- 172.21.15.5:0/1477731480 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c00eab0 con 0x7f0e441572d0 2024-08-17T02:47:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.906+0000 7f0e3b400640 1 -- 172.21.15.5:0/1477731480 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c00ee70 con 0x7f0e441572d0 2024-08-17T02:47:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.906+0000 7f0e4a800640 1 -- 172.21.15.5:0/1477731480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e44155c70 con 0x7f0e441572d0 2024-08-17T02:47:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.906+0000 7f0e4a800640 1 -- 172.21.15.5:0/1477731480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e44156230 con 0x7f0e441572d0 2024-08-17T02:47:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.907+0000 7f0e4a800640 1 -- 172.21.15.5:0/1477731480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e44063fb0 con 0x7f0e441572d0 2024-08-17T02:47:13.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.908+0000 7f0e3b400640 1 -- 172.21.15.5:0/1477731480 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0e3c001790 con 0x7f0e441572d0 2024-08-17T02:47:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.909+0000 7f0e3b400640 1 --2- 172.21.15.5:0/1477731480 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0e20065220 0x7f0e200676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.909+0000 7f0e3b400640 1 -- 172.21.15.5:0/1477731480 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e3c0815f0 con 0x7f0e441572d0 2024-08-17T02:47:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.909+0000 7f0e43400640 1 --2- 172.21.15.5:0/1477731480 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0e20065220 0x7f0e200676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.910+0000 7f0e43400640 1 --2- 172.21.15.5:0/1477731480 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0e20065220 0x7f0e200676d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e34032000 tx=0x7f0e34033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:13.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:13.913+0000 7f0e3b400640 1 -- 172.21.15.5:0/1477731480 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0e3c04f740 con 0x7f0e441572d0 2024-08-17T02:47:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.098+0000 7f0e4a800640 1 -- 172.21.15.5:0/1477731480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e44067b70 con 0x7f0e441572d0 2024-08-17T02:47:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.099+0000 7f0e3b400640 1 -- 172.21.15.5:0/1477731480 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0e3c052d60 con 0x7f0e441572d0 2024-08-17T02:47:14.099 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:47:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.100+0000 7f0e4a800640 1 -- 172.21.15.5:0/1477731480 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0e20065220 msgr2=0x7f0e200676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.101+0000 7f0e4a800640 1 --2- 172.21.15.5:0/1477731480 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0e20065220 0x7f0e200676d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e34032000 tx=0x7f0e34033000 comp rx=0 tx=0).stop 2024-08-17T02:47:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.101+0000 7f0e4a800640 1 -- 172.21.15.5:0/1477731480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e441572d0 msgr2=0x7f0e44157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.101+0000 7f0e4a800640 1 --2- 172.21.15.5:0/1477731480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e441572d0 0x7f0e44157770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0e44159480 tx=0x7f0e3c009040 comp rx=0 tx=0).stop 2024-08-17T02:47:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.101+0000 7f0e4a800640 1 -- 172.21.15.5:0/1477731480 shutdown_connections 2024-08-17T02:47:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.101+0000 7f0e4a800640 1 --2- 172.21.15.5:0/1477731480 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0e20065220 0x7f0e200676d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.101+0000 7f0e4a800640 1 --2- 172.21.15.5:0/1477731480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e441572d0 0x7f0e44157770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.101+0000 7f0e4a800640 1 --2- 172.21.15.5:0/1477731480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e44169a10 0x7f0e44155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.101+0000 7f0e4a800640 1 --2- 172.21.15.5:0/1477731480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e28003a20 0x7f0e4414b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.101+0000 7f0e4a800640 1 -- 172.21.15.5:0/1477731480 >> 172.21.15.5:0/1477731480 conn(0x7f0e44066e60 msgr2=0x7f0e4406a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.101+0000 7f0e4a800640 1 -- 172.21.15.5:0/1477731480 shutdown_connections 2024-08-17T02:47:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.101+0000 7f0e4a800640 1 -- 172.21.15.5:0/1477731480 wait complete. 2024-08-17T02:47:14.115 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:47:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.271+0000 7fd917200640 1 Processor -- start 2024-08-17T02:47:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.271+0000 7fd917200640 1 -- start start 2024-08-17T02:47:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.272+0000 7fd917200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9100cb0d0 0x7fd910158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.272+0000 7fd917200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd9100cda30 0x7fd9100cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.272+0000 7fd917200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9100af9a0 con 0x7fd9101589e0 2024-08-17T02:47:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.272+0000 7fd917200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9100af810 con 0x7fd9100cda30 2024-08-17T02:47:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.272+0000 7fd917200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100ce740 con 0x7fd9100cb0d0 2024-08-17T02:47:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.272+0000 7fd90fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd9101589e0 0x7fd9100ca9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42240/0 (socket says 172.21.15.5:42240) 2024-08-17T02:47:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.272+0000 7fd90fe00640 1 -- 172.21.15.5:0/205929558 learned_addr learned my addr 172.21.15.5:0/205929558 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd915200640 1 --2- 172.21.15.5:0/205929558 >> v2:172.21.15.107:3300/0 conn(0x7fd9100cda30 0x7fd9100cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd907e00640 1 --2- 172.21.15.5:0/205929558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9100cb0d0 0x7fd910158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd90f400640 1 -- 172.21.15.5:0/205929558 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097243257 0 0) 0x7fd9100af9a0 con 0x7fd9101589e0 2024-08-17T02:47:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd90f400640 1 -- 172.21.15.5:0/205929558 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8f40034e0 con 0x7fd9101589e0 2024-08-17T02:47:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd90f400640 1 -- 172.21.15.5:0/205929558 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3262772915 0 0) 0x7fd8f40034e0 con 0x7fd9101589e0 2024-08-17T02:47:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd90f400640 1 -- 172.21.15.5:0/205929558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9100cb0d0 msgr2=0x7fd910158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd90f400640 1 --2- 172.21.15.5:0/205929558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9100cb0d0 0x7fd910158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd90f400640 1 -- 172.21.15.5:0/205929558 >> v2:172.21.15.107:3300/0 conn(0x7fd9100cda30 msgr2=0x7fd9100cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd90f400640 1 --2- 172.21.15.5:0/205929558 >> v2:172.21.15.107:3300/0 conn(0x7fd9100cda30 0x7fd9100cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd90f400640 1 -- 172.21.15.5:0/205929558 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9100cea00 con 0x7fd9101589e0 2024-08-17T02:47:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd90f400640 1 -- 172.21.15.5:0/205929558 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7fd900001470 con 0x7fd9101589e0 2024-08-17T02:47:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd915200640 1 --2- 172.21.15.5:0/205929558 >> v2:172.21.15.107:3300/0 conn(0x7fd9100cda30 0x7fd9100cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd907e00640 1 --2- 172.21.15.5:0/205929558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9100cb0d0 0x7fd910158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd90f400640 1 -- 172.21.15.5:0/205929558 >> v1:172.21.15.5:6789/0 conn(0x7fd9101589e0 legacy=0x7fd9100ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd90f400640 1 --2- 172.21.15.5:0/205929558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9100cb0d0 0x7fd8f40039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd90f400640 1 --2- 172.21.15.5:0/205929558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8f4003f10 0x7fd8f4004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd90f400640 1 --2- 172.21.15.5:0/205929558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f4004cc0 0x7fd8f4005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd90f400640 1 -- 172.21.15.5:0/205929558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100af810 con 0x7fd8f4003f10 2024-08-17T02:47:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd90f400640 1 -- 172.21.15.5:0/205929558 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100ce740 con 0x7fd8f4004cc0 2024-08-17T02:47:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.273+0000 7fd90f400640 1 -- 172.21.15.5:0/205929558 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f400b9d0 con 0x7fd9100cb0d0 2024-08-17T02:47:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.274+0000 7fd907e00640 1 --2- 172.21.15.5:0/205929558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8f4003f10 0x7fd8f4004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.274+0000 7fd90fe00640 1 --2- 172.21.15.5:0/205929558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9100cb0d0 0x7fd8f40039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.274+0000 7fd915200640 1 --2- 172.21.15.5:0/205929558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f4004cc0 0x7fd8f4005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.274+0000 7fd907e00640 1 -- 172.21.15.5:0/205929558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9100cb0d0 msgr2=0x7fd8f40039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.274+0000 7fd907e00640 1 --2- 172.21.15.5:0/205929558 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9100cb0d0 0x7fd8f40039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.274+0000 7fd907e00640 1 -- 172.21.15.5:0/205929558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f4004cc0 msgr2=0x7fd8f4005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.274+0000 7fd907e00640 1 --2- 172.21.15.5:0/205929558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f4004cc0 0x7fd8f4005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.274+0000 7fd907e00640 1 -- 172.21.15.5:0/205929558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f8009390 con 0x7fd8f4003f10 2024-08-17T02:47:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.274+0000 7fd915200640 1 --2- 172.21.15.5:0/205929558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8f4004cc0 0x7fd8f4005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.275+0000 7fd907e00640 1 --2- 172.21.15.5:0/205929558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8f4003f10 0x7fd8f4004780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009d60 tx=0x7fd8f80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39290ddc882f418 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.275+0000 7fd90f400640 1 -- 172.21.15.5:0/205929558 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8031400 con 0x7fd8f4003f10 2024-08-17T02:47:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.275+0000 7fd90f400640 1 -- 172.21.15.5:0/205929558 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f802d050 con 0x7fd8f4003f10 2024-08-17T02:47:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.275+0000 7fd90f400640 1 -- 172.21.15.5:0/205929558 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8031770 con 0x7fd8f4003f10 2024-08-17T02:47:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.276+0000 7fd917200640 1 -- 172.21.15.5:0/205929558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8f4003f10 msgr2=0x7fd8f4004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.276+0000 7fd917200640 1 --2- 172.21.15.5:0/205929558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8f4003f10 0x7fd8f4004780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009d60 tx=0x7fd8f80090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.276+0000 7fd915200640 1 -- 172.21.15.5:0/205929558 reap_dead start 2024-08-17T02:47:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.276+0000 7fd917200640 1 -- 172.21.15.5:0/205929558 shutdown_connections 2024-08-17T02:47:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.276+0000 7fd917200640 1 -- 172.21.15.5:0/205929558 >> 172.21.15.5:0/205929558 conn(0x7fd91006e590 msgr2=0x7fd91006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.276+0000 7fd917200640 1 -- 172.21.15.5:0/205929558 shutdown_connections 2024-08-17T02:47:14.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.276+0000 7fd917200640 1 -- 172.21.15.5:0/205929558 wait complete. 2024-08-17T02:47:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.277+0000 7fd917200640 1 Processor -- start 2024-08-17T02:47:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.277+0000 7fd917200640 1 -- start start 2024-08-17T02:47:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.278+0000 7fd917200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8f4003f10 0x7fd91015af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.278+0000 7fd917200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd910153750 0x7fd91014b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.278+0000 7fd917200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9100b0360 0x7fd9100b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.278+0000 7fd917200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9101699b0 con 0x7fd8f4003f10 2024-08-17T02:47:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.278+0000 7fd917200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100b0d20 con 0x7fd910153750 2024-08-17T02:47:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.278+0000 7fd917200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd910169bc0 con 0x7fd9100b0360 2024-08-17T02:47:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.278+0000 7fd90fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8f4003f10 0x7fd91015af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.278+0000 7fd90fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8f4003f10 0x7fd91015af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33766/0 (socket says 172.21.15.5:33766) 2024-08-17T02:47:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.279+0000 7fd90fe00640 1 -- 172.21.15.5:0/1000765104 learned_addr learned my addr 172.21.15.5:0/1000765104 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:14.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.279+0000 7fd907e00640 1 --2- 172.21.15.5:0/1000765104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd910153750 0x7fd91014b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.279+0000 7fd915200640 1 --2- 172.21.15.5:0/1000765104 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9100b0360 0x7fd9100b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.279+0000 7fd90fe00640 1 -- 172.21.15.5:0/1000765104 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9100b0360 msgr2=0x7fd9100b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.279+0000 7fd90fe00640 1 --2- 172.21.15.5:0/1000765104 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9100b0360 0x7fd9100b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.279+0000 7fd90fe00640 1 -- 172.21.15.5:0/1000765104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd910153750 msgr2=0x7fd91014b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.279+0000 7fd90fe00640 1 --2- 172.21.15.5:0/1000765104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd910153750 0x7fd91014b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.279+0000 7fd90fe00640 1 -- 172.21.15.5:0/1000765104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd910169ea0 con 0x7fd8f4003f10 2024-08-17T02:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.279+0000 7fd90fe00640 1 --2- 172.21.15.5:0/1000765104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8f4003f10 0x7fd91015af10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd900001050 tx=0x7fd900001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.279+0000 7fd907400640 1 -- 172.21.15.5:0/1000765104 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900018030 con 0x7fd8f4003f10 2024-08-17T02:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.279+0000 7fd907400640 1 -- 172.21.15.5:0/1000765104 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90000f940 con 0x7fd8f4003f10 2024-08-17T02:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.279+0000 7fd907400640 1 -- 172.21.15.5:0/1000765104 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900001bf0 con 0x7fd8f4003f10 2024-08-17T02:47:14.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.279+0000 7fd917200640 1 -- 172.21.15.5:0/1000765104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91016a180 con 0x7fd8f4003f10 2024-08-17T02:47:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.280+0000 7fd917200640 1 -- 172.21.15.5:0/1000765104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91016a740 con 0x7fd8f4003f10 2024-08-17T02:47:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.281+0000 7fd917200640 1 -- 172.21.15.5:0/1000765104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91016a990 con 0x7fd8f4003f10 2024-08-17T02:47:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.281+0000 7fd907400640 1 -- 172.21.15.5:0/1000765104 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd90001b070 con 0x7fd8f4003f10 2024-08-17T02:47:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.282+0000 7fd907400640 1 --2- 172.21.15.5:0/1000765104 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd8ec065150 0x7fd8ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.282+0000 7fd907400640 1 -- 172.21.15.5:0/1000765104 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd900019070 con 0x7fd8f4003f10 2024-08-17T02:47:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.282+0000 7fd907e00640 1 --2- 172.21.15.5:0/1000765104 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd8ec065150 0x7fd8ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.283+0000 7fd907e00640 1 --2- 172.21.15.5:0/1000765104 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd8ec065150 0x7fd8ec067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8034000 tx=0x7fd8f8035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.286+0000 7fd907400640 1 -- 172.21.15.5:0/1000765104 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd900050360 con 0x7fd8f4003f10 2024-08-17T02:47:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.466+0000 7fd917200640 1 -- 172.21.15.5:0/1000765104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd910063fb0 con 0x7fd8f4003f10 2024-08-17T02:47:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.467+0000 7fd907400640 1 -- 172.21.15.5:0/1000765104 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd900053980 con 0x7fd8f4003f10 2024-08-17T02:47:14.467 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:47:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.469+0000 7fd917200640 1 -- 172.21.15.5:0/1000765104 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd8ec065150 msgr2=0x7fd8ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.469+0000 7fd917200640 1 --2- 172.21.15.5:0/1000765104 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd8ec065150 0x7fd8ec067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8034000 tx=0x7fd8f8035000 comp rx=0 tx=0).stop 2024-08-17T02:47:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.469+0000 7fd917200640 1 -- 172.21.15.5:0/1000765104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8f4003f10 msgr2=0x7fd91015af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.469+0000 7fd917200640 1 --2- 172.21.15.5:0/1000765104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8f4003f10 0x7fd91015af10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd900001050 tx=0x7fd900001e90 comp rx=0 tx=0).stop 2024-08-17T02:47:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.469+0000 7fd917200640 1 -- 172.21.15.5:0/1000765104 shutdown_connections 2024-08-17T02:47:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.469+0000 7fd917200640 1 --2- 172.21.15.5:0/1000765104 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd8ec065150 0x7fd8ec067600 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.469+0000 7fd917200640 1 --2- 172.21.15.5:0/1000765104 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9100b0360 0x7fd9100b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.469+0000 7fd917200640 1 --2- 172.21.15.5:0/1000765104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd910153750 0x7fd91014b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.469+0000 7fd917200640 1 --2- 172.21.15.5:0/1000765104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8f4003f10 0x7fd91015af10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.469+0000 7fd917200640 1 -- 172.21.15.5:0/1000765104 >> 172.21.15.5:0/1000765104 conn(0x7fd91006e590 msgr2=0x7fd9101549e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.469+0000 7fd917200640 1 -- 172.21.15.5:0/1000765104 shutdown_connections 2024-08-17T02:47:14.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.469+0000 7fd917200640 1 -- 172.21.15.5:0/1000765104 wait complete. 2024-08-17T02:47:14.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:14.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.634+0000 7f79fb200640 1 Processor -- start 2024-08-17T02:47:14.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.635+0000 7f79fb200640 1 -- start start 2024-08-17T02:47:14.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.636+0000 7f79fb200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79f4158990 0x7f79f40ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.636+0000 7f79fb200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f79f4158d60 0x7f79f40af590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.636+0000 7f79fb200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f40ce930 con 0x7f79f40cd810 2024-08-17T02:47:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.636+0000 7f79fb200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f40cdd20 con 0x7f79f4158d60 2024-08-17T02:47:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.636+0000 7f79fb200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40ce000 con 0x7f79f4158990 2024-08-17T02:47:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.636+0000 7f79f9e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79f4158990 0x7f79f40ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.636+0000 7f79f9e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79f4158990 0x7f79f40ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:59534/0 (socket says 172.21.15.5:59534) 2024-08-17T02:47:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.636+0000 7f79f9e00640 1 -- 172.21.15.5:0/865804716 learned_addr learned my addr 172.21.15.5:0/865804716 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.636+0000 7f79fa800640 1 --2- 172.21.15.5:0/865804716 >> v2:172.21.15.107:3300/0 conn(0x7f79f4158d60 0x7f79f40af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.637+0000 7f79f9e00640 1 -- 172.21.15.5:0/865804716 >> v2:172.21.15.107:3300/0 conn(0x7f79f4158d60 msgr2=0x7f79f40af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.637+0000 7f79f9e00640 1 --2- 172.21.15.5:0/865804716 >> v2:172.21.15.107:3300/0 conn(0x7f79f4158d60 0x7f79f40af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.637+0000 7f79f9e00640 1 -- 172.21.15.5:0/865804716 >> v1:172.21.15.107:6789/0 conn(0x7f79f40cd810 legacy=0x7f79f40cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.637+0000 7f79f9e00640 1 -- 172.21.15.5:0/865804716 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f40ce2e0 con 0x7f79f4158990 2024-08-17T02:47:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.637+0000 7f79f8a00640 1 -- 172.21.15.5:0/865804716 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100824122 0 0) 0x7f79f40ce930 con 0x7f79f40cd810 2024-08-17T02:47:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.638+0000 7f79f9e00640 1 --2- 172.21.15.5:0/865804716 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79f4158990 0x7f79f40ca210 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009910 tx=0x7f79e80091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1330e7e1930117f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.638+0000 7f79f8a00640 1 -- 172.21.15.5:0/865804716 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8032440 con 0x7f79f4158990 2024-08-17T02:47:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.638+0000 7f79f8a00640 1 -- 172.21.15.5:0/865804716 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e80325a0 con 0x7f79f4158990 2024-08-17T02:47:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.638+0000 7f79f8a00640 1 -- 172.21.15.5:0/865804716 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8032940 con 0x7f79f4158990 2024-08-17T02:47:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.639+0000 7f79fb200640 1 -- 172.21.15.5:0/865804716 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79f4158990 msgr2=0x7f79f40ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.639+0000 7f79fb200640 1 --2- 172.21.15.5:0/865804716 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79f4158990 0x7f79f40ca210 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009910 tx=0x7f79e80091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.639+0000 7f79fb200640 1 -- 172.21.15.5:0/865804716 shutdown_connections 2024-08-17T02:47:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.639+0000 7f79fb200640 1 --2- 172.21.15.5:0/865804716 >> v2:172.21.15.107:3300/0 conn(0x7f79f4158d60 0x7f79f40af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.639+0000 7f79fb200640 1 --2- 172.21.15.5:0/865804716 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79f4158990 0x7f79f40ca210 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.639+0000 7f79fb200640 1 -- 172.21.15.5:0/865804716 >> 172.21.15.5:0/865804716 conn(0x7f79f406e590 msgr2=0x7f79f406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.639+0000 7f79fb200640 1 -- 172.21.15.5:0/865804716 shutdown_connections 2024-08-17T02:47:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.639+0000 7f79fb200640 1 -- 172.21.15.5:0/865804716 wait complete. 2024-08-17T02:47:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.640+0000 7f79fb200640 1 Processor -- start 2024-08-17T02:47:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.640+0000 7f79fb200640 1 -- start start 2024-08-17T02:47:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.641+0000 7f79fb200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79f40cd810 0x7f79f415b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.641+0000 7f79fb200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f4158990 0x7f79f4152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.641+0000 7f79fb200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79f4158d60 0x7f79f41530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.641+0000 7f79fb200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f4169100 con 0x7f79f4158990 2024-08-17T02:47:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.641+0000 7f79fb200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f416d670 con 0x7f79f40cd810 2024-08-17T02:47:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.641+0000 7f79fb200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f4169c10 con 0x7f79f4158d60 2024-08-17T02:47:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.641+0000 7f79f9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f4158990 0x7f79f4152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.641+0000 7f79f9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f4158990 0x7f79f4152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33772/0 (socket says 172.21.15.5:33772) 2024-08-17T02:47:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.641+0000 7f79f9400640 1 -- 172.21.15.5:0/3512325300 learned_addr learned my addr 172.21.15.5:0/3512325300 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.642+0000 7f79f9e00640 1 --2- 172.21.15.5:0/3512325300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79f40cd810 0x7f79f415b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.642+0000 7f79fa800640 1 --2- 172.21.15.5:0/3512325300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79f4158d60 0x7f79f41530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.642+0000 7f79f9400640 1 -- 172.21.15.5:0/3512325300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79f4158d60 msgr2=0x7f79f41530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.642+0000 7f79f9400640 1 --2- 172.21.15.5:0/3512325300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79f4158d60 0x7f79f41530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.642+0000 7f79f9400640 1 -- 172.21.15.5:0/3512325300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79f40cd810 msgr2=0x7f79f415b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.642+0000 7f79f9400640 1 --2- 172.21.15.5:0/3512325300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79f40cd810 0x7f79f415b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.642+0000 7f79f9400640 1 -- 172.21.15.5:0/3512325300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e8009450 con 0x7f79f4158990 2024-08-17T02:47:14.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.642+0000 7f79f9400640 1 --2- 172.21.15.5:0/3512325300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f4158990 0x7f79f4152b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f79e400c5b0 tx=0x7f79e4007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.642+0000 7f79ed600640 1 -- 172.21.15.5:0/3512325300 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4012630 con 0x7f79f4158990 2024-08-17T02:47:14.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.642+0000 7f79ed600640 1 -- 172.21.15.5:0/3512325300 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e40127d0 con 0x7f79f4158990 2024-08-17T02:47:14.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.642+0000 7f79ed600640 1 -- 172.21.15.5:0/3512325300 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4012b90 con 0x7f79f4158990 2024-08-17T02:47:14.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.642+0000 7f79fb200640 1 -- 172.21.15.5:0/3512325300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f416a0a0 con 0x7f79f4158990 2024-08-17T02:47:14.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.643+0000 7f79fb200640 1 -- 172.21.15.5:0/3512325300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f41695c0 con 0x7f79f4158990 2024-08-17T02:47:14.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.644+0000 7f79fb200640 1 -- 172.21.15.5:0/3512325300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f4169dc0 con 0x7f79f4158990 2024-08-17T02:47:14.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.644+0000 7f79ed600640 1 -- 172.21.15.5:0/3512325300 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f79e401b400 con 0x7f79f4158990 2024-08-17T02:47:14.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.646+0000 7f79ed600640 1 --2- 172.21.15.5:0/3512325300 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f79d8065150 0x7f79d8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.646+0000 7f79ed600640 1 -- 172.21.15.5:0/3512325300 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f79e4081f80 con 0x7f79f4158990 2024-08-17T02:47:14.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.646+0000 7f79f9e00640 1 --2- 172.21.15.5:0/3512325300 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f79d8065150 0x7f79d8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.647+0000 7f79f9e00640 1 --2- 172.21.15.5:0/3512325300 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f79d8065150 0x7f79d8067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f79e8034000 tx=0x7f79e8032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.649+0000 7f79ed600640 1 -- 172.21.15.5:0/3512325300 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f79f4169dc0 con 0x7f79f4158990 2024-08-17T02:47:14.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.869+0000 7f79fb200640 1 -- 172.21.15.5:0/3512325300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79f4169d80 con 0x7f79f4158990 2024-08-17T02:47:14.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.870+0000 7f79ed600640 1 -- 172.21.15.5:0/3512325300 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f79e4050050 con 0x7f79f4158990 2024-08-17T02:47:14.870 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:14.871 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/3624354828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3624354828},{"type":"v1","addr":"172.21.15.5:6836","nonce":3624354828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2614098803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2614098803},{"type":"v1","addr":"172.21.15.107:6835","nonce":2614098803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1090239725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1090239725},{"type":"v1","addr":"172.21.15.5:6837","nonce":1090239725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:57.590268+0000","modified":"2024-08-17T02:47:01.184380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6834/2631760450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2631760450},{"type":"v1","addr":"172.21.15.107:6834","nonce":2631760450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:47:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-08-17T02:47:14.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.872+0000 7f79fb200640 1 -- 172.21.15.5:0/3512325300 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f79d8065150 msgr2=0x7f79d8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.872+0000 7f79fb200640 1 --2- 172.21.15.5:0/3512325300 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f79d8065150 0x7f79d8067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f79e8034000 tx=0x7f79e8032000 comp rx=0 tx=0).stop 2024-08-17T02:47:14.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.872+0000 7f79fb200640 1 -- 172.21.15.5:0/3512325300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f4158990 msgr2=0x7f79f4152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.872+0000 7f79fb200640 1 --2- 172.21.15.5:0/3512325300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f4158990 0x7f79f4152b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f79e400c5b0 tx=0x7f79e4007d60 comp rx=0 tx=0).stop 2024-08-17T02:47:14.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.872+0000 7f79fb200640 1 -- 172.21.15.5:0/3512325300 shutdown_connections 2024-08-17T02:47:14.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.872+0000 7f79fb200640 1 --2- 172.21.15.5:0/3512325300 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f79d8065150 0x7f79d8067600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.872+0000 7f79fb200640 1 --2- 172.21.15.5:0/3512325300 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79f4158d60 0x7f79f41530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.872+0000 7f79fb200640 1 --2- 172.21.15.5:0/3512325300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79f4158990 0x7f79f4152b60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.872+0000 7f79fb200640 1 --2- 172.21.15.5:0/3512325300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79f40cd810 0x7f79f415b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.872+0000 7f79fb200640 1 -- 172.21.15.5:0/3512325300 >> 172.21.15.5:0/3512325300 conn(0x7f79f406e590 msgr2=0x7f79f40685c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:14.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.872+0000 7f79fb200640 1 -- 172.21.15.5:0/3512325300 shutdown_connections 2024-08-17T02:47:14.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:14.872+0000 7f79fb200640 1 -- 172.21.15.5:0/3512325300 wait complete. 2024-08-17T02:47:14.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.037+0000 7fb759000640 1 Processor -- start 2024-08-17T02:47:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.037+0000 7fb759000640 1 -- start start 2024-08-17T02:47:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.039+0000 7fb759000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb7540afca0 0x7fb7540b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.039+0000 7fb759000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb7541590b0 0x7fb754159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.039+0000 7fb759000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75415a4e0 con 0x7fb7540acf10 2024-08-17T02:47:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.039+0000 7fb759000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7540b0980 con 0x7fb7541590b0 2024-08-17T02:47:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.039+0000 7fb759000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7540c92b0 con 0x7fb7540afca0 2024-08-17T02:47:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.039+0000 7fb752800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb7541590b0 0x7fb754159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.039+0000 7fb74be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb7540acf10 0x7fb7541589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42244/0 (socket says 172.21.15.5:42244) 2024-08-17T02:47:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.039+0000 7fb74be00640 1 -- 172.21.15.5:0/1552030932 learned_addr learned my addr 172.21.15.5:0/1552030932 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.039+0000 7fb751e00640 1 --2- 172.21.15.5:0/1552030932 >> v2:172.21.15.107:3300/0 conn(0x7fb7540afca0 0x7fb7540b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.039+0000 7fb752800640 1 -- 172.21.15.5:0/1552030932 >> v2:172.21.15.107:3300/0 conn(0x7fb7540afca0 msgr2=0x7fb7540b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.039+0000 7fb752800640 1 --2- 172.21.15.5:0/1552030932 >> v2:172.21.15.107:3300/0 conn(0x7fb7540afca0 0x7fb7540b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.039+0000 7fb752800640 1 -- 172.21.15.5:0/1552030932 >> v1:172.21.15.5:6789/0 conn(0x7fb7540acf10 legacy=0x7fb7541589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.039+0000 7fb752800640 1 -- 172.21.15.5:0/1552030932 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7540ad480 con 0x7fb7541590b0 2024-08-17T02:47:15.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.039+0000 7fb751400640 1 -- 172.21.15.5:0/1552030932 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217722767 0 0) 0x7fb73c001110 con 0x7fb7540acf10 2024-08-17T02:47:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.040+0000 7fb752800640 1 --2- 172.21.15.5:0/1552030932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7541590b0 0x7fb754159fa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb754067e40 tx=0x7fb74c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c841e4cd9c4bd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.041+0000 7fb751400640 1 -- 172.21.15.5:0/1552030932 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c007550 con 0x7fb7541590b0 2024-08-17T02:47:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.041+0000 7fb751400640 1 -- 172.21.15.5:0/1552030932 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c02d050 con 0x7fb7541590b0 2024-08-17T02:47:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.041+0000 7fb751400640 1 -- 172.21.15.5:0/1552030932 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c0078e0 con 0x7fb7541590b0 2024-08-17T02:47:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.041+0000 7fb759000640 1 -- 172.21.15.5:0/1552030932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7541590b0 msgr2=0x7fb754159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.041+0000 7fb759000640 1 --2- 172.21.15.5:0/1552030932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7541590b0 0x7fb754159fa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb754067e40 tx=0x7fb74c009780 comp rx=0 tx=0).stop 2024-08-17T02:47:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.041+0000 7fb759000640 1 -- 172.21.15.5:0/1552030932 shutdown_connections 2024-08-17T02:47:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.041+0000 7fb759000640 1 --2- 172.21.15.5:0/1552030932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7541590b0 0x7fb754159fa0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.041+0000 7fb759000640 1 --2- 172.21.15.5:0/1552030932 >> v2:172.21.15.107:3300/0 conn(0x7fb7540afca0 0x7fb7540b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.041+0000 7fb759000640 1 -- 172.21.15.5:0/1552030932 >> 172.21.15.5:0/1552030932 conn(0x7fb754066e60 msgr2=0x7fb754067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.041+0000 7fb759000640 1 -- 172.21.15.5:0/1552030932 shutdown_connections 2024-08-17T02:47:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.041+0000 7fb759000640 1 -- 172.21.15.5:0/1552030932 wait complete. 2024-08-17T02:47:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.043+0000 7fb759000640 1 Processor -- start 2024-08-17T02:47:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.043+0000 7fb759000640 1 -- start start 2024-08-17T02:47:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.043+0000 7fb759000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540acf10 0x7fb7540abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb759000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7540afca0 0x7fb7540c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb759000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7541590b0 0x7fb7540c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb759000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7540c62c0 con 0x7fb7540afca0 2024-08-17T02:47:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb759000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7540c56b0 con 0x7fb7541590b0 2024-08-17T02:47:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb759000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7540c5990 con 0x7fb7540acf10 2024-08-17T02:47:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb74be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7540afca0 0x7fb7540c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb74be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7540afca0 0x7fb7540c4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33796/0 (socket says 172.21.15.5:33796) 2024-08-17T02:47:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb74be00640 1 -- 172.21.15.5:0/4025381832 learned_addr learned my addr 172.21.15.5:0/4025381832 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb751e00640 1 --2- 172.21.15.5:0/4025381832 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540acf10 0x7fb7540abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb752800640 1 --2- 172.21.15.5:0/4025381832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7541590b0 0x7fb7540c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb74be00640 1 -- 172.21.15.5:0/4025381832 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540acf10 msgr2=0x7fb7540abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb74be00640 1 --2- 172.21.15.5:0/4025381832 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540acf10 0x7fb7540abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb74be00640 1 -- 172.21.15.5:0/4025381832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7541590b0 msgr2=0x7fb7540c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb74be00640 1 --2- 172.21.15.5:0/4025381832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7541590b0 0x7fb7540c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb74be00640 1 -- 172.21.15.5:0/4025381832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c009a20 con 0x7fb7540afca0 2024-08-17T02:47:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb751e00640 1 --2- 172.21.15.5:0/4025381832 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540acf10 0x7fb7540abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb752800640 1 --2- 172.21.15.5:0/4025381832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7541590b0 0x7fb7540c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.044+0000 7fb74be00640 1 --2- 172.21.15.5:0/4025381832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7540afca0 0x7fb7540c4bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00c510 tx=0x7fb73c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.045+0000 7fb749600640 1 -- 172.21.15.5:0/4025381832 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c005aa0 con 0x7fb7540afca0 2024-08-17T02:47:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.045+0000 7fb749600640 1 -- 172.21.15.5:0/4025381832 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c005c00 con 0x7fb7540afca0 2024-08-17T02:47:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.045+0000 7fb749600640 1 -- 172.21.15.5:0/4025381832 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c0070d0 con 0x7fb7540afca0 2024-08-17T02:47:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.045+0000 7fb759000640 1 -- 172.21.15.5:0/4025381832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7540c5c70 con 0x7fb7540afca0 2024-08-17T02:47:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.045+0000 7fb759000640 1 -- 172.21.15.5:0/4025381832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb754169800 con 0x7fb7540afca0 2024-08-17T02:47:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.046+0000 7fb759000640 1 -- 172.21.15.5:0/4025381832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7540c6430 con 0x7fb7540afca0 2024-08-17T02:47:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.047+0000 7fb749600640 1 -- 172.21.15.5:0/4025381832 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb73c007500 con 0x7fb7540afca0 2024-08-17T02:47:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.047+0000 7fb749600640 1 --2- 172.21.15.5:0/4025381832 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb730065150 0x7fb730067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.047+0000 7fb749600640 1 -- 172.21.15.5:0/4025381832 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb73c0818b0 con 0x7fb7540afca0 2024-08-17T02:47:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.048+0000 7fb751e00640 1 --2- 172.21.15.5:0/4025381832 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb730065150 0x7fb730067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.048+0000 7fb751e00640 1 --2- 172.21.15.5:0/4025381832 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb730065150 0x7fb730067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb7540ad9c0 tx=0x7fb744008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.051+0000 7fb749600640 1 -- 172.21.15.5:0/4025381832 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb73c04f990 con 0x7fb7540afca0 2024-08-17T02:47:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.236+0000 7fb759000640 1 -- 172.21.15.5:0/4025381832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb75415a4e0 con 0x7fb7540afca0 2024-08-17T02:47:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.237+0000 7fb749600640 1 -- 172.21.15.5:0/4025381832 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fb75415a4e0 con 0x7fb7540afca0 2024-08-17T02:47:15.238 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:15.238 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:59.170637+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:55.543347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:56.571235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.239+0000 7fb759000640 1 -- 172.21.15.5:0/4025381832 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb730065150 msgr2=0x7fb730067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.239+0000 7fb759000640 1 --2- 172.21.15.5:0/4025381832 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb730065150 0x7fb730067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb7540ad9c0 tx=0x7fb744008040 comp rx=0 tx=0).stop 2024-08-17T02:47:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.239+0000 7fb759000640 1 -- 172.21.15.5:0/4025381832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7540afca0 msgr2=0x7fb7540c4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.239+0000 7fb759000640 1 --2- 172.21.15.5:0/4025381832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7540afca0 0x7fb7540c4bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00c510 tx=0x7fb73c00c910 comp rx=0 tx=0).stop 2024-08-17T02:47:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.239+0000 7fb759000640 1 -- 172.21.15.5:0/4025381832 shutdown_connections 2024-08-17T02:47:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.239+0000 7fb759000640 1 --2- 172.21.15.5:0/4025381832 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb730065150 0x7fb730067600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.239+0000 7fb759000640 1 --2- 172.21.15.5:0/4025381832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7541590b0 0x7fb7540c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.239+0000 7fb759000640 1 --2- 172.21.15.5:0/4025381832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7540afca0 0x7fb7540c4bf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.239+0000 7fb759000640 1 --2- 172.21.15.5:0/4025381832 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7540acf10 0x7fb7540abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.239+0000 7fb759000640 1 -- 172.21.15.5:0/4025381832 >> 172.21.15.5:0/4025381832 conn(0x7fb754066e60 msgr2=0x7fb754151100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.239+0000 7fb759000640 1 -- 172.21.15.5:0/4025381832 shutdown_connections 2024-08-17T02:47:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.239+0000 7fb759000640 1 -- 172.21.15.5:0/4025381832 wait complete. 2024-08-17T02:47:15.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:15.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.405+0000 7f4fa8a00640 1 Processor -- start 2024-08-17T02:47:15.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.406+0000 7f4fa8a00640 1 -- start start 2024-08-17T02:47:15.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.407+0000 7f4fa8a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4fa4069840 0x7f4fa40cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.407+0000 7f4fa8a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4fa40cd550 0x7f4fa415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.407+0000 7f4fa8a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa415c9d0 con 0x7f4fa40cbe10 2024-08-17T02:47:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.407+0000 7f4fa8a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa415a200 con 0x7f4fa4069840 2024-08-17T02:47:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.407+0000 7f4fa8a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa40b0830 con 0x7f4fa40cd550 2024-08-17T02:47:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.407+0000 7f4fa2800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4fa4069840 0x7f4fa40cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.407+0000 7f4fa2800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4fa4069840 0x7f4fa40cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33804/0 (socket says 172.21.15.5:33804) 2024-08-17T02:47:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.407+0000 7f4fa2800640 1 -- 172.21.15.5:0/3726698739 learned_addr learned my addr 172.21.15.5:0/3726698739 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.407+0000 7f4f9be00640 1 --2- 172.21.15.5:0/3726698739 >> v2:172.21.15.107:3300/0 conn(0x7f4fa40cd550 0x7f4fa415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.408+0000 7f4fa2800640 1 -- 172.21.15.5:0/3726698739 >> v2:172.21.15.107:3300/0 conn(0x7f4fa40cd550 msgr2=0x7f4fa415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.408+0000 7f4fa2800640 1 --2- 172.21.15.5:0/3726698739 >> v2:172.21.15.107:3300/0 conn(0x7f4fa40cd550 0x7f4fa415ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.408+0000 7f4fa2800640 1 -- 172.21.15.5:0/3726698739 >> v1:172.21.15.5:6789/0 conn(0x7f4fa40cbe10 legacy=0x7f4fa409a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.408+0000 7f4fa2800640 1 -- 172.21.15.5:0/3726698739 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa40b0b10 con 0x7f4fa4069840 2024-08-17T02:47:15.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.409+0000 7f4fa2800640 1 --2- 172.21.15.5:0/3726698739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fa4069840 0x7f4fa40cb8d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4fa409b440 tx=0x7f4f940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8645776a5e01fe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.409+0000 7f4fa1e00640 1 -- 172.21.15.5:0/3726698739 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9402ae80 con 0x7f4fa4069840 2024-08-17T02:47:15.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.409+0000 7f4fa1e00640 1 -- 172.21.15.5:0/3726698739 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f94032440 con 0x7f4fa4069840 2024-08-17T02:47:15.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.409+0000 7f4fa1e00640 1 -- 172.21.15.5:0/3726698739 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f94032800 con 0x7f4fa4069840 2024-08-17T02:47:15.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.409+0000 7f4fa8a00640 1 -- 172.21.15.5:0/3726698739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fa4069840 msgr2=0x7f4fa40cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.409+0000 7f4fa8a00640 1 --2- 172.21.15.5:0/3726698739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fa4069840 0x7f4fa40cb8d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4fa409b440 tx=0x7f4f940091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.409+0000 7f4fa8a00640 1 -- 172.21.15.5:0/3726698739 shutdown_connections 2024-08-17T02:47:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.409+0000 7f4fa8a00640 1 --2- 172.21.15.5:0/3726698739 >> v2:172.21.15.107:3300/0 conn(0x7f4fa40cd550 0x7f4fa415ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.409+0000 7f4fa8a00640 1 --2- 172.21.15.5:0/3726698739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fa4069840 0x7f4fa40cb8d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.409+0000 7f4fa8a00640 1 -- 172.21.15.5:0/3726698739 >> 172.21.15.5:0/3726698739 conn(0x7f4fa4066e60 msgr2=0x7f4fa4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.410+0000 7f4fa8a00640 1 -- 172.21.15.5:0/3726698739 shutdown_connections 2024-08-17T02:47:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.410+0000 7f4fa8a00640 1 -- 172.21.15.5:0/3726698739 wait complete. 2024-08-17T02:47:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.411+0000 7f4fa8a00640 1 Processor -- start 2024-08-17T02:47:15.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.411+0000 7f4fa8a00640 1 -- start start 2024-08-17T02:47:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.412+0000 7f4fa8a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4fa4069840 0x7f4fa4152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.412+0000 7f4fa8a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fa40cbe10 0x7f4fa41698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.412+0000 7f4fa8a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fa4154590 0x7f4fa4168730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.412+0000 7f4fa8a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa4169de0 con 0x7f4fa4154590 2024-08-17T02:47:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.412+0000 7f4fa8a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa4168c70 con 0x7f4fa40cbe10 2024-08-17T02:47:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.412+0000 7f4fa8a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa41534f0 con 0x7f4fa4069840 2024-08-17T02:47:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.412+0000 7f4fa3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fa4154590 0x7f4fa4168730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.412+0000 7f4fa3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fa4154590 0x7f4fa4168730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33820/0 (socket says 172.21.15.5:33820) 2024-08-17T02:47:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.412+0000 7f4fa3200640 1 -- 172.21.15.5:0/1531962682 learned_addr learned my addr 172.21.15.5:0/1531962682 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.412+0000 7f4f9be00640 1 --2- 172.21.15.5:0/1531962682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fa40cbe10 0x7f4fa41698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.412+0000 7f4fa2800640 1 --2- 172.21.15.5:0/1531962682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4fa4069840 0x7f4fa4152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.413+0000 7f4fa3200640 1 -- 172.21.15.5:0/1531962682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4fa4069840 msgr2=0x7f4fa4152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.413+0000 7f4fa3200640 1 --2- 172.21.15.5:0/1531962682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4fa4069840 0x7f4fa4152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.413+0000 7f4fa3200640 1 -- 172.21.15.5:0/1531962682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fa40cbe10 msgr2=0x7f4fa41698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.413+0000 7f4fa3200640 1 --2- 172.21.15.5:0/1531962682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fa40cbe10 0x7f4fa41698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.413+0000 7f4fa3200640 1 -- 172.21.15.5:0/1531962682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f94009450 con 0x7f4fa4154590 2024-08-17T02:47:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.413+0000 7f4fa3200640 1 --2- 172.21.15.5:0/1531962682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fa4154590 0x7f4fa4168730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00c860 tx=0x7f4f9c001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.413+0000 7f4f9a000640 1 -- 172.21.15.5:0/1531962682 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00ce50 con 0x7f4fa4154590 2024-08-17T02:47:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.413+0000 7f4f9a000640 1 -- 172.21.15.5:0/1531962682 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c00a850 con 0x7f4fa4154590 2024-08-17T02:47:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.413+0000 7f4f9a000640 1 -- 172.21.15.5:0/1531962682 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00ac10 con 0x7f4fa4154590 2024-08-17T02:47:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.413+0000 7f4fa8a00640 1 -- 172.21.15.5:0/1531962682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa41537d0 con 0x7f4fa4154590 2024-08-17T02:47:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.413+0000 7f4fa8a00640 1 -- 172.21.15.5:0/1531962682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa4153d90 con 0x7f4fa4154590 2024-08-17T02:47:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.414+0000 7f4fa8a00640 1 -- 172.21.15.5:0/1531962682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa409b470 con 0x7f4fa4154590 2024-08-17T02:47:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.415+0000 7f4f9a000640 1 -- 172.21.15.5:0/1531962682 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4f9c012630 con 0x7f4fa4154590 2024-08-17T02:47:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.416+0000 7f4f9a000640 1 --2- 172.21.15.5:0/1531962682 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4f80065150 0x7f4f80067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.417+0000 7f4f9a000640 1 -- 172.21.15.5:0/1531962682 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f9c0825e0 con 0x7f4fa4154590 2024-08-17T02:47:15.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.417+0000 7f4fa2800640 1 --2- 172.21.15.5:0/1531962682 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4f80065150 0x7f4f80067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.417+0000 7f4fa2800640 1 --2- 172.21.15.5:0/1531962682 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4f80065150 0x7f4f80067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4f94034000 tx=0x7f4f94032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.420+0000 7f4f9a000640 1 -- 172.21.15.5:0/1531962682 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4f9c0506b0 con 0x7f4fa4154590 2024-08-17T02:47:15.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.637+0000 7f4fa8a00640 1 -- 172.21.15.5:0/1531962682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fa4070700 con 0x7f4fa4154590 2024-08-17T02:47:15.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.638+0000 7f4f9a000640 1 -- 172.21.15.5:0/1531962682 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f4f9c053cd0 con 0x7f4fa4154590 2024-08-17T02:47:15.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:15.639 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/3624354828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3624354828},{"type":"v1","addr":"172.21.15.5:6836","nonce":3624354828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2614098803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2614098803},{"type":"v1","addr":"172.21.15.107:6835","nonce":2614098803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1090239725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1090239725},{"type":"v1","addr":"172.21.15.5:6837","nonce":1090239725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:57.590268+0000","modified":"2024-08-17T02:47:01.184380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6834/2631760450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2631760450},{"type":"v1","addr":"172.21.15.107:6834","nonce":2631760450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:47:15.639 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-08-17T02:47:15.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.640+0000 7f4fa8a00640 1 -- 172.21.15.5:0/1531962682 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4f80065150 msgr2=0x7f4f80067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.640+0000 7f4fa8a00640 1 --2- 172.21.15.5:0/1531962682 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4f80065150 0x7f4f80067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4f94034000 tx=0x7f4f94032000 comp rx=0 tx=0).stop 2024-08-17T02:47:15.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.640+0000 7f4fa8a00640 1 -- 172.21.15.5:0/1531962682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fa4154590 msgr2=0x7f4fa4168730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.640+0000 7f4fa8a00640 1 --2- 172.21.15.5:0/1531962682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fa4154590 0x7f4fa4168730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00c860 tx=0x7f4f9c001690 comp rx=0 tx=0).stop 2024-08-17T02:47:15.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.640+0000 7f4fa8a00640 1 -- 172.21.15.5:0/1531962682 shutdown_connections 2024-08-17T02:47:15.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.640+0000 7f4fa8a00640 1 --2- 172.21.15.5:0/1531962682 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4f80065150 0x7f4f80067600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.640+0000 7f4fa8a00640 1 --2- 172.21.15.5:0/1531962682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fa4154590 0x7f4fa4168730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.640+0000 7f4fa8a00640 1 --2- 172.21.15.5:0/1531962682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fa40cbe10 0x7f4fa41698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.640+0000 7f4fa8a00640 1 --2- 172.21.15.5:0/1531962682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4fa4069840 0x7f4fa4152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.640+0000 7f4fa8a00640 1 -- 172.21.15.5:0/1531962682 >> 172.21.15.5:0/1531962682 conn(0x7f4fa4066e60 msgr2=0x7f4fa4155360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:15.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.640+0000 7f4fa8a00640 1 -- 172.21.15.5:0/1531962682 shutdown_connections 2024-08-17T02:47:15.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:15.640+0000 7f4fa8a00640 1 -- 172.21.15.5:0/1531962682 wait complete. 2024-08-17T02:47:16.059 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:46:57.590268+0000', 'modified': '2024-08-17T02:47:01.184380+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.107:6834/2631760450', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6832', 'nonce': 2631760450}, {'type': 'v1', 'addr': '172.21.15.107:6834', 'nonce': 2631760450}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:47:16.059 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:47:16.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-17T02:47:16.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.217+0000 7f45c3200640 1 Processor -- start 2024-08-17T02:47:16.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.217+0000 7f45c3200640 1 -- start start 2024-08-17T02:47:16.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.218+0000 7f45c3200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45c40ae540 0x7f45c4068950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.218+0000 7f45c3200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45c40af020 0x7f45c4162730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.218+0000 7f45c3200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c40aab10 con 0x7f45c4068e90 2024-08-17T02:47:16.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.218+0000 7f45c3200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c40abfb0 con 0x7f45c40ae540 2024-08-17T02:47:16.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.218+0000 7f45c3200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40ac250 con 0x7f45c40af020 2024-08-17T02:47:16.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.218+0000 7f45c1e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45c40ae540 0x7f45c4068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.218+0000 7f45c1e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45c40ae540 0x7f45c4068950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38372/0 (socket says 172.21.15.5:38372) 2024-08-17T02:47:16.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.218+0000 7f45c1e00640 1 -- 172.21.15.5:0/890982075 learned_addr learned my addr 172.21.15.5:0/890982075 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:16.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.218+0000 7f45c2800640 1 --2- 172.21.15.5:0/890982075 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45c40af020 0x7f45c4162730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.219+0000 7f45c1e00640 1 -- 172.21.15.5:0/890982075 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45c40af020 msgr2=0x7f45c4162730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.219+0000 7f45c1e00640 1 --2- 172.21.15.5:0/890982075 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45c40af020 0x7f45c4162730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.219+0000 7f45c1e00640 1 -- 172.21.15.5:0/890982075 >> v1:172.21.15.5:6789/0 conn(0x7f45c4068e90 legacy=0x7f45c40ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.219+0000 7f45c1e00640 1 -- 172.21.15.5:0/890982075 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c40693e0 con 0x7f45c40ae540 2024-08-17T02:47:16.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.220+0000 7f45c1e00640 1 --2- 172.21.15.5:0/890982075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c40ae540 0x7f45c4068950 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009910 tx=0x7f45b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d840630778ac54 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.220+0000 7f45c1400640 1 -- 172.21.15.5:0/890982075 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b402add0 con 0x7f45c40ae540 2024-08-17T02:47:16.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.220+0000 7f45c1400640 1 -- 172.21.15.5:0/890982075 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b4032440 con 0x7f45c40ae540 2024-08-17T02:47:16.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.220+0000 7f45c1400640 1 -- 172.21.15.5:0/890982075 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4032820 con 0x7f45c40ae540 2024-08-17T02:47:16.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.220+0000 7f45c3200640 1 -- 172.21.15.5:0/890982075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c40ae540 msgr2=0x7f45c4068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.220+0000 7f45c3200640 1 --2- 172.21.15.5:0/890982075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c40ae540 0x7f45c4068950 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009910 tx=0x7f45b40091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.221+0000 7f45c3200640 1 -- 172.21.15.5:0/890982075 shutdown_connections 2024-08-17T02:47:16.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.221+0000 7f45c3200640 1 --2- 172.21.15.5:0/890982075 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45c40af020 0x7f45c4162730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.221+0000 7f45c3200640 1 --2- 172.21.15.5:0/890982075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c40ae540 0x7f45c4068950 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.221+0000 7f45c3200640 1 -- 172.21.15.5:0/890982075 >> 172.21.15.5:0/890982075 conn(0x7f45c40ce400 msgr2=0x7f45c4095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.221+0000 7f45c3200640 1 -- 172.21.15.5:0/890982075 shutdown_connections 2024-08-17T02:47:16.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.221+0000 7f45c3200640 1 -- 172.21.15.5:0/890982075 wait complete. 2024-08-17T02:47:16.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.222+0000 7f45c3200640 1 Processor -- start 2024-08-17T02:47:16.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.222+0000 7f45c3200640 1 -- start start 2024-08-17T02:47:16.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.223+0000 7f45c3200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45c4068e90 0x7f45c4145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.223+0000 7f45c3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c40ae540 0x7f45c4146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.223+0000 7f45c3200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45c40af020 0x7f45c409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.223+0000 7f45c3200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4099980 con 0x7f45c40ae540 2024-08-17T02:47:16.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.223+0000 7f45c3200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4098d70 con 0x7f45c4068e90 2024-08-17T02:47:16.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.223+0000 7f45c3200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4099050 con 0x7f45c40af020 2024-08-17T02:47:16.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.223+0000 7f45bbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c40ae540 0x7f45c4146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.223+0000 7f45bbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c40ae540 0x7f45c4146520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38388/0 (socket says 172.21.15.5:38388) 2024-08-17T02:47:16.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.223+0000 7f45bbe00640 1 -- 172.21.15.5:0/728348319 learned_addr learned my addr 172.21.15.5:0/728348319 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:16.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.223+0000 7f45c2800640 1 --2- 172.21.15.5:0/728348319 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45c40af020 0x7f45c409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.223+0000 7f45c1e00640 1 --2- 172.21.15.5:0/728348319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45c4068e90 0x7f45c4145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.224+0000 7f45bbe00640 1 -- 172.21.15.5:0/728348319 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45c40af020 msgr2=0x7f45c409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.224+0000 7f45bbe00640 1 --2- 172.21.15.5:0/728348319 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45c40af020 0x7f45c409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.224+0000 7f45bbe00640 1 -- 172.21.15.5:0/728348319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45c4068e90 msgr2=0x7f45c4145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.224+0000 7f45bbe00640 1 --2- 172.21.15.5:0/728348319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45c4068e90 0x7f45c4145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.224+0000 7f45bbe00640 1 -- 172.21.15.5:0/728348319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4009450 con 0x7f45c40ae540 2024-08-17T02:47:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.224+0000 7f45bbe00640 1 --2- 172.21.15.5:0/728348319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c40ae540 0x7f45c4146520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00c4c0 tx=0x7f45ac007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.224+0000 7f45b9600640 1 -- 172.21.15.5:0/728348319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac011590 con 0x7f45c40ae540 2024-08-17T02:47:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.224+0000 7f45b9600640 1 -- 172.21.15.5:0/728348319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac011710 con 0x7f45c40ae540 2024-08-17T02:47:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.224+0000 7f45b9600640 1 -- 172.21.15.5:0/728348319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac011ad0 con 0x7f45c40ae540 2024-08-17T02:47:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.224+0000 7f45c3200640 1 -- 172.21.15.5:0/728348319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c4099330 con 0x7f45c40ae540 2024-08-17T02:47:16.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.224+0000 7f45c3200640 1 -- 172.21.15.5:0/728348319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c41460b0 con 0x7f45c40ae540 2024-08-17T02:47:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.226+0000 7f45b9600640 1 -- 172.21.15.5:0/728348319 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f45ac01b3b0 con 0x7f45c40ae540 2024-08-17T02:47:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.227+0000 7f45b9600640 1 --2- 172.21.15.5:0/728348319 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f45a0065150 0x7f45a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.227+0000 7f45b9600640 1 -- 172.21.15.5:0/728348319 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45ac081900 con 0x7f45c40ae540 2024-08-17T02:47:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.227+0000 7f45c1e00640 1 --2- 172.21.15.5:0/728348319 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f45a0065150 0x7f45a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.228+0000 7f45cb46c740 1 Processor -- start 2024-08-17T02:47:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.228+0000 7f45c1e00640 1 --2- 172.21.15.5:0/728348319 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f45a0065150 0x7f45a0067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f45b4034000 tx=0x7f45b4032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.228+0000 7f45cb46c740 1 -- start start 2024-08-17T02:47:16.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45cb46c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddb83bc0 0x55a0ddb83f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45cb46c740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb5f230 0x55a0ddba1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45cb46c740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddba1ca0 0x55a0ddb58a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45cb46c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0ddb19380 con 0x55a0ddb83bc0 2024-08-17T02:47:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45cb46c740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0ddac29e0 con 0x55a0ddb5f230 2024-08-17T02:47:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45cb46c740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0ddac0170 con 0x55a0ddba1ca0 2024-08-17T02:47:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45c1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddb83bc0 0x55a0ddb83f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45c1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddb83bc0 0x55a0ddb83f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38392/0 (socket says 172.21.15.5:38392) 2024-08-17T02:47:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45c1e00640 1 -- 172.21.15.5:0/2790743621 learned_addr learned my addr 172.21.15.5:0/2790743621 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45bbe00640 1 --2- 172.21.15.5:0/2790743621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb5f230 0x55a0ddba1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45c2800640 1 --2- 172.21.15.5:0/2790743621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddba1ca0 0x55a0ddb58a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45c1e00640 1 -- 172.21.15.5:0/2790743621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddba1ca0 msgr2=0x55a0ddb58a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45c1e00640 1 --2- 172.21.15.5:0/2790743621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddba1ca0 0x55a0ddb58a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45c1e00640 1 -- 172.21.15.5:0/2790743621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb5f230 msgr2=0x55a0ddba1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45c1e00640 1 --2- 172.21.15.5:0/2790743621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb5f230 0x55a0ddba1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45c1e00640 1 -- 172.21.15.5:0/2790743621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0dda6f820 con 0x55a0ddb83bc0 2024-08-17T02:47:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.229+0000 7f45c2800640 1 --2- 172.21.15.5:0/2790743621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddba1ca0 0x55a0ddb58a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:16.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.230+0000 7f45c1e00640 1 --2- 172.21.15.5:0/2790743621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddb83bc0 0x55a0ddb83f90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009940 tx=0x7f45b403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd02061e2bbb35fa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.230+0000 7f45b2000640 1 -- 172.21.15.5:0/2790743621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b403c9c0 con 0x55a0ddb83bc0 2024-08-17T02:47:16.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.230+0000 7f45b2000640 1 -- 172.21.15.5:0/2790743621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b403cb20 con 0x55a0ddb83bc0 2024-08-17T02:47:16.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.230+0000 7f45b2000640 1 -- 172.21.15.5:0/2790743621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4051460 con 0x55a0ddb83bc0 2024-08-17T02:47:16.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.231+0000 7f45cb46c740 1 -- 172.21.15.5:0/2790743621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddb83bc0 msgr2=0x55a0ddb83f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.231+0000 7f45cb46c740 1 --2- 172.21.15.5:0/2790743621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddb83bc0 0x55a0ddb83f90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009940 tx=0x7f45b403d000 comp rx=0 tx=0).stop 2024-08-17T02:47:16.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.231+0000 7f45cb46c740 1 -- 172.21.15.5:0/2790743621 shutdown_connections 2024-08-17T02:47:16.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.231+0000 7f45cb46c740 1 --2- 172.21.15.5:0/2790743621 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddba1ca0 0x55a0ddb58a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.231+0000 7f45cb46c740 1 --2- 172.21.15.5:0/2790743621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb5f230 0x55a0ddba1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.231+0000 7f45cb46c740 1 --2- 172.21.15.5:0/2790743621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddb83bc0 0x55a0ddb83f90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.231+0000 7f45cb46c740 1 -- 172.21.15.5:0/2790743621 >> 172.21.15.5:0/2790743621 conn(0x55a0ddaf7030 msgr2=0x55a0ddba5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.231+0000 7f45cb46c740 1 -- 172.21.15.5:0/2790743621 shutdown_connections 2024-08-17T02:47:16.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.231+0000 7f45cb46c740 1 -- 172.21.15.5:0/2790743621 wait complete. 2024-08-17T02:47:16.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.231+0000 7f45cb46c740 1 -- start start 2024-08-17T02:47:16.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.232+0000 7f45cb46c740 1 Processor -- start 2024-08-17T02:47:16.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45cb46c740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 0x55a0ddb83290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45cb46c740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb83bc0 0x55a0ddb58fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45cb46c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddb594f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45cb46c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0ddabbf60 con 0x55a0ddba1ca0 2024-08-17T02:47:16.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45cb46c740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0dda64690 con 0x55a0ddb83bc0 2024-08-17T02:47:16.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45cb46c740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0dda64330 con 0x55a0ddb5f230 2024-08-17T02:47:16.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45cb46c740 10 client.0 _ll_register_callbacks cb 0x55a0dda5e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:47:16.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45c2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddb594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45c2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddb594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38408/0 (socket says 172.21.15.5:38408) 2024-08-17T02:47:16.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45c2800640 1 -- 172.21.15.5:0/855188243 learned_addr learned my addr 172.21.15.5:0/855188243 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:16.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45c1e00640 1 --2- 172.21.15.5:0/855188243 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 0x55a0ddb83290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45bbe00640 1 --2- 172.21.15.5:0/855188243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb83bc0 0x55a0ddb58fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45c2800640 1 -- 172.21.15.5:0/855188243 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 msgr2=0x55a0ddb83290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45c2800640 1 --2- 172.21.15.5:0/855188243 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 0x55a0ddb83290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45c2800640 1 -- 172.21.15.5:0/855188243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb83bc0 msgr2=0x55a0ddb58fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45c2800640 1 --2- 172.21.15.5:0/855188243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb83bc0 0x55a0ddb58fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.233+0000 7f45c2800640 1 -- 172.21.15.5:0/855188243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c40693e0 con 0x55a0ddba1ca0 2024-08-17T02:47:16.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.234+0000 7f45c2800640 1 --2- 172.21.15.5:0/855188243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddb594f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f45bc007bf0 tx=0x7f45bc009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2ff1f80cae7cfa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.234+0000 7f45a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-17T02:47:16.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.234+0000 7f45a6a00640 1 -- 172.21.15.5:0/855188243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc002c60 con 0x55a0ddba1ca0 2024-08-17T02:47:16.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.234+0000 7f45a6a00640 1 -- 172.21.15.5:0/855188243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45bc002dc0 con 0x55a0ddba1ca0 2024-08-17T02:47:16.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.234+0000 7f45cb46c740 1 -- 172.21.15.5:0/855188243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a0ddaefd20 con 0x55a0ddba1ca0 2024-08-17T02:47:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.234+0000 7f45a6a00640 1 -- 172.21.15.5:0/855188243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45bc016610 con 0x55a0ddba1ca0 2024-08-17T02:47:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.234+0000 7f45cb46c740 10 client.4623 fetch_fsmap learned FSMap version 7 2024-08-17T02:47:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.234+0000 7f45cb46c740 1 -- 172.21.15.5:0/855188243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a0dda85ab0 con 0x55a0ddba1ca0 2024-08-17T02:47:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.234+0000 7f45a6a00640 1 -- 172.21.15.5:0/855188243 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a0ddaefd20 con 0x55a0ddba1ca0 2024-08-17T02:47:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.235+0000 7f45a6a00640 1 -- 172.21.15.5:0/855188243 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f45bc016770 con 0x55a0ddba1ca0 2024-08-17T02:47:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.235+0000 7f45cb46c740 10 client.4623 fetch_fsmap finished waiting for FSMap version 7 2024-08-17T02:47:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.235+0000 7f45cb46c740 10 client.4623 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:47:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.235+0000 7f45cb46c740 20 client.4623 populate_metadata read hostname 'smithi005' 2024-08-17T02:47:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.235+0000 7f45cb46c740 1 --2- 172.21.15.5:0/855188243 >> [v2:172.21.15.107:6832/2631760450,v1:172.21.15.107:6834/2631760450] conn(0x55a0ddb9fde0 0x55a0ddba2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.235+0000 7f45cb46c740 4 client.4623 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:47:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.235+0000 7f45cb46c740 1 -- 172.21.15.5:0/855188243 --> [v2:172.21.15.107:6832/2631760450,v1:172.21.15.107:6834/2631760450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a0dd7c33c0 con 0x55a0ddb9fde0 2024-08-17T02:47:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.235+0000 7f45c1e00640 1 --2- 172.21.15.5:0/855188243 >> [v2:172.21.15.107:6832/2631760450,v1:172.21.15.107:6834/2631760450] conn(0x55a0ddb9fde0 0x55a0ddba2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.236+0000 7f45c1e00640 1 --2- 172.21.15.5:0/855188243 >> [v2:172.21.15.107:6832/2631760450,v1:172.21.15.107:6834/2631760450] conn(0x55a0ddb9fde0 0x55a0ddba2e80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef0d71fbfb3aae30 server_cookie=9e75ea4624fa39f7 in_seq=0 out_seq=0 2024-08-17T02:47:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.236+0000 7f45a6a00640 10 client.4623 ms_handle_connect on v2:172.21.15.107:6832/2631760450 2024-08-17T02:47:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.237+0000 7f45a6a00640 1 -- 172.21.15.5:0/855188243 <== mds.0 v2:172.21.15.107:6832/2631760450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x55a0dd7c33c0 con 0x55a0ddb9fde0 2024-08-17T02:47:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.237+0000 7f45a6a00640 10 client.4623 handle_command_reply: tid=0 2024-08-17T02:47:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.237+0000 7f45cb46c740 1 client.4623 shutdown 2024-08-17T02:47:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.237+0000 7f45cb46c740 1 -- 172.21.15.5:0/855188243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 msgr2=0x55a0ddb594f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.237+0000 7f45cb46c740 1 --2- 172.21.15.5:0/855188243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddb594f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f45bc007bf0 tx=0x7f45bc009850 comp rx=0 tx=0).stop 2024-08-17T02:47:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.237+0000 7f45cb46c740 1 -- 172.21.15.5:0/855188243 shutdown_connections 2024-08-17T02:47:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.237+0000 7f45cb46c740 1 --2- 172.21.15.5:0/855188243 >> [v2:172.21.15.107:6832/2631760450,v1:172.21.15.107:6834/2631760450] conn(0x55a0ddb9fde0 0x55a0ddba2e80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.237+0000 7f45cb46c740 1 --2- 172.21.15.5:0/855188243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddb594f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.237+0000 7f45cb46c740 1 --2- 172.21.15.5:0/855188243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb83bc0 0x55a0ddb58fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.237+0000 7f45cb46c740 1 --2- 172.21.15.5:0/855188243 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 0x55a0ddb83290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.237+0000 7f45a6a00640 0 client.4623 ms_handle_reset on v2:172.21.15.107:6832/2631760450 2024-08-17T02:47:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.237+0000 7f45cb46c740 1 -- 172.21.15.5:0/855188243 >> 172.21.15.5:0/855188243 conn(0x55a0ddaf7030 msgr2=0x55a0ddba5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.237+0000 7f45cb46c740 1 -- 172.21.15.5:0/855188243 shutdown_connections 2024-08-17T02:47:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.237+0000 7f45cb46c740 1 -- 172.21.15.5:0/855188243 wait complete. 2024-08-17T02:47:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.237+0000 7f45cb46c740 20 client.4623 trim_cache size 0 max 16384 2024-08-17T02:47:16.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.253+0000 7f45cb46c740 1 Processor -- start 2024-08-17T02:47:16.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.253+0000 7f45cb46c740 1 -- start start 2024-08-17T02:47:16.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.254+0000 7f45cb46c740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 0x55a0ddba4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.254+0000 7f45cb46c740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb83bc0 0x55a0ddba4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.254+0000 7f45cb46c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddba5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.254+0000 7f45cb46c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0dd836f20 con 0x55a0ddba1ca0 2024-08-17T02:47:16.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.254+0000 7f45cb46c740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0ddb9f860 con 0x55a0ddb83bc0 2024-08-17T02:47:16.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.254+0000 7f45cb46c740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0ddba51b0 con 0x55a0ddb5f230 2024-08-17T02:47:16.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.254+0000 7f45c2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddba5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.254+0000 7f45c1e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 0x55a0ddba4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.254+0000 7f45bbe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb83bc0 0x55a0ddba4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.254+0000 7f45c1e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 0x55a0ddba4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:38396/0 (socket says 172.21.15.5:38396) 2024-08-17T02:47:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.254+0000 7f45c2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddba5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38414/0 (socket says 172.21.15.5:38414) 2024-08-17T02:47:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.254+0000 7f45c2800640 1 -- 172.21.15.5:0/2290399086 learned_addr learned my addr 172.21.15.5:0/2290399086 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.255+0000 7f45c2800640 1 -- 172.21.15.5:0/2290399086 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 msgr2=0x55a0ddba4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.255+0000 7f45c2800640 1 --2- 172.21.15.5:0/2290399086 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 0x55a0ddba4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.255+0000 7f45c2800640 1 -- 172.21.15.5:0/2290399086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb83bc0 msgr2=0x55a0ddba4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.255+0000 7f45c2800640 1 --2- 172.21.15.5:0/2290399086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb83bc0 0x55a0ddba4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.255+0000 7f45c2800640 1 -- 172.21.15.5:0/2290399086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0dda89490 con 0x55a0ddba1ca0 2024-08-17T02:47:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.255+0000 7f45bbe00640 1 --2- 172.21.15.5:0/2290399086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb83bc0 0x55a0ddba4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.255+0000 7f45c1e00640 1 --2- 172.21.15.5:0/2290399086 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 0x55a0ddba4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.255+0000 7f45c2800640 1 --2- 172.21.15.5:0/2290399086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddba5b80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0094a0 tx=0x7f45bc01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02d3cff734cd033 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.257+0000 7f45b2a00640 1 -- 172.21.15.5:0/2290399086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc0020c0 con 0x55a0ddba1ca0 2024-08-17T02:47:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.257+0000 7f45b2a00640 1 -- 172.21.15.5:0/2290399086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc00d020 con 0x55a0ddba1ca0 2024-08-17T02:47:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.257+0000 7f45b2a00640 1 -- 172.21.15.5:0/2290399086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc002eb0 con 0x55a0ddba1ca0 2024-08-17T02:47:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.258+0000 7f45cb46c740 1 -- 172.21.15.5:0/2290399086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 msgr2=0x55a0ddba5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.258+0000 7f45cb46c740 1 --2- 172.21.15.5:0/2290399086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddba5b80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0094a0 tx=0x7f45bc01c000 comp rx=0 tx=0).stop 2024-08-17T02:47:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.258+0000 7f45cb46c740 1 -- 172.21.15.5:0/2290399086 shutdown_connections 2024-08-17T02:47:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.258+0000 7f45cb46c740 1 --2- 172.21.15.5:0/2290399086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddba5b80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.258+0000 7f45cb46c740 1 --2- 172.21.15.5:0/2290399086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb83bc0 0x55a0ddba4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.258+0000 7f45cb46c740 1 --2- 172.21.15.5:0/2290399086 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 0x55a0ddba4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.258+0000 7f45cb46c740 1 -- 172.21.15.5:0/2290399086 >> 172.21.15.5:0/2290399086 conn(0x55a0ddaf7030 msgr2=0x55a0ddb58fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.258+0000 7f45cb46c740 1 -- 172.21.15.5:0/2290399086 shutdown_connections 2024-08-17T02:47:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.258+0000 7f45cb46c740 1 -- 172.21.15.5:0/2290399086 wait complete. 2024-08-17T02:47:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.259+0000 7f45cb46c740 1 -- start start 2024-08-17T02:47:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.259+0000 7f45cb46c740 1 Processor -- start 2024-08-17T02:47:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.260+0000 7f45cb46c740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 0x55a0ddb5cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.260+0000 7f45cb46c740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb83bc0 0x55a0ddba5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.260+0000 7f45cb46c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddba5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.260+0000 7f45cb46c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0ddb5a180 con 0x55a0ddba1ca0 2024-08-17T02:47:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.260+0000 7f45cb46c740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0ddb82e30 con 0x55a0ddb83bc0 2024-08-17T02:47:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.260+0000 7f45cb46c740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0ddc09ea0 con 0x55a0ddb5f230 2024-08-17T02:47:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.260+0000 7f45cb46c740 10 client.0 _ll_register_callbacks cb 0x7f45bc009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:47:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.260+0000 7f45c2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddba5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.260+0000 7f45c1e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 0x55a0ddb5cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.260+0000 7f45bbe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb83bc0 0x55a0ddba5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.260+0000 7f45c2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddba5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38416/0 (socket says 172.21.15.5:38416) 2024-08-17T02:47:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.260+0000 7f45c2800640 1 -- 172.21.15.5:0/2143531825 learned_addr learned my addr 172.21.15.5:0/2143531825 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.260+0000 7f45c1e00640 1 --2- 172.21.15.5:0/2143531825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 0x55a0ddb5cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:38408/0 (socket says 172.21.15.5:38408) 2024-08-17T02:47:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.261+0000 7f45c1e00640 1 -- 172.21.15.5:0/2143531825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb83bc0 msgr2=0x55a0ddba5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.261+0000 7f45c1e00640 1 --2- 172.21.15.5:0/2143531825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb83bc0 0x55a0ddba5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.261+0000 7f45c1e00640 1 -- 172.21.15.5:0/2143531825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 msgr2=0x55a0ddba5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.261+0000 7f45c1e00640 1 --2- 172.21.15.5:0/2143531825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddba5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.261+0000 7f45c1e00640 1 -- 172.21.15.5:0/2143531825 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0dda6f820 con 0x55a0ddb5f230 2024-08-17T02:47:16.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.261+0000 7f45c2800640 1 --2- 172.21.15.5:0/2143531825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddba5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:16.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.261+0000 7f45c1e00640 1 --2- 172.21.15.5:0/2143531825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 0x55a0ddb5cc50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x55a0ddb5f6a0 tx=0x7f45b4030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd8ee89f6c5bac3c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.261+0000 7f45a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.107:3301/0 2024-08-17T02:47:16.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.261+0000 7f45a6a00640 1 -- 172.21.15.5:0/2143531825 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4060110 con 0x55a0ddb5f230 2024-08-17T02:47:16.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.261+0000 7f45cb46c740 1 -- 172.21.15.5:0/2143531825 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45b403cb20 con 0x55a0ddb5f230 2024-08-17T02:47:16.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.261+0000 7f45a6a00640 1 -- 172.21.15.5:0/2143531825 <== mon.2 v2:172.21.15.107:3301/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45b4058040 con 0x55a0ddb5f230 2024-08-17T02:47:16.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.261+0000 7f45a6a00640 1 -- 172.21.15.5:0/2143531825 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45b4051850 con 0x55a0ddb5f230 2024-08-17T02:47:16.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.262+0000 7f45cb46c740 10 client.4487 fetch_fsmap learned FSMap version 7 2024-08-17T02:47:16.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.262+0000 7f45cb46c740 1 -- 172.21.15.5:0/2143531825 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x7f45c41460b0 con 0x55a0ddb5f230 2024-08-17T02:47:16.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.262+0000 7f45a6a00640 1 -- 172.21.15.5:0/2143531825 <== mon.2 v2:172.21.15.107:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b403cb20 con 0x55a0ddb5f230 2024-08-17T02:47:16.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.262+0000 7f45a6a00640 1 -- 172.21.15.5:0/2143531825 <== mon.2 v2:172.21.15.107:3301/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f45b4044070 con 0x55a0ddb5f230 2024-08-17T02:47:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.262+0000 7f45cb46c740 10 client.4487 fetch_fsmap finished waiting for FSMap version 7 2024-08-17T02:47:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.262+0000 7f45cb46c740 10 client.4487 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:47:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.262+0000 7f45cb46c740 20 client.4487 populate_metadata read hostname 'smithi005' 2024-08-17T02:47:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.262+0000 7f45cb46c740 1 --2- 172.21.15.5:0/2143531825 >> [v2:172.21.15.107:6832/2631760450,v1:172.21.15.107:6834/2631760450] conn(0x55a0ddc08dc0 0x55a0ddc09190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.262+0000 7f45cb46c740 4 client.4487 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2024-08-17T02:47:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.262+0000 7f45cb46c740 1 -- 172.21.15.5:0/2143531825 --> [v2:172.21.15.107:6832/2631760450,v1:172.21.15.107:6834/2631760450] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a0dd7d46c0 con 0x55a0ddc08dc0 2024-08-17T02:47:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.262+0000 7f45bbe00640 1 --2- 172.21.15.5:0/2143531825 >> [v2:172.21.15.107:6832/2631760450,v1:172.21.15.107:6834/2631760450] conn(0x55a0ddc08dc0 0x55a0ddc09190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.263+0000 7f45bbe00640 1 --2- 172.21.15.5:0/2143531825 >> [v2:172.21.15.107:6832/2631760450,v1:172.21.15.107:6834/2631760450] conn(0x55a0ddc08dc0 0x55a0ddc09190 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cc6f9dbc3603d2d server_cookie=fdff22fafaaa643a in_seq=0 out_seq=0 2024-08-17T02:47:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.263+0000 7f45a6a00640 10 client.4487 ms_handle_connect on v2:172.21.15.107:6832/2631760450 2024-08-17T02:47:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.263+0000 7f45a6a00640 1 -- 172.21.15.5:0/2143531825 <== mds.0 v2:172.21.15.107:6832/2631760450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55a0dd7d46c0 con 0x55a0ddc08dc0 2024-08-17T02:47:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.263+0000 7f45a6a00640 10 client.4487 handle_command_reply: tid=0 2024-08-17T02:47:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.263+0000 7f45cb46c740 1 client.4487 shutdown 2024-08-17T02:47:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.263+0000 7f45cb46c740 1 -- 172.21.15.5:0/2143531825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 msgr2=0x55a0ddb5cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.263+0000 7f45cb46c740 1 --2- 172.21.15.5:0/2143531825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 0x55a0ddb5cc50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x55a0ddb5f6a0 tx=0x7f45b4030000 comp rx=0 tx=0).stop 2024-08-17T02:47:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.263+0000 7f45cb46c740 1 -- 172.21.15.5:0/2143531825 shutdown_connections 2024-08-17T02:47:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.263+0000 7f45cb46c740 1 --2- 172.21.15.5:0/2143531825 >> [v2:172.21.15.107:6832/2631760450,v1:172.21.15.107:6834/2631760450] conn(0x55a0ddc08dc0 0x55a0ddc09190 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.263+0000 7f45cb46c740 1 --2- 172.21.15.5:0/2143531825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0ddba1ca0 0x55a0ddba5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.263+0000 7f45a6a00640 0 client.4487 ms_handle_reset on v2:172.21.15.107:6832/2631760450 2024-08-17T02:47:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.263+0000 7f45cb46c740 1 --2- 172.21.15.5:0/2143531825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0ddb83bc0 0x55a0ddba5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.263+0000 7f45cb46c740 1 --2- 172.21.15.5:0/2143531825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55a0ddb5f230 0x55a0ddb5cc50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.263+0000 7f45cb46c740 1 -- 172.21.15.5:0/2143531825 >> 172.21.15.5:0/2143531825 conn(0x55a0ddaf7030 msgr2=0x55a0ddba3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.264+0000 7f45cb46c740 1 -- 172.21.15.5:0/2143531825 shutdown_connections 2024-08-17T02:47:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.264+0000 7f45cb46c740 1 -- 172.21.15.5:0/2143531825 wait complete. 2024-08-17T02:47:16.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.264+0000 7f45cb46c740 20 client.4487 trim_cache size 0 max 16384 2024-08-17T02:47:16.276 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:47:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3", 2024-08-17T02:47:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-17T02:47:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4291, 2024-08-17T02:47:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-17T02:47:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-17T02:47:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-17T02:47:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 18.104667320000001, 2024-08-17T02:47:16.277 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 7, 2024-08-17T02:47:16.277 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 20, 2024-08-17T02:47:16.277 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 20, 2024-08-17T02:47:16.277 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 23.250355500000001 2024-08-17T02:47:16.277 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:47:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.264+0000 7f45c3200640 1 -- 172.21.15.5:0/728348319 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f45a0065150 msgr2=0x7f45a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.264+0000 7f45c3200640 1 --2- 172.21.15.5:0/728348319 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f45a0065150 0x7f45a0067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f45b4034000 tx=0x7f45b4032000 comp rx=0 tx=0).stop 2024-08-17T02:47:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.264+0000 7f45c3200640 1 -- 172.21.15.5:0/728348319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c40ae540 msgr2=0x7f45c4146520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.264+0000 7f45c3200640 1 --2- 172.21.15.5:0/728348319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c40ae540 0x7f45c4146520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00c4c0 tx=0x7f45ac007ef0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.264+0000 7f45c3200640 1 -- 172.21.15.5:0/728348319 shutdown_connections 2024-08-17T02:47:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.264+0000 7f45c3200640 1 --2- 172.21.15.5:0/728348319 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f45a0065150 0x7f45a0067600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.264+0000 7f45c3200640 1 --2- 172.21.15.5:0/728348319 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f45c40af020 0x7f45c409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.264+0000 7f45c3200640 1 --2- 172.21.15.5:0/728348319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45c40ae540 0x7f45c4146520 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.264+0000 7f45c3200640 1 --2- 172.21.15.5:0/728348319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45c4068e90 0x7f45c4145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.264+0000 7f45c3200640 1 -- 172.21.15.5:0/728348319 >> 172.21.15.5:0/728348319 conn(0x7f45c40ce400 msgr2=0x7f45c406d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.265+0000 7f45c3200640 1 -- 172.21.15.5:0/728348319 shutdown_connections 2024-08-17T02:47:16.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:16.265+0000 7f45c3200640 1 -- 172.21.15.5:0/728348319 wait complete. 2024-08-17T02:47:16.280 INFO:teuthology.run_tasks:Running task kclient... 2024-08-17T02:47:16.305 INFO:tasks.kclient:Mounting kernel clients... 2024-08-17T02:47:16.305 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:47:16.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:16.306 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-17T02:47:16.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:16.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-08-17T02:47:16.442 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2024-08-17T02:47:16.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:47:16.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:16.445 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-17T02:47:16.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:16.481 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-08-17T02:47:16.579 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2024-08-17T02:47:16.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:47:16.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:16.582 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-08-17T02:47:16.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:16.622 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-08-17T02:47:16.725 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-08-17T02:47:16.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:47:16.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:16.729 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-08-17T02:47:16.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:16.766 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-08-17T02:47:16.866 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-08-17T02:47:16.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:47:16.869 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-08-17T02:47:16.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:47:17.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.021+0000 7fb3bb400640 1 Processor -- start 2024-08-17T02:47:17.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.021+0000 7fb3bb400640 1 -- start start 2024-08-17T02:47:17.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.022+0000 7fb3bb400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3b41590b0 0x7fb3b40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.022+0000 7fb3bb400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3b40acf10 0x7fb3b4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.022+0000 7fb3bb400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b415a4e0 con 0x7fb3b40afca0 2024-08-17T02:47:17.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.022+0000 7fb3bb400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b40b0980 con 0x7fb3b41590b0 2024-08-17T02:47:17.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.022+0000 7fb3bb400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b40c92b0 con 0x7fb3b40acf10 2024-08-17T02:47:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.023+0000 7fb3b3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3b41590b0 0x7fb3b40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.023+0000 7fb3b3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3b41590b0 0x7fb3b40b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38418/0 (socket says 172.21.15.5:38418) 2024-08-17T02:47:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.023+0000 7fb3b3e00640 1 -- 172.21.15.5:0/579553912 learned_addr learned my addr 172.21.15.5:0/579553912 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.023+0000 7fb3b9400640 1 --2- 172.21.15.5:0/579553912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3b40acf10 0x7fb3b4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.023+0000 7fb3b3e00640 1 -- 172.21.15.5:0/579553912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3b40acf10 msgr2=0x7fb3b4159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.023+0000 7fb3b3e00640 1 --2- 172.21.15.5:0/579553912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3b40acf10 0x7fb3b4159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.023+0000 7fb3b3e00640 1 -- 172.21.15.5:0/579553912 >> v1:172.21.15.107:6789/0 conn(0x7fb3b40afca0 legacy=0x7fb3b41589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.023+0000 7fb3b3e00640 1 -- 172.21.15.5:0/579553912 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b40ad480 con 0x7fb3b41590b0 2024-08-17T02:47:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.023+0000 7fb3b9400640 1 --2- 172.21.15.5:0/579553912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3b40acf10 0x7fb3b4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.024+0000 7fb3b3e00640 1 --2- 172.21.15.5:0/579553912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b41590b0 0x7fb3b40b0070 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009910 tx=0x7fb3a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2789bc12e9b6fc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.024+0000 7fb3b3400640 1 -- 172.21.15.5:0/579553912 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a002adb0 con 0x7fb3b41590b0 2024-08-17T02:47:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.024+0000 7fb3b3400640 1 -- 172.21.15.5:0/579553912 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a0032440 con 0x7fb3b41590b0 2024-08-17T02:47:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.024+0000 7fb3b3400640 1 -- 172.21.15.5:0/579553912 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0032820 con 0x7fb3b41590b0 2024-08-17T02:47:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.025+0000 7fb3bb400640 1 -- 172.21.15.5:0/579553912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b41590b0 msgr2=0x7fb3b40b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.025+0000 7fb3bb400640 1 --2- 172.21.15.5:0/579553912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b41590b0 0x7fb3b40b0070 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009910 tx=0x7fb3a00091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.025+0000 7fb3bb400640 1 -- 172.21.15.5:0/579553912 shutdown_connections 2024-08-17T02:47:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.025+0000 7fb3bb400640 1 --2- 172.21.15.5:0/579553912 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3b40acf10 0x7fb3b4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.025+0000 7fb3bb400640 1 --2- 172.21.15.5:0/579553912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b41590b0 0x7fb3b40b0070 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.025+0000 7fb3bb400640 1 -- 172.21.15.5:0/579553912 >> 172.21.15.5:0/579553912 conn(0x7fb3b4066e60 msgr2=0x7fb3b4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.025+0000 7fb3bb400640 1 -- 172.21.15.5:0/579553912 shutdown_connections 2024-08-17T02:47:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.025+0000 7fb3bb400640 1 -- 172.21.15.5:0/579553912 wait complete. 2024-08-17T02:47:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.026+0000 7fb3bb400640 1 Processor -- start 2024-08-17T02:47:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.026+0000 7fb3bb400640 1 -- start start 2024-08-17T02:47:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.027+0000 7fb3bb400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3b40acf10 0x7fb3b4144190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.027+0000 7fb3bb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b40afca0 0x7fb3b40c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.027+0000 7fb3bb400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3b41590b0 0x7fb3b40ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.027+0000 7fb3bb400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b4145480 con 0x7fb3b40afca0 2024-08-17T02:47:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.027+0000 7fb3bb400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b414aad0 con 0x7fb3b40acf10 2024-08-17T02:47:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.027+0000 7fb3bb400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b4144b50 con 0x7fb3b41590b0 2024-08-17T02:47:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.028+0000 7fb3b3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b40afca0 0x7fb3b40c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.028+0000 7fb3b3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b40afca0 0x7fb3b40c9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38420/0 (socket says 172.21.15.5:38420) 2024-08-17T02:47:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.028+0000 7fb3b3e00640 1 -- 172.21.15.5:0/2791692356 learned_addr learned my addr 172.21.15.5:0/2791692356 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.028+0000 7fb3b9400640 1 --2- 172.21.15.5:0/2791692356 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3b41590b0 0x7fb3b40ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.028+0000 7fb3b8a00640 1 --2- 172.21.15.5:0/2791692356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3b40acf10 0x7fb3b4144190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.028+0000 7fb3b3e00640 1 -- 172.21.15.5:0/2791692356 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3b41590b0 msgr2=0x7fb3b40ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.028+0000 7fb3b3e00640 1 --2- 172.21.15.5:0/2791692356 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3b41590b0 0x7fb3b40ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.028+0000 7fb3b3e00640 1 -- 172.21.15.5:0/2791692356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3b40acf10 msgr2=0x7fb3b4144190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.028+0000 7fb3b3e00640 1 --2- 172.21.15.5:0/2791692356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3b40acf10 0x7fb3b4144190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.028+0000 7fb3b3e00640 1 -- 172.21.15.5:0/2791692356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a0009450 con 0x7fb3b40afca0 2024-08-17T02:47:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.028+0000 7fb3b3e00640 1 --2- 172.21.15.5:0/2791692356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b40afca0 0x7fb3b40c9bb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009910 tx=0x7fb3a0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.029+0000 7fb3a7e00640 1 -- 172.21.15.5:0/2791692356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0031de0 con 0x7fb3b40afca0 2024-08-17T02:47:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.029+0000 7fb3a7e00640 1 -- 172.21.15.5:0/2791692356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a003d420 con 0x7fb3b40afca0 2024-08-17T02:47:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.029+0000 7fb3bb400640 1 -- 172.21.15.5:0/2791692356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b4144e30 con 0x7fb3b40afca0 2024-08-17T02:47:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.029+0000 7fb3a7e00640 1 -- 172.21.15.5:0/2791692356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a003d7e0 con 0x7fb3b40afca0 2024-08-17T02:47:17.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.029+0000 7fb3bb400640 1 -- 172.21.15.5:0/2791692356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b4145910 con 0x7fb3b40afca0 2024-08-17T02:47:17.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.030+0000 7fb3bb400640 1 -- 172.21.15.5:0/2791692356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b4158980 con 0x7fb3b40afca0 2024-08-17T02:47:17.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.031+0000 7fb3a7e00640 1 -- 172.21.15.5:0/2791692356 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb3a0039040 con 0x7fb3b40afca0 2024-08-17T02:47:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.031+0000 7fb3a7e00640 1 --2- 172.21.15.5:0/2791692356 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb394065150 0x7fb394067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.031+0000 7fb3a7e00640 1 -- 172.21.15.5:0/2791692356 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb3a00a2970 con 0x7fb3b40afca0 2024-08-17T02:47:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.032+0000 7fb3b8a00640 1 --2- 172.21.15.5:0/2791692356 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb394065150 0x7fb394067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.032+0000 7fb3b8a00640 1 --2- 172.21.15.5:0/2791692356 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb394065150 0x7fb394067600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8007fd0 tx=0x7fb3a8007e10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.036+0000 7fb3a7e00640 1 -- 172.21.15.5:0/2791692356 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb3b4158980 con 0x7fb3b40afca0 2024-08-17T02:47:17.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.258+0000 7fb3bb400640 1 -- 172.21.15.5:0/2791692356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb3b415a4e0 con 0x7fb3b40afca0 2024-08-17T02:47:17.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.258+0000 7fb3a7e00640 1 -- 172.21.15.5:0/2791692356 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb3b415a4e0 con 0x7fb3b40afca0 2024-08-17T02:47:17.259 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:47:17.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.260+0000 7fb3bb400640 1 -- 172.21.15.5:0/2791692356 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb394065150 msgr2=0x7fb394067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.260+0000 7fb3bb400640 1 --2- 172.21.15.5:0/2791692356 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb394065150 0x7fb394067600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8007fd0 tx=0x7fb3a8007e10 comp rx=0 tx=0).stop 2024-08-17T02:47:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.260+0000 7fb3bb400640 1 -- 172.21.15.5:0/2791692356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b40afca0 msgr2=0x7fb3b40c9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.260+0000 7fb3bb400640 1 --2- 172.21.15.5:0/2791692356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b40afca0 0x7fb3b40c9bb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009910 tx=0x7fb3a0032000 comp rx=0 tx=0).stop 2024-08-17T02:47:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.261+0000 7fb3bb400640 1 -- 172.21.15.5:0/2791692356 shutdown_connections 2024-08-17T02:47:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.261+0000 7fb3bb400640 1 --2- 172.21.15.5:0/2791692356 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb394065150 0x7fb394067600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.261+0000 7fb3bb400640 1 --2- 172.21.15.5:0/2791692356 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3b41590b0 0x7fb3b40ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.261+0000 7fb3bb400640 1 --2- 172.21.15.5:0/2791692356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b40afca0 0x7fb3b40c9bb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.261+0000 7fb3bb400640 1 --2- 172.21.15.5:0/2791692356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3b40acf10 0x7fb3b4144190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.261+0000 7fb3bb400640 1 -- 172.21.15.5:0/2791692356 >> 172.21.15.5:0/2791692356 conn(0x7fb3b4066e60 msgr2=0x7fb3b414eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.261+0000 7fb3bb400640 1 -- 172.21.15.5:0/2791692356 shutdown_connections 2024-08-17T02:47:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:17.261+0000 7fb3bb400640 1 -- 172.21.15.5:0/2791692356 wait complete. 2024-08-17T02:47:17.276 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:47:17.276 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:47:17.276 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-17T02:47:17.276 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:47:17.276 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:17.277 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:47:17.277 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:47:17.277 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:47:17.277 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:47:17.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:17.277 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-17T02:47:17.312 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:17.313 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:17.313 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:17.313 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:17.313 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:17.313 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:17.313 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:17.313 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:17.313 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-17T02:47:17.313 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:17.313 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:17.313 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-17T02:47:17.313 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:47:17.314 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:17.314 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-17T02:47:17.314 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:47:17.314 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42674sec preferred_lft 42674sec 2024-08-17T02:47:17.314 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-08-17T02:47:17.314 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:17.314 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:17.314 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:17.314 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-17T02:47:17.315 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:47:17.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:17.315 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:47:17.315 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:47:17.315 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:47:17.315 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2024-08-17T02:47:17.315 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2024-08-17T02:47:17.315 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:47:17.315 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:47:17.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:17.676 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:47:17.732 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-17T02:47:17.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:17.736 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-17T02:47:17.783 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-17T02:47:17.783 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:47:17.783 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:47:17.783 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:47:17.783 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:47:17.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:17.784 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:47:17.784 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:47:17.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:47:17.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:47:17.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:47:17.784 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:47:18.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:18.397 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-17T02:47:18.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:18.434 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-08-17T02:47:18.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:18.508 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:47:18.508 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:47:18.509 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:47:18.509 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:47:18.509 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:47:18.634 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:47:18.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:18.635 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:47:18.635 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:47:18.635 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:47:18.635 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:47:18.635 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:47:18.635 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:47:18.635 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:47:18.635 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:47:18.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:18.830 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:47:18.830 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:47:18.830 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-17T02:47:18.830 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:47:18.830 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:47:18.946 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:18.946 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:18.982 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:47:18.982 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:18.982 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:19.057 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:47:19.058 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:47:19.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:19.189 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:19.190 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:19.815 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:19.815 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:19.815 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-08-17T02:47:19.815 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3.cephfs=/ 2024-08-17T02:47:19.815 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.107:3300/172.21.15.107:3301" will pass to kernel 2024-08-17T02:47:19.817 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:47:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:47:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:47:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:47:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:47:19.820 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:47:19.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:19.820 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:19.878 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-08-17T02:47:19.878 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:47:20.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.028+0000 7f4ea3e00640 1 Processor -- start 2024-08-17T02:47:20.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.029+0000 7f4ea3e00640 1 -- start start 2024-08-17T02:47:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.030+0000 7f4ea3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ea415d570 0x7f4ea4163c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.030+0000 7f4ea3e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea415c9d0 con 0x7f4ea4069840 2024-08-17T02:47:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.030+0000 7f4ea3e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea415a200 con 0x7f4ea40cd550 2024-08-17T02:47:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.030+0000 7f4ea3e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea40cbfe0 con 0x7f4ea415d570 2024-08-17T02:47:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.030+0000 7f4ea2a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4ea4069840 0x7f4ea40cb8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57132/0 (socket says 172.21.15.5:57132) 2024-08-17T02:47:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.030+0000 7f4ea2a00640 1 -- 172.21.15.5:0/2429393192 learned_addr learned my addr 172.21.15.5:0/2429393192 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.030+0000 7f4ea3400640 1 --2- 172.21.15.5:0/2429393192 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ea415d570 0x7f4ea4163c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.031+0000 7f4ea2000640 1 -- 172.21.15.5:0/2429393192 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073697752 0 0) 0x7f4ea415c9d0 con 0x7f4ea4069840 2024-08-17T02:47:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.031+0000 7f4ea2000640 1 -- 172.21.15.5:0/2429393192 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e880034e0 con 0x7f4ea4069840 2024-08-17T02:47:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.031+0000 7f4ea2000640 1 -- 172.21.15.5:0/2429393192 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182672331 0 0) 0x7f4ea415a200 con 0x7f4ea40cd550 2024-08-17T02:47:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.031+0000 7f4ea2000640 1 -- 172.21.15.5:0/2429393192 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ea415c9d0 con 0x7f4ea40cd550 2024-08-17T02:47:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.031+0000 7f4ea3400640 1 -- 172.21.15.5:0/2429393192 >> v1:172.21.15.107:6789/0 conn(0x7f4ea40cd550 legacy=0x7f4ea415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.031+0000 7f4ea3400640 1 -- 172.21.15.5:0/2429393192 >> v1:172.21.15.5:6789/0 conn(0x7f4ea4069840 legacy=0x7f4ea40cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.031+0000 7f4ea3400640 1 -- 172.21.15.5:0/2429393192 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea40b0830 con 0x7f4ea415d570 2024-08-17T02:47:20.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.032+0000 7f4ea3400640 1 --2- 172.21.15.5:0/2429393192 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ea415d570 0x7f4ea4163c40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009e90 tx=0x7f4e9c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d023cee67d4fe08 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.033+0000 7f4ea2000640 1 -- 172.21.15.5:0/2429393192 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c007550 con 0x7f4ea415d570 2024-08-17T02:47:20.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.033+0000 7f4ea2000640 1 -- 172.21.15.5:0/2429393192 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c02d050 con 0x7f4ea415d570 2024-08-17T02:47:20.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.033+0000 7f4ea2000640 1 -- 172.21.15.5:0/2429393192 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0078e0 con 0x7f4ea415d570 2024-08-17T02:47:20.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.033+0000 7f4ea3e00640 1 -- 172.21.15.5:0/2429393192 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ea415d570 msgr2=0x7f4ea4163c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.033+0000 7f4ea3e00640 1 --2- 172.21.15.5:0/2429393192 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ea415d570 0x7f4ea4163c40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009e90 tx=0x7f4e9c009780 comp rx=0 tx=0).stop 2024-08-17T02:47:20.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.033+0000 7f4ea3e00640 1 -- 172.21.15.5:0/2429393192 shutdown_connections 2024-08-17T02:47:20.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.033+0000 7f4ea3e00640 1 --2- 172.21.15.5:0/2429393192 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ea415d570 0x7f4ea4163c40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.033+0000 7f4ea3e00640 1 -- 172.21.15.5:0/2429393192 >> 172.21.15.5:0/2429393192 conn(0x7f4ea4066e60 msgr2=0x7f4ea4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:20.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.033+0000 7f4ea3e00640 1 -- 172.21.15.5:0/2429393192 shutdown_connections 2024-08-17T02:47:20.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.033+0000 7f4ea3e00640 1 -- 172.21.15.5:0/2429393192 wait complete. 2024-08-17T02:47:20.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.035+0000 7f4ea3e00640 1 Processor -- start 2024-08-17T02:47:20.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.035+0000 7f4ea3e00640 1 -- start start 2024-08-17T02:47:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.036+0000 7f4ea3e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ea4069840 0x7f4ea415f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.036+0000 7f4ea3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ea415d570 0x7f4ea414e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.036+0000 7f4ea3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea415e4d0 0x7f4ea415c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.036+0000 7f4ea3e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea415bc50 con 0x7f4ea415e4d0 2024-08-17T02:47:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.036+0000 7f4ea3e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea415b320 con 0x7f4ea415d570 2024-08-17T02:47:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.036+0000 7f4ea3e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea415b600 con 0x7f4ea4069840 2024-08-17T02:47:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.036+0000 7f4ea3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea415e4d0 0x7f4ea415c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.036+0000 7f4ea3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea415e4d0 0x7f4ea415c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38422/0 (socket says 172.21.15.5:38422) 2024-08-17T02:47:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.036+0000 7f4ea2a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ea4069840 0x7f4ea415f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.036+0000 7f4ea3400640 1 -- 172.21.15.5:0/2246156853 learned_addr learned my addr 172.21.15.5:0/2246156853 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.036+0000 7f4e9be00640 1 --2- 172.21.15.5:0/2246156853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ea415d570 0x7f4ea414e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.037+0000 7f4ea3400640 1 -- 172.21.15.5:0/2246156853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ea4069840 msgr2=0x7f4ea415f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.037+0000 7f4ea3400640 1 --2- 172.21.15.5:0/2246156853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ea4069840 0x7f4ea415f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.037+0000 7f4ea3400640 1 -- 172.21.15.5:0/2246156853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ea415d570 msgr2=0x7f4ea414e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.037+0000 7f4ea3400640 1 --2- 172.21.15.5:0/2246156853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ea415d570 0x7f4ea414e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.037+0000 7f4ea3400640 1 -- 172.21.15.5:0/2246156853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c009a20 con 0x7f4ea415e4d0 2024-08-17T02:47:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.037+0000 7f4ea3400640 1 --2- 172.21.15.5:0/2246156853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea415e4d0 0x7f4ea415c0e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009de0 tx=0x7f4e9c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.037+0000 7f4e9a000640 1 -- 172.21.15.5:0/2246156853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c031ac0 con 0x7f4ea415e4d0 2024-08-17T02:47:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.037+0000 7f4e9a000640 1 -- 172.21.15.5:0/2246156853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c031c20 con 0x7f4ea415e4d0 2024-08-17T02:47:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.037+0000 7f4ea3e00640 1 -- 172.21.15.5:0/2246156853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea415b8e0 con 0x7f4ea415e4d0 2024-08-17T02:47:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.037+0000 7f4e9a000640 1 -- 172.21.15.5:0/2246156853 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c03c420 con 0x7f4ea415e4d0 2024-08-17T02:47:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.037+0000 7f4ea3e00640 1 -- 172.21.15.5:0/2246156853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea415c620 con 0x7f4ea415e4d0 2024-08-17T02:47:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.038+0000 7f4ea3e00640 1 -- 172.21.15.5:0/2246156853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea415c840 con 0x7f4ea415e4d0 2024-08-17T02:47:20.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.039+0000 7f4e9a000640 1 -- 172.21.15.5:0/2246156853 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4e9c03c830 con 0x7f4ea415e4d0 2024-08-17T02:47:20.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.040+0000 7f4e9a000640 1 --2- 172.21.15.5:0/2246156853 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4e80065150 0x7f4e80067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.040+0000 7f4e9a000640 1 -- 172.21.15.5:0/2246156853 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e9c0a3440 con 0x7f4ea415e4d0 2024-08-17T02:47:20.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.040+0000 7f4ea2a00640 1 --2- 172.21.15.5:0/2246156853 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4e80065150 0x7f4e80067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.041+0000 7f4ea2a00640 1 --2- 172.21.15.5:0/2246156853 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4e80065150 0x7f4e80067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4e94005840 tx=0x7f4e94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.044+0000 7f4e9a000640 1 -- 172.21.15.5:0/2246156853 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4e9c071510 con 0x7f4ea415e4d0 2024-08-17T02:47:20.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.265+0000 7f4ea3e00640 1 -- 172.21.15.5:0/2246156853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4ea4070720 con 0x7f4ea415e4d0 2024-08-17T02:47:20.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.265+0000 7f4e9a000640 1 -- 172.21.15.5:0/2246156853 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4e9c074b30 con 0x7f4ea415e4d0 2024-08-17T02:47:20.266 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:47:20.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.267+0000 7f4ea3e00640 1 -- 172.21.15.5:0/2246156853 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4e80065150 msgr2=0x7f4e80067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.267+0000 7f4ea3e00640 1 --2- 172.21.15.5:0/2246156853 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4e80065150 0x7f4e80067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4e94005840 tx=0x7f4e94009040 comp rx=0 tx=0).stop 2024-08-17T02:47:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.267+0000 7f4ea3e00640 1 -- 172.21.15.5:0/2246156853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea415e4d0 msgr2=0x7f4ea415c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.267+0000 7f4ea3e00640 1 --2- 172.21.15.5:0/2246156853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea415e4d0 0x7f4ea415c0e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009de0 tx=0x7f4e9c037000 comp rx=0 tx=0).stop 2024-08-17T02:47:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.267+0000 7f4ea3e00640 1 -- 172.21.15.5:0/2246156853 shutdown_connections 2024-08-17T02:47:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.267+0000 7f4ea3e00640 1 --2- 172.21.15.5:0/2246156853 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4e80065150 0x7f4e80067600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.267+0000 7f4ea3e00640 1 --2- 172.21.15.5:0/2246156853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ea415e4d0 0x7f4ea415c0e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.267+0000 7f4ea3e00640 1 --2- 172.21.15.5:0/2246156853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ea415d570 0x7f4ea414e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.267+0000 7f4ea3e00640 1 --2- 172.21.15.5:0/2246156853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ea4069840 0x7f4ea415f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.267+0000 7f4ea3e00640 1 -- 172.21.15.5:0/2246156853 >> 172.21.15.5:0/2246156853 conn(0x7f4ea4066e60 msgr2=0x7f4ea40686e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.267+0000 7f4ea3e00640 1 -- 172.21.15.5:0/2246156853 shutdown_connections 2024-08-17T02:47:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:20.267+0000 7f4ea3e00640 1 -- 172.21.15.5:0/2246156853 wait complete. 2024-08-17T02:47:20.283 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:47:20.283 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:47:20.284 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-17T02:47:20.284 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:47:20.284 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:47:20.284 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:47:20.284 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:47:20.284 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:47:20.284 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:47:20.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:20.284 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-17T02:47:20.320 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:20.321 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-17T02:47:20.321 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-17T02:47:20.322 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:47:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-17T02:47:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:47:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42671sec preferred_lft 42671sec 2024-08-17T02:47:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-08-17T02:47:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:20.322 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-17T02:47:20.322 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 6e:4d:a5:1f:ec:1a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:47:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::4874:feff:febd:3c70/64 scope link 2024-08-17T02:47:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:20.323 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:47:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 6e:4d:a5:1f:ec:1a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:47:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::6c4d:a5ff:fe1f:ec1a/64 scope link tentative 2024-08-17T02:47:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:20.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:20.323 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:47:20.415 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-17T02:47:20.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:20.418 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-17T02:47:20.454 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-17T02:47:20.455 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:47:20.455 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:47:20.455 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:47:20.455 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:47:20.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:20.458 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:47:20.458 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:47:20.458 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:47:20.458 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:47:20.458 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:47:20.458 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:47:20.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:20.602 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-17T02:47:20.637 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:47:20.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:20.637 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-08-17T02:47:20.712 INFO:teuthology.orchestra.run.smithi005.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:47:20.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:20.713 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:47:20.713 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:47:20.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:47:20.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:47:20.713 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:47:20.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:20.840 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:47:20.896 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:20.897 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 76:11:1f:b8:11:af brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:47:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:47:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::7411:1fff:feb8:11af/64 scope link 2024-08-17T02:47:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:20.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:20.899 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:47:20.954 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:20.955 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 76:11:1f:b8:11:af brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:47:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:47:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::7411:1fff:feb8:11af/64 scope link 2024-08-17T02:47:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:20.957 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:47:20.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:20.957 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:47:20.958 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:47:20.958 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:47:20.958 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:47:20.958 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:47:20.958 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:47:20.958 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:47:20.958 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:47:21.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:21.125 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:47:21.125 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:47:21.125 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.1 up 2024-08-17T02:47:21.125 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:47:21.125 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:47:21.241 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:21.241 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:47:21.277 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:47:21.277 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:21.277 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:47:21.352 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-08-17T02:47:21.353 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:47:21.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:21.475 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:21.476 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:21.503 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:21.503 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:21.503 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-08-17T02:47:21.503 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 2@c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3.cephfs=/ 2024-08-17T02:47:21.503 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.5:3300/172.21.15.107:3300/172.21.15.107:3301" will pass to kernel 2024-08-17T02:47:21.504 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-08-17T02:47:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:47:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:47:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:47:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:47:21.507 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:47:21.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:21.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:47:21.563 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-08-17T02:47:21.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:47:21.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.713+0000 7f9e6ce00640 1 Processor -- start 2024-08-17T02:47:21.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.713+0000 7f9e6ce00640 1 -- start start 2024-08-17T02:47:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.714+0000 7f9e6ce00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e68155040 0x7f9e68158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.714+0000 7f9e6ce00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9e681591c0 0x7f9e6806e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.714+0000 7f9e6ce00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e680aeeb0 con 0x7f9e6806e5a0 2024-08-17T02:47:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.714+0000 7f9e6ce00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e68159610 con 0x7f9e68155040 2024-08-17T02:47:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.715+0000 7f9e6ce00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e680aadd0 con 0x7f9e681591c0 2024-08-17T02:47:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.715+0000 7f9e65e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e68155040 0x7f9e68158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.715+0000 7f9e65e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e68155040 0x7f9e68158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38430/0 (socket says 172.21.15.5:38430) 2024-08-17T02:47:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.715+0000 7f9e65e00640 1 -- 172.21.15.5:0/1677175134 learned_addr learned my addr 172.21.15.5:0/1677175134 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.715+0000 7f9e5fe00640 1 --2- 172.21.15.5:0/1677175134 >> v2:172.21.15.107:3300/0 conn(0x7f9e681591c0 0x7f9e6806e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.715+0000 7f9e65e00640 1 -- 172.21.15.5:0/1677175134 >> v2:172.21.15.107:3300/0 conn(0x7f9e681591c0 msgr2=0x7f9e6806e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.715+0000 7f9e65e00640 1 --2- 172.21.15.5:0/1677175134 >> v2:172.21.15.107:3300/0 conn(0x7f9e681591c0 0x7f9e6806e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.715+0000 7f9e65e00640 1 -- 172.21.15.5:0/1677175134 >> v1:172.21.15.107:6789/0 conn(0x7f9e6806e5a0 legacy=0x7f9e680ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.715+0000 7f9e65e00640 1 -- 172.21.15.5:0/1677175134 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6806e9c0 con 0x7f9e68155040 2024-08-17T02:47:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.716+0000 7f9e65e00640 1 --2- 172.21.15.5:0/1677175134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68155040 0x7f9e68158c80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9e680ae620 tx=0x7f9e580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81d95bc3c303c92 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.717+0000 7f9e65400640 1 -- 172.21.15.5:0/1677175134 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5802ad40 con 0x7f9e68155040 2024-08-17T02:47:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.717+0000 7f9e65400640 1 -- 172.21.15.5:0/1677175134 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e58032440 con 0x7f9e68155040 2024-08-17T02:47:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.717+0000 7f9e65400640 1 -- 172.21.15.5:0/1677175134 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5802aea0 con 0x7f9e68155040 2024-08-17T02:47:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.717+0000 7f9e6ce00640 1 -- 172.21.15.5:0/1677175134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68155040 msgr2=0x7f9e68158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.717+0000 7f9e6ce00640 1 --2- 172.21.15.5:0/1677175134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68155040 0x7f9e68158c80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9e680ae620 tx=0x7f9e580091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.717+0000 7f9e6ce00640 1 -- 172.21.15.5:0/1677175134 shutdown_connections 2024-08-17T02:47:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.717+0000 7f9e6ce00640 1 --2- 172.21.15.5:0/1677175134 >> v2:172.21.15.107:3300/0 conn(0x7f9e681591c0 0x7f9e6806e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.717+0000 7f9e6ce00640 1 --2- 172.21.15.5:0/1677175134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68155040 0x7f9e68158c80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.717+0000 7f9e6ce00640 1 -- 172.21.15.5:0/1677175134 >> 172.21.15.5:0/1677175134 conn(0x7f9e68066e60 msgr2=0x7f9e68067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.717+0000 7f9e6ce00640 1 -- 172.21.15.5:0/1677175134 shutdown_connections 2024-08-17T02:47:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.717+0000 7f9e6ce00640 1 -- 172.21.15.5:0/1677175134 wait complete. 2024-08-17T02:47:21.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.719+0000 7f9e6ce00640 1 Processor -- start 2024-08-17T02:47:21.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.719+0000 7f9e6ce00640 1 -- start start 2024-08-17T02:47:21.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.720+0000 7f9e6ce00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e6806e5a0 0x7f9e680b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:21.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.720+0000 7f9e6ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68155040 0x7f9e680c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:21.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.720+0000 7f9e6ce00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e681591c0 0x7f9e68153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:21.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.720+0000 7f9e6ce00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e680c1730 con 0x7f9e68155040 2024-08-17T02:47:21.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.720+0000 7f9e6ce00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e68169150 con 0x7f9e6806e5a0 2024-08-17T02:47:21.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.720+0000 7f9e6ce00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e680c1960 con 0x7f9e681591c0 2024-08-17T02:47:21.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.720+0000 7f9e5fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68155040 0x7f9e680c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:21.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.720+0000 7f9e5fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68155040 0x7f9e680c11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38442/0 (socket says 172.21.15.5:38442) 2024-08-17T02:47:21.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.720+0000 7f9e5fe00640 1 -- 172.21.15.5:0/2559606133 learned_addr learned my addr 172.21.15.5:0/2559606133 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:21.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.720+0000 7f9e65e00640 1 --2- 172.21.15.5:0/2559606133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e6806e5a0 0x7f9e680b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:21.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.720+0000 7f9e5fe00640 1 -- 172.21.15.5:0/2559606133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e681591c0 msgr2=0x7f9e68153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:21.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.720+0000 7f9e66800640 1 --2- 172.21.15.5:0/2559606133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e681591c0 0x7f9e68153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:21.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.720+0000 7f9e5fe00640 1 --2- 172.21.15.5:0/2559606133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e681591c0 0x7f9e68153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.720+0000 7f9e5fe00640 1 -- 172.21.15.5:0/2559606133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e6806e5a0 msgr2=0x7f9e680b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:21.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.720+0000 7f9e5fe00640 1 --2- 172.21.15.5:0/2559606133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e6806e5a0 0x7f9e680b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.721+0000 7f9e5fe00640 1 -- 172.21.15.5:0/2559606133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e58009450 con 0x7f9e68155040 2024-08-17T02:47:21.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.721+0000 7f9e65e00640 1 --2- 172.21.15.5:0/2559606133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e6806e5a0 0x7f9e680b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:21.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.721+0000 7f9e66800640 1 --2- 172.21.15.5:0/2559606133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e681591c0 0x7f9e68153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:21.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.721+0000 7f9e5fe00640 1 --2- 172.21.15.5:0/2559606133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68155040 0x7f9e680c11f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9e5000d890 tx=0x7f9e50008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:21.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.721+0000 7f9e5d600640 1 -- 172.21.15.5:0/2559606133 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5000de20 con 0x7f9e68155040 2024-08-17T02:47:21.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.721+0000 7f9e5d600640 1 -- 172.21.15.5:0/2559606133 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e500098b0 con 0x7f9e68155040 2024-08-17T02:47:21.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.721+0000 7f9e5d600640 1 -- 172.21.15.5:0/2559606133 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e50009c50 con 0x7f9e68155040 2024-08-17T02:47:21.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.721+0000 7f9e6ce00640 1 -- 172.21.15.5:0/2559606133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e680c1c40 con 0x7f9e68155040 2024-08-17T02:47:21.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.721+0000 7f9e6ce00640 1 -- 172.21.15.5:0/2559606133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e68153d80 con 0x7f9e68155040 2024-08-17T02:47:21.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.722+0000 7f9e6ce00640 1 -- 172.21.15.5:0/2559606133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e68169300 con 0x7f9e68155040 2024-08-17T02:47:21.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.723+0000 7f9e5d600640 1 -- 172.21.15.5:0/2559606133 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9e50014620 con 0x7f9e68155040 2024-08-17T02:47:21.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.724+0000 7f9e5d600640 1 --2- 172.21.15.5:0/2559606133 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9e44065150 0x7f9e44067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:21.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.724+0000 7f9e5d600640 1 -- 172.21.15.5:0/2559606133 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e50082cf0 con 0x7f9e68155040 2024-08-17T02:47:21.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.724+0000 7f9e65e00640 1 --2- 172.21.15.5:0/2559606133 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9e44065150 0x7f9e44067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:21.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.725+0000 7f9e65e00640 1 --2- 172.21.15.5:0/2559606133 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9e44065150 0x7f9e44067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9e58034000 tx=0x7f9e58032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:21.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.728+0000 7f9e5d600640 1 -- 172.21.15.5:0/2559606133 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9e68169300 con 0x7f9e68155040 2024-08-17T02:47:21.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.950+0000 7f9e6ce00640 1 -- 172.21.15.5:0/2559606133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9e681692c0 con 0x7f9e68155040 2024-08-17T02:47:21.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.950+0000 7f9e5d600640 1 -- 172.21.15.5:0/2559606133 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9e50054850 con 0x7f9e68155040 2024-08-17T02:47:21.951 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:47:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.953+0000 7f9e6ce00640 1 -- 172.21.15.5:0/2559606133 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9e44065150 msgr2=0x7f9e44067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.953+0000 7f9e6ce00640 1 --2- 172.21.15.5:0/2559606133 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9e44065150 0x7f9e44067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9e58034000 tx=0x7f9e58032000 comp rx=0 tx=0).stop 2024-08-17T02:47:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.953+0000 7f9e6ce00640 1 -- 172.21.15.5:0/2559606133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68155040 msgr2=0x7f9e680c11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.953+0000 7f9e6ce00640 1 --2- 172.21.15.5:0/2559606133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68155040 0x7f9e680c11f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9e5000d890 tx=0x7f9e50008040 comp rx=0 tx=0).stop 2024-08-17T02:47:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.953+0000 7f9e6ce00640 1 -- 172.21.15.5:0/2559606133 shutdown_connections 2024-08-17T02:47:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.953+0000 7f9e6ce00640 1 --2- 172.21.15.5:0/2559606133 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9e44065150 0x7f9e44067600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.953+0000 7f9e6ce00640 1 --2- 172.21.15.5:0/2559606133 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9e681591c0 0x7f9e68153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.953+0000 7f9e6ce00640 1 --2- 172.21.15.5:0/2559606133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68155040 0x7f9e680c11f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.953+0000 7f9e6ce00640 1 --2- 172.21.15.5:0/2559606133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e6806e5a0 0x7f9e680b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.953+0000 7f9e6ce00640 1 -- 172.21.15.5:0/2559606133 >> 172.21.15.5:0/2559606133 conn(0x7f9e68066e60 msgr2=0x7f9e680ab530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.953+0000 7f9e6ce00640 1 -- 172.21.15.5:0/2559606133 shutdown_connections 2024-08-17T02:47:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:21.953+0000 7f9e6ce00640 1 -- 172.21.15.5:0/2559606133 wait complete. 2024-08-17T02:47:21.968 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:47:21.968 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:47:21.968 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-08-17T02:47:21.968 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:47:21.968 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:21.968 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:47:21.968 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:47:21.968 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:47:21.969 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:47:21.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:21.969 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-08-17T02:47:22.008 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:22.009 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2024-08-17T02:47:22.009 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2024-08-17T02:47:22.009 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:22.009 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:47:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:47:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42671sec preferred_lft 42671sec 2024-08-17T02:47:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link 2024-08-17T02:47:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:22.011 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:47:22.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:22.011 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:47:22.011 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:47:22.011 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:47:22.011 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr flush dev ceph-brx 2024-08-17T02:47:22.011 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set ceph-brx up 2024-08-17T02:47:22.011 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:47:22.011 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:47:22.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:22.371 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:47:22.430 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-08-17T02:47:22.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:22.433 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-08-17T02:47:22.486 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-08-17T02:47:22.487 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:47:22.487 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:47:22.487 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:47:22.487 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:47:22.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:22.487 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:47:22.487 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:47:22.487 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:47:22.487 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:47:22.488 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:47:22.488 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:47:23.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:23.023 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-08-17T02:47:23.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:23.059 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2024-08-17T02:47:23.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:23.135 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:47:23.135 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:47:23.135 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:47:23.135 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:47:23.135 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:47:23.265 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:47:23.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:23.266 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:47:23.266 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:47:23.266 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:47:23.266 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:47:23.266 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:47:23.266 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:47:23.266 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:47:23.266 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:47:23.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:23.455 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:47:23.455 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:47:23.455 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.0 up 2024-08-17T02:47:23.455 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:47:23.455 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:47:23.571 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:23.571 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:23.605 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:47:23.606 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:23.606 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:23.679 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:47:23.680 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:47:23.680 DEBUG:teuthology.orchestra.run.smithi107:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:23.810 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:23.810 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:24.414 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:24.414 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:24.414 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-08-17T02:47:24.415 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: trying mount with new device syntax: 1@c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3.cephfs=/ 2024-08-17T02:47:24.415 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.107:3300/172.21.15.107:3301" will pass to kernel 2024-08-17T02:47:24.416 INFO:teuthology.orchestra.run.smithi107.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:47:24.416 INFO:teuthology.orchestra.run.smithi107.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:47:24.416 INFO:teuthology.orchestra.run.smithi107.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:47:24.416 INFO:teuthology.orchestra.run.smithi107.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:47:24.416 INFO:teuthology.orchestra.run.smithi107.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:47:24.420 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:47:24.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:24.420 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:24.477 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-08-17T02:47:24.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:47:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.640+0000 7fbee8400640 1 Processor -- start 2024-08-17T02:47:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.640+0000 7fbee8400640 1 -- start start 2024-08-17T02:47:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.642+0000 7fbee8400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbee00ad960 0x7fbee015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.642+0000 7fbee8400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbee00ca050 0x7fbee0156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.642+0000 7fbee8400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee015b5e0 con 0x7fbee00add30 2024-08-17T02:47:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.642+0000 7fbee8400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee00cb160 con 0x7fbee00ca050 2024-08-17T02:47:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.642+0000 7fbee8400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee00b0d10 con 0x7fbee00ad960 2024-08-17T02:47:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.642+0000 7fbee6400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbee00add30 0x7fbee0156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57136/0 (socket says 172.21.15.5:57136) 2024-08-17T02:47:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.642+0000 7fbee6400640 1 -- 172.21.15.5:0/4050786511 learned_addr learned my addr 172.21.15.5:0/4050786511 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:24.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.642+0000 7fbee5000640 1 --2- 172.21.15.5:0/4050786511 >> v2:172.21.15.107:3300/0 conn(0x7fbee00ca050 0x7fbee0156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.642+0000 7fbee5a00640 1 --2- 172.21.15.5:0/4050786511 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbee00ad960 0x7fbee015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.642+0000 7fbedfe00640 1 -- 172.21.15.5:0/4050786511 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829114178 0 0) 0x7fbed8001490 con 0x7fbee00add30 2024-08-17T02:47:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.642+0000 7fbedfe00640 1 -- 172.21.15.5:0/4050786511 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec80034e0 con 0x7fbee00add30 2024-08-17T02:47:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.643+0000 7fbee5000640 1 -- 172.21.15.5:0/4050786511 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbee00ad960 msgr2=0x7fbee015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.643+0000 7fbee5000640 1 --2- 172.21.15.5:0/4050786511 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbee00ad960 0x7fbee015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.643+0000 7fbedfe00640 1 -- 172.21.15.5:0/4050786511 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2422863520 0 0) 0x7fbec80034e0 con 0x7fbee00add30 2024-08-17T02:47:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.643+0000 7fbee5000640 1 -- 172.21.15.5:0/4050786511 >> v1:172.21.15.5:6789/0 conn(0x7fbee00add30 legacy=0x7fbee0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.643+0000 7fbee5000640 1 -- 172.21.15.5:0/4050786511 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee00ca550 con 0x7fbee00ca050 2024-08-17T02:47:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.643+0000 7fbee5a00640 1 --2- 172.21.15.5:0/4050786511 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbee00ad960 0x7fbee015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.644+0000 7fbee5000640 1 --2- 172.21.15.5:0/4050786511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbee00ca050 0x7fbee0156420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009850 tx=0x7fbecc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11e557c48835404f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.644+0000 7fbedfe00640 1 -- 172.21.15.5:0/4050786511 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed8001980 con 0x7fbee00ca050 2024-08-17T02:47:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.644+0000 7fbedfe00640 1 -- 172.21.15.5:0/4050786511 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc02aae0 con 0x7fbee00ca050 2024-08-17T02:47:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.644+0000 7fbedfe00640 1 -- 172.21.15.5:0/4050786511 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc02ae80 con 0x7fbee00ca050 2024-08-17T02:47:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.645+0000 7fbee8400640 1 -- 172.21.15.5:0/4050786511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbee00ca050 msgr2=0x7fbee0156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.645+0000 7fbee8400640 1 --2- 172.21.15.5:0/4050786511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbee00ca050 0x7fbee0156420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009850 tx=0x7fbecc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.645+0000 7fbee8400640 1 -- 172.21.15.5:0/4050786511 shutdown_connections 2024-08-17T02:47:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.645+0000 7fbee8400640 1 --2- 172.21.15.5:0/4050786511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbee00ca050 0x7fbee0156420 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.645+0000 7fbee8400640 1 --2- 172.21.15.5:0/4050786511 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbee00ad960 0x7fbee015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.645+0000 7fbee8400640 1 -- 172.21.15.5:0/4050786511 >> 172.21.15.5:0/4050786511 conn(0x7fbee0066e60 msgr2=0x7fbee0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.645+0000 7fbee8400640 1 -- 172.21.15.5:0/4050786511 shutdown_connections 2024-08-17T02:47:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.645+0000 7fbee8400640 1 -- 172.21.15.5:0/4050786511 wait complete. 2024-08-17T02:47:24.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.646+0000 7fbee8400640 1 Processor -- start 2024-08-17T02:47:24.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.646+0000 7fbee8400640 1 -- start start 2024-08-17T02:47:24.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.647+0000 7fbee8400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbee00ad960 0x7fbee0157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.647+0000 7fbee8400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbee00add30 0x7fbee0151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.647+0000 7fbee8400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbee00ca050 0x7fbee014b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.647+0000 7fbee8400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee0150810 con 0x7fbee00ca050 2024-08-17T02:47:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.647+0000 7fbee8400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee014b8b0 con 0x7fbee00add30 2024-08-17T02:47:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.647+0000 7fbee8400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee0158360 con 0x7fbee00ad960 2024-08-17T02:47:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.648+0000 7fbee6400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbee00ca050 0x7fbee014b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.648+0000 7fbee5000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbee00add30 0x7fbee0151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.648+0000 7fbee5a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbee00ad960 0x7fbee0157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.648+0000 7fbee5000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbee00add30 0x7fbee0151410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:49554/0 (socket says 172.21.15.5:49554) 2024-08-17T02:47:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.648+0000 7fbee5000640 1 -- 172.21.15.5:0/3169236965 learned_addr learned my addr 172.21.15.5:0/3169236965 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.648+0000 7fbee5a00640 1 -- 172.21.15.5:0/3169236965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbee00add30 msgr2=0x7fbee0151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.648+0000 7fbee5a00640 1 --2- 172.21.15.5:0/3169236965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbee00add30 0x7fbee0151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.648+0000 7fbee5a00640 1 -- 172.21.15.5:0/3169236965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbee00ca050 msgr2=0x7fbee014b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.648+0000 7fbee5a00640 1 --2- 172.21.15.5:0/3169236965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbee00ca050 0x7fbee014b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.648+0000 7fbee5a00640 1 -- 172.21.15.5:0/3169236965 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed4009390 con 0x7fbee00ad960 2024-08-17T02:47:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.648+0000 7fbee5a00640 1 --2- 172.21.15.5:0/3169236965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbee00ad960 0x7fbee0157c80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbed400ea50 tx=0x7fbed40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.649+0000 7fbedcc00640 1 -- 172.21.15.5:0/3169236965 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed400ca10 con 0x7fbee00ad960 2024-08-17T02:47:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.649+0000 7fbee8400640 1 -- 172.21.15.5:0/3169236965 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbecc009390 con 0x7fbee00ad960 2024-08-17T02:47:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.649+0000 7fbedcc00640 1 -- 172.21.15.5:0/3169236965 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed400cb70 con 0x7fbee00ad960 2024-08-17T02:47:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.649+0000 7fbedcc00640 1 -- 172.21.15.5:0/3169236965 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4013470 con 0x7fbee00ad960 2024-08-17T02:47:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.649+0000 7fbee8400640 1 -- 172.21.15.5:0/3169236965 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee0158920 con 0x7fbee00ad960 2024-08-17T02:47:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.650+0000 7fbee8400640 1 -- 172.21.15.5:0/3169236965 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee0063fb0 con 0x7fbee00ad960 2024-08-17T02:47:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.651+0000 7fbedcc00640 1 -- 172.21.15.5:0/3169236965 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbed4013860 con 0x7fbee00ad960 2024-08-17T02:47:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.652+0000 7fbedcc00640 1 --2- 172.21.15.5:0/3169236965 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbec0065150 0x7fbec0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.652+0000 7fbedcc00640 1 -- 172.21.15.5:0/3169236965 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbed40827b0 con 0x7fbee00ad960 2024-08-17T02:47:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.652+0000 7fbee5000640 1 --2- 172.21.15.5:0/3169236965 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbec0065150 0x7fbec0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.653+0000 7fbee5000640 1 --2- 172.21.15.5:0/3169236965 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbec0065150 0x7fbec0067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009130 tx=0x7fbecc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.657+0000 7fbedcc00640 1 -- 172.21.15.5:0/3169236965 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbed4050880 con 0x7fbee00ad960 2024-08-17T02:47:24.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.877+0000 7fbee8400640 1 -- 172.21.15.5:0/3169236965 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbee015add0 con 0x7fbee00ad960 2024-08-17T02:47:24.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.878+0000 7fbedcc00640 1 -- 172.21.15.5:0/3169236965 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbed4053ea0 con 0x7fbee00ad960 2024-08-17T02:47:24.879 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:47:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.880+0000 7fbee8400640 1 -- 172.21.15.5:0/3169236965 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbec0065150 msgr2=0x7fbec0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.880+0000 7fbee8400640 1 --2- 172.21.15.5:0/3169236965 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbec0065150 0x7fbec0067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009130 tx=0x7fbecc032000 comp rx=0 tx=0).stop 2024-08-17T02:47:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.880+0000 7fbee8400640 1 -- 172.21.15.5:0/3169236965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbee00ad960 msgr2=0x7fbee0157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.880+0000 7fbee8400640 1 --2- 172.21.15.5:0/3169236965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbee00ad960 0x7fbee0157c80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbed400ea50 tx=0x7fbed40090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.880+0000 7fbee8400640 1 -- 172.21.15.5:0/3169236965 shutdown_connections 2024-08-17T02:47:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.880+0000 7fbee8400640 1 --2- 172.21.15.5:0/3169236965 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbec0065150 0x7fbec0067600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.880+0000 7fbee8400640 1 --2- 172.21.15.5:0/3169236965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbee00ca050 0x7fbee014b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.881+0000 7fbee8400640 1 --2- 172.21.15.5:0/3169236965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbee00add30 0x7fbee0151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.881+0000 7fbee8400640 1 --2- 172.21.15.5:0/3169236965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbee00ad960 0x7fbee0157c80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.881+0000 7fbee8400640 1 -- 172.21.15.5:0/3169236965 >> 172.21.15.5:0/3169236965 conn(0x7fbee0066e60 msgr2=0x7fbee00b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.881+0000 7fbee8400640 1 -- 172.21.15.5:0/3169236965 shutdown_connections 2024-08-17T02:47:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:24.881+0000 7fbee8400640 1 -- 172.21.15.5:0/3169236965 wait complete. 2024-08-17T02:47:24.896 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:47:24.896 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:47:24.896 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-08-17T02:47:24.896 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:47:24.896 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:47:24.896 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:47:24.896 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:47:24.896 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:47:24.896 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:47:24.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:24.897 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-08-17T02:47:24.935 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:24.935 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:24.935 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:24.935 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:24.936 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:24.936 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:24.936 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:24.936 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:24.936 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2024-08-17T02:47:24.937 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:24.937 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:24.937 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2024-08-17T02:47:24.937 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:24.937 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:24.937 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:47:24.938 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:24.938 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:47:24.938 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42668sec preferred_lft 42668sec 2024-08-17T02:47:24.938 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link 2024-08-17T02:47:24.938 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:24.939 INFO:teuthology.orchestra.run.smithi107.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:24.939 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 3a:4a:5d:80:52:c3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:24.939 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:47:24.939 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:24.939 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::30e2:8fff:fe84:782/64 scope link 2024-08-17T02:47:24.939 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:24.940 INFO:teuthology.orchestra.run.smithi107.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:47:24.940 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 3a:4a:5d:80:52:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:47:24.940 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::384a:5dff:fe80:52c3/64 scope link tentative 2024-08-17T02:47:24.940 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:24.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:24.941 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:47:25.028 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-08-17T02:47:25.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:25.031 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-08-17T02:47:25.067 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-08-17T02:47:25.067 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:47:25.068 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:47:25.068 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:47:25.068 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:47:25.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:25.068 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:47:25.068 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:47:25.068 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:47:25.068 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:47:25.068 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:47:25.069 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:47:25.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:25.212 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-08-17T02:47:25.247 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:47:25.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:25.248 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2024-08-17T02:47:25.324 INFO:teuthology.orchestra.run.smithi107.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:47:25.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:25.325 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:47:25.325 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:47:25.325 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:47:25.325 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:47:25.325 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:47:25.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:25.452 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:47:25.506 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:25.507 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:25.507 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:25.507 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:25.507 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:25.507 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:25.507 INFO:teuthology.orchestra.run.smithi107.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:25.507 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether f6:60:32:79:76:54 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:47:25.507 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:47:25.507 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:25.507 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::f460:32ff:fe79:7654/64 scope link 2024-08-17T02:47:25.507 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:25.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:25.510 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:47:25.565 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:25.565 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:25.565 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:25.565 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:25.565 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:25.565 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:25.565 INFO:teuthology.orchestra.run.smithi107.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:25.565 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether f6:60:32:79:76:54 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:47:25.566 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:47:25.566 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:25.566 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::f460:32ff:fe79:7654/64 scope link 2024-08-17T02:47:25.566 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:25.567 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:47:25.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:25.568 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:47:25.568 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:47:25.568 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:47:25.568 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:47:25.568 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:47:25.568 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:47:25.568 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:47:25.568 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:47:25.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:25.732 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:47:25.732 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:47:25.732 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.1 up 2024-08-17T02:47:25.733 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:47:25.733 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:47:25.848 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:25.848 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:47:25.883 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:47:25.884 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:25.884 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:47:25.959 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-08-17T02:47:25.959 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:47:25.959 DEBUG:teuthology.orchestra.run.smithi107:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:26.080 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:26.080 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:26.107 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:26.107 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:26.107 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-08-17T02:47:26.107 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: trying mount with new device syntax: 3@c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3.cephfs=/ 2024-08-17T02:47:26.107 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.5:3300/172.21.15.107:3300/172.21.15.107:3301" will pass to kernel 2024-08-17T02:47:26.107 INFO:teuthology.orchestra.run.smithi107.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-08-17T02:47:26.108 INFO:teuthology.orchestra.run.smithi107.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:47:26.108 INFO:teuthology.orchestra.run.smithi107.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:47:26.108 INFO:teuthology.orchestra.run.smithi107.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:47:26.108 INFO:teuthology.orchestra.run.smithi107.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:47:26.111 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:47:26.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:26.111 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:47:26.166 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:47:26.183 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:26.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.346+0000 7fcf0f200640 1 Processor -- start 2024-08-17T02:47:26.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.347+0000 7fcf0f200640 1 -- start start 2024-08-17T02:47:26.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.348+0000 7fcf0f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf080cf080 0x7fcf0815a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.348+0000 7fcf0f200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf081599d0 0x7fcf08159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.348+0000 7fcf0f200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf08159540 con 0x7fcf080b1f80 2024-08-17T02:47:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.348+0000 7fcf0f200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf080b2350 con 0x7fcf081599d0 2024-08-17T02:47:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.348+0000 7fcf0f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0815a370 con 0x7fcf080cf080 2024-08-17T02:47:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.348+0000 7fcf0e800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf081599d0 0x7fcf08159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.348+0000 7fcf0d400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf080cf080 0x7fcf0815a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.348+0000 7fcf0e800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf081599d0 0x7fcf08159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43402/0 (socket says 172.21.15.5:43402) 2024-08-17T02:47:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.348+0000 7fcf0e800640 1 -- 172.21.15.5:0/1939789270 learned_addr learned my addr 172.21.15.5:0/1939789270 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.348+0000 7fcf0de00640 1 --1- 172.21.15.5:0/1939789270 >> v1:172.21.15.107:6789/0 conn(0x7fcf080b1f80 0x7fcf080cd760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:38418/0 (socket says 172.21.15.5:38418) 2024-08-17T02:47:26.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.349+0000 7fcf0e800640 1 -- 172.21.15.5:0/1939789270 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf080cf080 msgr2=0x7fcf0815a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:26.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.349+0000 7fcf0e800640 1 --2- 172.21.15.5:0/1939789270 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf080cf080 0x7fcf0815a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.349+0000 7fcf0e800640 1 -- 172.21.15.5:0/1939789270 >> v1:172.21.15.107:6789/0 conn(0x7fcf080b1f80 legacy=0x7fcf080cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.349+0000 7fcf0e800640 1 -- 172.21.15.5:0/1939789270 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf080cdf90 con 0x7fcf081599d0 2024-08-17T02:47:26.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.349+0000 7fcf0d400640 1 --2- 172.21.15.5:0/1939789270 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf080cf080 0x7fcf0815a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:26.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.350+0000 7fcf0e800640 1 --2- 172.21.15.5:0/1939789270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf081599d0 0x7fcf08159e30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009f20 tx=0x7fcf04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31df6a41be1fc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:26.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.350+0000 7fcf0ca00640 1 -- 172.21.15.5:0/1939789270 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04031400 con 0x7fcf081599d0 2024-08-17T02:47:26.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.350+0000 7fcf0ca00640 1 -- 172.21.15.5:0/1939789270 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0402d050 con 0x7fcf081599d0 2024-08-17T02:47:26.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.350+0000 7fcf0ca00640 1 -- 172.21.15.5:0/1939789270 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf040317d0 con 0x7fcf081599d0 2024-08-17T02:47:26.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.351+0000 7fcf0f200640 1 -- 172.21.15.5:0/1939789270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf081599d0 msgr2=0x7fcf08159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.351+0000 7fcf0f200640 1 --2- 172.21.15.5:0/1939789270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf081599d0 0x7fcf08159e30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009f20 tx=0x7fcf04009840 comp rx=0 tx=0).stop 2024-08-17T02:47:26.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.351+0000 7fcf0f200640 1 -- 172.21.15.5:0/1939789270 shutdown_connections 2024-08-17T02:47:26.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.351+0000 7fcf0f200640 1 --2- 172.21.15.5:0/1939789270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf081599d0 0x7fcf08159e30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.351+0000 7fcf0f200640 1 --2- 172.21.15.5:0/1939789270 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf080cf080 0x7fcf0815a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.351+0000 7fcf0f200640 1 -- 172.21.15.5:0/1939789270 >> 172.21.15.5:0/1939789270 conn(0x7fcf08087a80 msgr2=0x7fcf0806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.351+0000 7fcf0f200640 1 -- 172.21.15.5:0/1939789270 shutdown_connections 2024-08-17T02:47:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.351+0000 7fcf0f200640 1 -- 172.21.15.5:0/1939789270 wait complete. 2024-08-17T02:47:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.352+0000 7fcf0f200640 1 Processor -- start 2024-08-17T02:47:26.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.352+0000 7fcf0f200640 1 -- start start 2024-08-17T02:47:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.353+0000 7fcf0f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf080b1f80 0x7fcf0814e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.353+0000 7fcf0f200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf080cf080 0x7fcf080b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.353+0000 7fcf0f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf081599d0 0x7fcf080b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.353+0000 7fcf0f200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf080c9ac0 con 0x7fcf080cf080 2024-08-17T02:47:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.353+0000 7fcf0f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0814ed60 con 0x7fcf081599d0 2024-08-17T02:47:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.353+0000 7fcf0f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf080c7ba0 con 0x7fcf080b1f80 2024-08-17T02:47:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.353+0000 7fcf0d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf080cf080 0x7fcf080b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.353+0000 7fcf0d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf080cf080 0x7fcf080b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43414/0 (socket says 172.21.15.5:43414) 2024-08-17T02:47:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.353+0000 7fcf0d400640 1 -- 172.21.15.5:0/79799985 learned_addr learned my addr 172.21.15.5:0/79799985 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.354+0000 7fcf0de00640 1 --2- 172.21.15.5:0/79799985 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf080b1f80 0x7fcf0814e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.354+0000 7fcf0e800640 1 --2- 172.21.15.5:0/79799985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf081599d0 0x7fcf080b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.354+0000 7fcf0d400640 1 -- 172.21.15.5:0/79799985 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf080b1f80 msgr2=0x7fcf0814e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.354+0000 7fcf0d400640 1 --2- 172.21.15.5:0/79799985 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf080b1f80 0x7fcf0814e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.354+0000 7fcf0d400640 1 -- 172.21.15.5:0/79799985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf081599d0 msgr2=0x7fcf080b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.354+0000 7fcf0d400640 1 --2- 172.21.15.5:0/79799985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf081599d0 0x7fcf080b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.354+0000 7fcf0d400640 1 -- 172.21.15.5:0/79799985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef8009390 con 0x7fcf080cf080 2024-08-17T02:47:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.354+0000 7fcf0d400640 1 --2- 172.21.15.5:0/79799985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf080cf080 0x7fcf080b3300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcef800ec80 tx=0x7fcef80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.354+0000 7fcf01600640 1 -- 172.21.15.5:0/79799985 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef800eec0 con 0x7fcf080cf080 2024-08-17T02:47:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.354+0000 7fcf01600640 1 -- 172.21.15.5:0/79799985 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef800cbc0 con 0x7fcf080cf080 2024-08-17T02:47:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.354+0000 7fcf01600640 1 -- 172.21.15.5:0/79799985 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef8013470 con 0x7fcf080cf080 2024-08-17T02:47:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.354+0000 7fcf0f200640 1 -- 172.21.15.5:0/79799985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf04009ae0 con 0x7fcf080cf080 2024-08-17T02:47:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.355+0000 7fcf0f200640 1 -- 172.21.15.5:0/79799985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf080c72f0 con 0x7fcf080cf080 2024-08-17T02:47:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.356+0000 7fcf0f200640 1 -- 172.21.15.5:0/79799985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf08070720 con 0x7fcf080cf080 2024-08-17T02:47:26.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.356+0000 7fcf01600640 1 -- 172.21.15.5:0/79799985 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcef80137e0 con 0x7fcf080cf080 2024-08-17T02:47:26.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.357+0000 7fcf01600640 1 --2- 172.21.15.5:0/79799985 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fceec065150 0x7fceec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.357+0000 7fcf01600640 1 -- 172.21.15.5:0/79799985 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcef8082840 con 0x7fcf080cf080 2024-08-17T02:47:26.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.357+0000 7fcf0de00640 1 --2- 172.21.15.5:0/79799985 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fceec065150 0x7fceec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.358+0000 7fcf0de00640 1 --2- 172.21.15.5:0/79799985 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fceec065150 0x7fceec067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcefc007800 tx=0x7fcefc007e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:26.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.362+0000 7fcf01600640 1 -- 172.21.15.5:0/79799985 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcef8050910 con 0x7fcf080cf080 2024-08-17T02:47:26.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.547+0000 7fcf0f200640 1 -- 172.21.15.5:0/79799985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf080c7ce0 con 0x7fcf080cf080 2024-08-17T02:47:26.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.548+0000 7fcf01600640 1 -- 172.21.15.5:0/79799985 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fcef8053f30 con 0x7fcf080cf080 2024-08-17T02:47:26.548 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:26.548 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:59.170637+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:55.543347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:56.571235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:26.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.550+0000 7fcf0f200640 1 -- 172.21.15.5:0/79799985 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fceec065150 msgr2=0x7fceec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.550+0000 7fcf0f200640 1 --2- 172.21.15.5:0/79799985 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fceec065150 0x7fceec067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcefc007800 tx=0x7fcefc007e20 comp rx=0 tx=0).stop 2024-08-17T02:47:26.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.550+0000 7fcf0f200640 1 -- 172.21.15.5:0/79799985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf080cf080 msgr2=0x7fcf080b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.550+0000 7fcf0f200640 1 --2- 172.21.15.5:0/79799985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf080cf080 0x7fcf080b3300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcef800ec80 tx=0x7fcef80090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.550+0000 7fcf0f200640 1 -- 172.21.15.5:0/79799985 shutdown_connections 2024-08-17T02:47:26.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.550+0000 7fcf0f200640 1 --2- 172.21.15.5:0/79799985 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fceec065150 0x7fceec067600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.550+0000 7fcf0f200640 1 --2- 172.21.15.5:0/79799985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf081599d0 0x7fcf080b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.550+0000 7fcf0f200640 1 --2- 172.21.15.5:0/79799985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf080cf080 0x7fcf080b3300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.550+0000 7fcf0f200640 1 --2- 172.21.15.5:0/79799985 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf080b1f80 0x7fcf0814e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.550+0000 7fcf0f200640 1 -- 172.21.15.5:0/79799985 >> 172.21.15.5:0/79799985 conn(0x7fcf08087a80 msgr2=0x7fcf080cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:26.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.550+0000 7fcf0f200640 1 -- 172.21.15.5:0/79799985 shutdown_connections 2024-08-17T02:47:26.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.550+0000 7fcf0f200640 1 -- 172.21.15.5:0/79799985 wait complete. 2024-08-17T02:47:26.566 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:47.106425+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:55.543347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:56.571235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:47:26.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:26.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.720+0000 7f9197200640 1 Processor -- start 2024-08-17T02:47:26.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.721+0000 7f9197200640 1 -- start start 2024-08-17T02:47:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.722+0000 7f9197200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91900cc7e0 0x7f91900ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.722+0000 7f9197200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91900cd780 0x7f91900cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.722+0000 7f9197200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f919015bbd0 0x7f919015c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.722+0000 7f9197200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919015c590 con 0x7f91900cc7e0 2024-08-17T02:47:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.722+0000 7f9197200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91900cdc60 con 0x7f919015bbd0 2024-08-17T02:47:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.722+0000 7f9197200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91900cdf40 con 0x7f91900cd780 2024-08-17T02:47:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.722+0000 7f9195e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91900cc7e0 0x7f91900ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.722+0000 7f9195e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91900cc7e0 0x7f91900ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43418/0 (socket says 172.21.15.5:43418) 2024-08-17T02:47:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.722+0000 7f9195e00640 1 -- 172.21.15.5:0/307195813 learned_addr learned my addr 172.21.15.5:0/307195813 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.722+0000 7f9195400640 1 --2- 172.21.15.5:0/307195813 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91900cd780 0x7f91900cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.722+0000 7f9196800640 1 --2- 172.21.15.5:0/307195813 >> v2:172.21.15.107:3300/0 conn(0x7f919015bbd0 0x7f919015c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.723+0000 7f9195e00640 1 -- 172.21.15.5:0/307195813 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91900cd780 msgr2=0x7f91900cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:26.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.723+0000 7f9195e00640 1 --2- 172.21.15.5:0/307195813 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91900cd780 0x7f91900cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.723+0000 7f9195e00640 1 -- 172.21.15.5:0/307195813 >> v2:172.21.15.107:3300/0 conn(0x7f919015bbd0 msgr2=0x7f919015c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:26.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.723+0000 7f9195e00640 1 --2- 172.21.15.5:0/307195813 >> v2:172.21.15.107:3300/0 conn(0x7f919015bbd0 0x7f919015c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.723+0000 7f9195e00640 1 -- 172.21.15.5:0/307195813 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91900ce220 con 0x7f91900cc7e0 2024-08-17T02:47:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.723+0000 7f9196800640 1 --2- 172.21.15.5:0/307195813 >> v2:172.21.15.107:3300/0 conn(0x7f919015bbd0 0x7f919015c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.724+0000 7f9195e00640 1 --2- 172.21.15.5:0/307195813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91900cc7e0 0x7f91900ccbb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f91900b26d0 tx=0x7f91840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d88dbb8b23a9a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.724+0000 7f9194a00640 1 -- 172.21.15.5:0/307195813 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918402ae60 con 0x7f91900cc7e0 2024-08-17T02:47:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.724+0000 7f9194a00640 1 -- 172.21.15.5:0/307195813 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9184032440 con 0x7f91900cc7e0 2024-08-17T02:47:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.724+0000 7f9194a00640 1 -- 172.21.15.5:0/307195813 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91840327e0 con 0x7f91900cc7e0 2024-08-17T02:47:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.725+0000 7f9197200640 1 -- 172.21.15.5:0/307195813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91900cc7e0 msgr2=0x7f91900ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.725+0000 7f9197200640 1 --2- 172.21.15.5:0/307195813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91900cc7e0 0x7f91900ccbb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f91900b26d0 tx=0x7f91840091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.725+0000 7f9197200640 1 -- 172.21.15.5:0/307195813 shutdown_connections 2024-08-17T02:47:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.725+0000 7f9197200640 1 --2- 172.21.15.5:0/307195813 >> v2:172.21.15.107:3300/0 conn(0x7f919015bbd0 0x7f919015c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.725+0000 7f9197200640 1 --2- 172.21.15.5:0/307195813 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91900cd780 0x7f91900cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.725+0000 7f9197200640 1 --2- 172.21.15.5:0/307195813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91900cc7e0 0x7f91900ccbb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.725+0000 7f9197200640 1 -- 172.21.15.5:0/307195813 >> 172.21.15.5:0/307195813 conn(0x7f9190087a80 msgr2=0x7f919006e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:26.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.725+0000 7f9197200640 1 -- 172.21.15.5:0/307195813 shutdown_connections 2024-08-17T02:47:26.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.725+0000 7f9197200640 1 -- 172.21.15.5:0/307195813 wait complete. 2024-08-17T02:47:26.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.726+0000 7f9197200640 1 Processor -- start 2024-08-17T02:47:26.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.726+0000 7f9197200640 1 -- start start 2024-08-17T02:47:26.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.727+0000 7f9197200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91900cc7e0 0x7f9190151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.727+0000 7f9197200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91900cd780 0x7f9190168d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.727+0000 7f9197200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f919015bbd0 0x7f91900b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.727+0000 7f9197200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91900b5a60 con 0x7f919015bbd0 2024-08-17T02:47:26.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.727+0000 7f9197200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91900c7f90 con 0x7f91900cd780 2024-08-17T02:47:26.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.727+0000 7f9197200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91900b5780 con 0x7f91900cc7e0 2024-08-17T02:47:26.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.727+0000 7f9196800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f919015bbd0 0x7f91900b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.727+0000 7f9195e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91900cc7e0 0x7f9190151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.727+0000 7f9196800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f919015bbd0 0x7f91900b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43432/0 (socket says 172.21.15.5:43432) 2024-08-17T02:47:26.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.727+0000 7f9195400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91900cd780 0x7f9190168d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.727+0000 7f9196800640 1 -- 172.21.15.5:0/1605500735 learned_addr learned my addr 172.21.15.5:0/1605500735 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.728+0000 7f9196800640 1 -- 172.21.15.5:0/1605500735 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91900cc7e0 msgr2=0x7f9190151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.728+0000 7f9196800640 1 --2- 172.21.15.5:0/1605500735 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91900cc7e0 0x7f9190151270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.728+0000 7f9196800640 1 -- 172.21.15.5:0/1605500735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91900cd780 msgr2=0x7f9190168d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.728+0000 7f9196800640 1 --2- 172.21.15.5:0/1605500735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91900cd780 0x7f9190168d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.728+0000 7f9196800640 1 -- 172.21.15.5:0/1605500735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9184009450 con 0x7f919015bbd0 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.728+0000 7f9196800640 1 --2- 172.21.15.5:0/1605500735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f919015bbd0 0x7f91900b4cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f918c009fc0 tx=0x7f918c0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.728+0000 7f9189600640 1 -- 172.21.15.5:0/1605500735 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c00de80 con 0x7f919015bbd0 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.728+0000 7f9189600640 1 -- 172.21.15.5:0/1605500735 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918c00f040 con 0x7f919015bbd0 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.728+0000 7f9189600640 1 -- 172.21.15.5:0/1605500735 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c015690 con 0x7f919015bbd0 2024-08-17T02:47:26.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.728+0000 7f9197200640 1 -- 172.21.15.5:0/1605500735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91900c7940 con 0x7f919015bbd0 2024-08-17T02:47:26.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.728+0000 7f9197200640 1 -- 172.21.15.5:0/1605500735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91901517b0 con 0x7f919015bbd0 2024-08-17T02:47:26.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.729+0000 7f9197200640 1 -- 172.21.15.5:0/1605500735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91900c8120 con 0x7f919015bbd0 2024-08-17T02:47:26.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.730+0000 7f9189600640 1 -- 172.21.15.5:0/1605500735 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f918c01e3b0 con 0x7f919015bbd0 2024-08-17T02:47:26.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.731+0000 7f9189600640 1 --2- 172.21.15.5:0/1605500735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9174065180 0x7f9174067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:26.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.732+0000 7f9189600640 1 -- 172.21.15.5:0/1605500735 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f918c082a00 con 0x7f919015bbd0 2024-08-17T02:47:26.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.732+0000 7f9195e00640 1 --2- 172.21.15.5:0/1605500735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9174065180 0x7f9174067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:26.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.732+0000 7f9195e00640 1 --2- 172.21.15.5:0/1605500735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9174065180 0x7f9174067630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9184034000 tx=0x7f9184032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:26.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.735+0000 7f9189600640 1 -- 172.21.15.5:0/1605500735 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f918c050ad0 con 0x7f919015bbd0 2024-08-17T02:47:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.919+0000 7f9197200640 1 -- 172.21.15.5:0/1605500735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9190070720 con 0x7f919015bbd0 2024-08-17T02:47:26.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.919+0000 7f9189600640 1 -- 172.21.15.5:0/1605500735 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f918c016e60 con 0x7f919015bbd0 2024-08-17T02:47:26.920 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:47:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.922+0000 7f9197200640 1 -- 172.21.15.5:0/1605500735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9174065180 msgr2=0x7f9174067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.922+0000 7f9197200640 1 --2- 172.21.15.5:0/1605500735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9174065180 0x7f9174067630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9184034000 tx=0x7f9184032000 comp rx=0 tx=0).stop 2024-08-17T02:47:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.922+0000 7f9197200640 1 -- 172.21.15.5:0/1605500735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f919015bbd0 msgr2=0x7f91900b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:26.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.922+0000 7f9197200640 1 --2- 172.21.15.5:0/1605500735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f919015bbd0 0x7f91900b4cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f918c009fc0 tx=0x7f918c0099b0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.922+0000 7f9197200640 1 -- 172.21.15.5:0/1605500735 shutdown_connections 2024-08-17T02:47:26.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.922+0000 7f9197200640 1 --2- 172.21.15.5:0/1605500735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9174065180 0x7f9174067630 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.922+0000 7f9197200640 1 --2- 172.21.15.5:0/1605500735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f919015bbd0 0x7f91900b4cc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.922+0000 7f9197200640 1 --2- 172.21.15.5:0/1605500735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91900cd780 0x7f9190168d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.922+0000 7f9197200640 1 --2- 172.21.15.5:0/1605500735 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f91900cc7e0 0x7f9190151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:26.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.922+0000 7f9197200640 1 -- 172.21.15.5:0/1605500735 >> 172.21.15.5:0/1605500735 conn(0x7f9190087a80 msgr2=0x7f91900cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:26.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.922+0000 7f9197200640 1 -- 172.21.15.5:0/1605500735 shutdown_connections 2024-08-17T02:47:26.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:26.922+0000 7f9197200640 1 -- 172.21.15.5:0/1605500735 wait complete. 2024-08-17T02:47:26.937 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:47:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.091+0000 7fefd9800640 1 Processor -- start 2024-08-17T02:47:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.091+0000 7fefd9800640 1 -- start start 2024-08-17T02:47:27.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.092+0000 7fefd9800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefd40aee60 0x7fefd40caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.092+0000 7fefd9800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd40afd20 con 0x7fefd4158b90 2024-08-17T02:47:27.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.092+0000 7fefd9800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd40affe0 con 0x7fefd40aea20 2024-08-17T02:47:27.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.092+0000 7fefd9800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd40b02c0 con 0x7fefd40aee60 2024-08-17T02:47:27.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.092+0000 7fefd2a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fefd4158b90 0x7fefd40b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54198/0 (socket says 172.21.15.5:54198) 2024-08-17T02:47:27.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.092+0000 7fefd2a00640 1 -- 172.21.15.5:0/824265855 learned_addr learned my addr 172.21.15.5:0/824265855 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:27.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd3400640 1 --2- 172.21.15.5:0/824265855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefd40aee60 0x7fefd40caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 -- 172.21.15.5:0/824265855 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112347301 0 0) 0x7fefd40afd20 con 0x7fefd4158b90 2024-08-17T02:47:27.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 -- 172.21.15.5:0/824265855 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefb80034e0 con 0x7fefd4158b90 2024-08-17T02:47:27.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 -- 172.21.15.5:0/824265855 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862089444 0 0) 0x7fefd40affe0 con 0x7fefd40aea20 2024-08-17T02:47:27.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 -- 172.21.15.5:0/824265855 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd40afd20 con 0x7fefd40aea20 2024-08-17T02:47:27.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 -- 172.21.15.5:0/824265855 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3901069455 0 0) 0x7fefb80034e0 con 0x7fefd4158b90 2024-08-17T02:47:27.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 -- 172.21.15.5:0/824265855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefd40aee60 msgr2=0x7fefd40caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:27.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 --2- 172.21.15.5:0/824265855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefd40aee60 0x7fefd40caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 -- 172.21.15.5:0/824265855 >> v1:172.21.15.107:6789/0 conn(0x7fefd40aea20 legacy=0x7fefd40ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 -- 172.21.15.5:0/824265855 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd40ca3c0 con 0x7fefd4158b90 2024-08-17T02:47:27.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 -- 172.21.15.5:0/824265855 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7fefc4001490 con 0x7fefd4158b90 2024-08-17T02:47:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 -- 172.21.15.5:0/824265855 >> v1:172.21.15.5:6789/0 conn(0x7fefd4158b90 legacy=0x7fefd40b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 --2- 172.21.15.5:0/824265855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefb8003b90 0x7fefb8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 --2- 172.21.15.5:0/824265855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefd40aee60 0x7fefb8004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 --2- 172.21.15.5:0/824265855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb8004cc0 0x7fefb8005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 -- 172.21.15.5:0/824265855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd40b02c0 con 0x7fefb8004cc0 2024-08-17T02:47:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 -- 172.21.15.5:0/824265855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb800bb60 con 0x7fefb8003b90 2024-08-17T02:47:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.093+0000 7fefd1600640 1 -- 172.21.15.5:0/824265855 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb800bcd0 con 0x7fefd40aee60 2024-08-17T02:47:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.094+0000 7fefd2a00640 1 --2- 172.21.15.5:0/824265855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefb8003b90 0x7fefb8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.094+0000 7fefd2000640 1 --2- 172.21.15.5:0/824265855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefd40aee60 0x7fefb8004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.094+0000 7fefd3400640 1 --2- 172.21.15.5:0/824265855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb8004cc0 0x7fefb8005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.094+0000 7fefd2a00640 1 -- 172.21.15.5:0/824265855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefd40aee60 msgr2=0x7fefb8004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.094+0000 7fefd2a00640 1 --2- 172.21.15.5:0/824265855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefd40aee60 0x7fefb8004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.094+0000 7fefd2a00640 1 -- 172.21.15.5:0/824265855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb8004cc0 msgr2=0x7fefb8005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:27.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.094+0000 7fefd2a00640 1 --2- 172.21.15.5:0/824265855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb8004cc0 0x7fefb8005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.094+0000 7fefd2a00640 1 -- 172.21.15.5:0/824265855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb80034e0 con 0x7fefb8003b90 2024-08-17T02:47:27.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.095+0000 7fefd2a00640 1 --2- 172.21.15.5:0/824265855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefb8003b90 0x7fefb8003f80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fefd4066ff0 tx=0x7fefc4001d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd0f31c1acde1b52 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:27.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.096+0000 7fefd1600640 1 -- 172.21.15.5:0/824265855 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4005960 con 0x7fefb8003b90 2024-08-17T02:47:27.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.096+0000 7fefd1600640 1 -- 172.21.15.5:0/824265855 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc402d070 con 0x7fefb8003b90 2024-08-17T02:47:27.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.096+0000 7fefd1600640 1 -- 172.21.15.5:0/824265855 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4005b20 con 0x7fefb8003b90 2024-08-17T02:47:27.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.096+0000 7fefd9800640 1 -- 172.21.15.5:0/824265855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefb8003b90 msgr2=0x7fefb8003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.096+0000 7fefd9800640 1 --2- 172.21.15.5:0/824265855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefb8003b90 0x7fefb8003f80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fefd4066ff0 tx=0x7fefc4001d60 comp rx=0 tx=0).stop 2024-08-17T02:47:27.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.096+0000 7fefd3400640 1 -- 172.21.15.5:0/824265855 reap_dead start 2024-08-17T02:47:27.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.096+0000 7fefd9800640 1 -- 172.21.15.5:0/824265855 shutdown_connections 2024-08-17T02:47:27.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.096+0000 7fefd9800640 1 -- 172.21.15.5:0/824265855 >> 172.21.15.5:0/824265855 conn(0x7fefd406e590 msgr2=0x7fefd406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:27.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.096+0000 7fefd9800640 1 -- 172.21.15.5:0/824265855 shutdown_connections 2024-08-17T02:47:27.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.096+0000 7fefd9800640 1 -- 172.21.15.5:0/824265855 wait complete. 2024-08-17T02:47:27.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.098+0000 7fefd9800640 1 Processor -- start 2024-08-17T02:47:27.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.098+0000 7fefd9800640 1 -- start start 2024-08-17T02:47:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.099+0000 7fefd9800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefb8003b90 0x7fefd415d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.099+0000 7fefd9800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd415efc0 0x7fefd4158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.099+0000 7fefd9800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefd40c86c0 0x7fefd40c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.099+0000 7fefd9800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd415d740 con 0x7fefd415efc0 2024-08-17T02:47:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.099+0000 7fefd9800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd41690d0 con 0x7fefd40c86c0 2024-08-17T02:47:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.099+0000 7fefd9800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd40c9050 con 0x7fefb8003b90 2024-08-17T02:47:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.099+0000 7fefd2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd415efc0 0x7fefd4158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.099+0000 7fefd2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd415efc0 0x7fefd4158310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43440/0 (socket says 172.21.15.5:43440) 2024-08-17T02:47:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.099+0000 7fefd2000640 1 -- 172.21.15.5:0/828040326 learned_addr learned my addr 172.21.15.5:0/828040326 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.099+0000 7fefd3400640 1 --2- 172.21.15.5:0/828040326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefd40c86c0 0x7fefd40c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.099+0000 7fefd2a00640 1 --2- 172.21.15.5:0/828040326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefb8003b90 0x7fefd415d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.099+0000 7fefd2000640 1 -- 172.21.15.5:0/828040326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefb8003b90 msgr2=0x7fefd415d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.099+0000 7fefd2000640 1 --2- 172.21.15.5:0/828040326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefb8003b90 0x7fefd415d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.099+0000 7fefd2000640 1 -- 172.21.15.5:0/828040326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefd40c86c0 msgr2=0x7fefd40c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.099+0000 7fefd2000640 1 --2- 172.21.15.5:0/828040326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefd40c86c0 0x7fefd40c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.099+0000 7fefd2000640 1 -- 172.21.15.5:0/828040326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd415d930 con 0x7fefd415efc0 2024-08-17T02:47:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.100+0000 7fefd2000640 1 --2- 172.21.15.5:0/828040326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd415efc0 0x7fefd4158310 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fefc0002b70 tx=0x7fefc0007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.100+0000 7fefca000640 1 -- 172.21.15.5:0/828040326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc000fa70 con 0x7fefd415efc0 2024-08-17T02:47:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.100+0000 7fefca000640 1 -- 172.21.15.5:0/828040326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc000fbf0 con 0x7fefd415efc0 2024-08-17T02:47:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.100+0000 7fefd9800640 1 -- 172.21.15.5:0/828040326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd415dc10 con 0x7fefd415efc0 2024-08-17T02:47:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.100+0000 7fefca000640 1 -- 172.21.15.5:0/828040326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc00133f0 con 0x7fefd415efc0 2024-08-17T02:47:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.100+0000 7fefd9800640 1 -- 172.21.15.5:0/828040326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd415e1d0 con 0x7fefd415efc0 2024-08-17T02:47:27.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.101+0000 7fefd9800640 1 -- 172.21.15.5:0/828040326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd4169260 con 0x7fefd415efc0 2024-08-17T02:47:27.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.102+0000 7fefca000640 1 -- 172.21.15.5:0/828040326 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fefc00137e0 con 0x7fefd415efc0 2024-08-17T02:47:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.103+0000 7fefca000640 1 --2- 172.21.15.5:0/828040326 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fefb4065180 0x7fefb4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.103+0000 7fefca000640 1 -- 172.21.15.5:0/828040326 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fefc0082a50 con 0x7fefd415efc0 2024-08-17T02:47:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.103+0000 7fefd2a00640 1 --2- 172.21.15.5:0/828040326 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fefb4065180 0x7fefb4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.104+0000 7fefd2a00640 1 --2- 172.21.15.5:0/828040326 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fefb4065180 0x7fefb4067630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fefc4032000 tx=0x7fefc4033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:27.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.107+0000 7fefca000640 1 -- 172.21.15.5:0/828040326 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fefc0050b20 con 0x7fefd415efc0 2024-08-17T02:47:27.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.289+0000 7fefd9800640 1 -- 172.21.15.5:0/828040326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fefd4063fb0 con 0x7fefd415efc0 2024-08-17T02:47:27.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.289+0000 7fefca000640 1 -- 172.21.15.5:0/828040326 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fefc00170a0 con 0x7fefd415efc0 2024-08-17T02:47:27.290 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:47:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.290+0000 7fefd9800640 1 -- 172.21.15.5:0/828040326 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fefb4065180 msgr2=0x7fefb4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.290+0000 7fefd9800640 1 --2- 172.21.15.5:0/828040326 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fefb4065180 0x7fefb4067630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fefc4032000 tx=0x7fefc4033000 comp rx=0 tx=0).stop 2024-08-17T02:47:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.290+0000 7fefd9800640 1 -- 172.21.15.5:0/828040326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd415efc0 msgr2=0x7fefd4158310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.290+0000 7fefd9800640 1 --2- 172.21.15.5:0/828040326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd415efc0 0x7fefd4158310 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fefc0002b70 tx=0x7fefc0007ca0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.290+0000 7fefd9800640 1 -- 172.21.15.5:0/828040326 shutdown_connections 2024-08-17T02:47:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.290+0000 7fefd9800640 1 --2- 172.21.15.5:0/828040326 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fefb4065180 0x7fefb4067630 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.290+0000 7fefd9800640 1 --2- 172.21.15.5:0/828040326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefd40c86c0 0x7fefd40c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.290+0000 7fefd9800640 1 --2- 172.21.15.5:0/828040326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefd415efc0 0x7fefd4158310 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.290+0000 7fefd9800640 1 --2- 172.21.15.5:0/828040326 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefb8003b90 0x7fefd415d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.290+0000 7fefd9800640 1 -- 172.21.15.5:0/828040326 >> 172.21.15.5:0/828040326 conn(0x7fefd406e590 msgr2=0x7fefd40b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.290+0000 7fefd9800640 1 -- 172.21.15.5:0/828040326 shutdown_connections 2024-08-17T02:47:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.290+0000 7fefd9800640 1 -- 172.21.15.5:0/828040326 wait complete. 2024-08-17T02:47:27.306 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:47:27.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:47:27.449 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:47:27.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.459+0000 7f909fe00640 1 Processor -- start 2024-08-17T02:47:27.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.459+0000 7f909fe00640 1 -- start start 2024-08-17T02:47:27.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.460+0000 7f909fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f90980ad960 0x7f909815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.460+0000 7f909fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90980ca050 0x7f9098156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.460+0000 7f909fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90980add30 0x7f9098156960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.460+0000 7f909fe00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909815b5e0 con 0x7f90980add30 2024-08-17T02:47:27.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.461+0000 7f909fe00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90980cb160 con 0x7f90980ad960 2024-08-17T02:47:27.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.461+0000 7f909fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90980b0d10 con 0x7f90980ca050 2024-08-17T02:47:27.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.461+0000 7f909de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90980add30 0x7f9098156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.461+0000 7f909de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90980add30 0x7f9098156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43444/0 (socket says 172.21.15.5:43444) 2024-08-17T02:47:27.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.461+0000 7f909de00640 1 -- 172.21.15.5:0/1013769072 learned_addr learned my addr 172.21.15.5:0/1013769072 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:27.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.461+0000 7f909ca00640 1 --2- 172.21.15.5:0/1013769072 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90980ca050 0x7f9098156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.461+0000 7f909d400640 1 --2- 172.21.15.5:0/1013769072 >> v2:172.21.15.107:3300/0 conn(0x7f90980ad960 0x7f909815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.461+0000 7f909de00640 1 -- 172.21.15.5:0/1013769072 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90980ca050 msgr2=0x7f9098156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:27.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.461+0000 7f909de00640 1 --2- 172.21.15.5:0/1013769072 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90980ca050 0x7f9098156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.461+0000 7f909de00640 1 -- 172.21.15.5:0/1013769072 >> v2:172.21.15.107:3300/0 conn(0x7f90980ad960 msgr2=0x7f909815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:27.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.461+0000 7f909de00640 1 --2- 172.21.15.5:0/1013769072 >> v2:172.21.15.107:3300/0 conn(0x7f90980ad960 0x7f909815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.461+0000 7f909de00640 1 -- 172.21.15.5:0/1013769072 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90980ca550 con 0x7f90980add30 2024-08-17T02:47:27.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.462+0000 7f909de00640 1 --2- 172.21.15.5:0/1013769072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90980add30 0x7f9098156960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f90980cc910 tx=0x7f9090009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca6bb717a1e9888 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:27.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.463+0000 7f9097e00640 1 -- 172.21.15.5:0/1013769072 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090031400 con 0x7f90980add30 2024-08-17T02:47:27.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.463+0000 7f9097e00640 1 -- 172.21.15.5:0/1013769072 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909002d050 con 0x7f90980add30 2024-08-17T02:47:27.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.463+0000 7f9097e00640 1 -- 172.21.15.5:0/1013769072 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900317d0 con 0x7f90980add30 2024-08-17T02:47:27.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.463+0000 7f909fe00640 1 -- 172.21.15.5:0/1013769072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90980add30 msgr2=0x7f9098156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.463+0000 7f909fe00640 1 --2- 172.21.15.5:0/1013769072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90980add30 0x7f9098156960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f90980cc910 tx=0x7f9090009840 comp rx=0 tx=0).stop 2024-08-17T02:47:27.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.464+0000 7f909fe00640 1 -- 172.21.15.5:0/1013769072 shutdown_connections 2024-08-17T02:47:27.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.464+0000 7f909fe00640 1 --2- 172.21.15.5:0/1013769072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90980add30 0x7f9098156960 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.464+0000 7f909fe00640 1 --2- 172.21.15.5:0/1013769072 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90980ca050 0x7f9098156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.464+0000 7f909fe00640 1 --2- 172.21.15.5:0/1013769072 >> v2:172.21.15.107:3300/0 conn(0x7f90980ad960 0x7f909815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.464+0000 7f909fe00640 1 -- 172.21.15.5:0/1013769072 >> 172.21.15.5:0/1013769072 conn(0x7f9098066e60 msgr2=0x7f9098067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:27.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.464+0000 7f909fe00640 1 -- 172.21.15.5:0/1013769072 shutdown_connections 2024-08-17T02:47:27.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.464+0000 7f909fe00640 1 -- 172.21.15.5:0/1013769072 wait complete. 2024-08-17T02:47:27.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.465+0000 7f909fe00640 1 Processor -- start 2024-08-17T02:47:27.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.465+0000 7f909fe00640 1 -- start start 2024-08-17T02:47:27.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.466+0000 7f909fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90980ad960 0x7f909815c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.466+0000 7f909fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90980add30 0x7f9098140220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.466+0000 7f909fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90980ca050 0x7f909815dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.466+0000 7f909fe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909806b9f0 con 0x7f90980ca050 2024-08-17T02:47:27.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.466+0000 7f909fe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909806b710 con 0x7f90980add30 2024-08-17T02:47:27.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.466+0000 7f909fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909814f150 con 0x7f90980ad960 2024-08-17T02:47:27.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.466+0000 7f909de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90980ca050 0x7f909815dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.467+0000 7f909de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90980ca050 0x7f909815dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43448/0 (socket says 172.21.15.5:43448) 2024-08-17T02:47:27.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.467+0000 7f909d400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90980ad960 0x7f909815c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.467+0000 7f909de00640 1 -- 172.21.15.5:0/3653826032 learned_addr learned my addr 172.21.15.5:0/3653826032 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:27.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.467+0000 7f909ca00640 1 --2- 172.21.15.5:0/3653826032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90980add30 0x7f9098140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.467+0000 7f909de00640 1 -- 172.21.15.5:0/3653826032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90980ad960 msgr2=0x7f909815c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.467+0000 7f909de00640 1 --2- 172.21.15.5:0/3653826032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90980ad960 0x7f909815c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.467+0000 7f909de00640 1 -- 172.21.15.5:0/3653826032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90980add30 msgr2=0x7f9098140220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.467+0000 7f909de00640 1 --2- 172.21.15.5:0/3653826032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90980add30 0x7f9098140220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.467+0000 7f909de00640 1 -- 172.21.15.5:0/3653826032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9090009ae0 con 0x7f90980ca050 2024-08-17T02:47:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.467+0000 7f909de00640 1 --2- 172.21.15.5:0/3653826032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90980ca050 0x7f909815dc10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f909002ad40 tx=0x7f9090036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.468+0000 7f9094c00640 1 -- 172.21.15.5:0/3653826032 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090031880 con 0x7f90980ca050 2024-08-17T02:47:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.468+0000 7f9094c00640 1 -- 172.21.15.5:0/3653826032 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9090007170 con 0x7f90980ca050 2024-08-17T02:47:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.468+0000 7f9094c00640 1 -- 172.21.15.5:0/3653826032 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909003b640 con 0x7f90980ca050 2024-08-17T02:47:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.468+0000 7f909fe00640 1 -- 172.21.15.5:0/3653826032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909814f430 con 0x7f90980ca050 2024-08-17T02:47:27.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.468+0000 7f909fe00640 1 -- 172.21.15.5:0/3653826032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9098169020 con 0x7f90980ca050 2024-08-17T02:47:27.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.469+0000 7f909fe00640 1 -- 172.21.15.5:0/3653826032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909814f930 con 0x7f90980ca050 2024-08-17T02:47:27.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.470+0000 7f9094c00640 1 -- 172.21.15.5:0/3653826032 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9090038050 con 0x7f90980ca050 2024-08-17T02:47:27.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.471+0000 7f9094c00640 1 --2- 172.21.15.5:0/3653826032 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9078065220 0x7f90780676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.471+0000 7f9094c00640 1 -- 172.21.15.5:0/3653826032 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f90900a28d0 con 0x7f90980ca050 2024-08-17T02:47:27.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.471+0000 7f909d400640 1 --2- 172.21.15.5:0/3653826032 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9078065220 0x7f90780676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.472+0000 7f909d400640 1 --2- 172.21.15.5:0/3653826032 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9078065220 0x7f90780676d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f908c009c80 tx=0x7f908c0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:27.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.475+0000 7f9094c00640 1 -- 172.21.15.5:0/3653826032 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9090070ae0 con 0x7f90980ca050 2024-08-17T02:47:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.657+0000 7f909fe00640 1 -- 172.21.15.5:0/3653826032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9098063fb0 con 0x7f90980ca050 2024-08-17T02:47:27.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.658+0000 7f9094c00640 1 -- 172.21.15.5:0/3653826032 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f90900a20a0 con 0x7f90980ca050 2024-08-17T02:47:27.659 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:47:27.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.660+0000 7f909fe00640 1 -- 172.21.15.5:0/3653826032 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9078065220 msgr2=0x7f90780676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.660+0000 7f909fe00640 1 --2- 172.21.15.5:0/3653826032 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9078065220 0x7f90780676d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f908c009c80 tx=0x7f908c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.660+0000 7f909fe00640 1 -- 172.21.15.5:0/3653826032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90980ca050 msgr2=0x7f909815dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.660+0000 7f909fe00640 1 --2- 172.21.15.5:0/3653826032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90980ca050 0x7f909815dc10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f909002ad40 tx=0x7f9090036000 comp rx=0 tx=0).stop 2024-08-17T02:47:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.660+0000 7f909fe00640 1 -- 172.21.15.5:0/3653826032 shutdown_connections 2024-08-17T02:47:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.660+0000 7f909fe00640 1 --2- 172.21.15.5:0/3653826032 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9078065220 0x7f90780676d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.660+0000 7f909fe00640 1 --2- 172.21.15.5:0/3653826032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90980ca050 0x7f909815dc10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.660+0000 7f909fe00640 1 --2- 172.21.15.5:0/3653826032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90980add30 0x7f9098140220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.660+0000 7f909fe00640 1 --2- 172.21.15.5:0/3653826032 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90980ad960 0x7f909815c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.660+0000 7f909fe00640 1 -- 172.21.15.5:0/3653826032 >> 172.21.15.5:0/3653826032 conn(0x7f9098066e60 msgr2=0x7f90980b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.660+0000 7f909fe00640 1 -- 172.21.15.5:0/3653826032 shutdown_connections 2024-08-17T02:47:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.660+0000 7f909fe00640 1 -- 172.21.15.5:0/3653826032 wait complete. 2024-08-17T02:47:27.677 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.827+0000 7f711ee00640 1 Processor -- start 2024-08-17T02:47:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.827+0000 7f711ee00640 1 -- start start 2024-08-17T02:47:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.829+0000 7f711ee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f71180ae860 0x7f711806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.829+0000 7f711ee00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7118158df0 0x7f711806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.829+0000 7f711ee00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71180aed90 con 0x7f7118158a20 2024-08-17T02:47:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.829+0000 7f711ee00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71180af070 con 0x7f7118158df0 2024-08-17T02:47:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.829+0000 7f711ee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71180af350 con 0x7f71180ae860 2024-08-17T02:47:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.829+0000 7f711ce00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7118158df0 0x7f711806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.829+0000 7f711ce00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7118158df0 0x7f711806dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43464/0 (socket says 172.21.15.5:43464) 2024-08-17T02:47:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.829+0000 7f711ce00640 1 -- 172.21.15.5:0/1769257713 learned_addr learned my addr 172.21.15.5:0/1769257713 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.829+0000 7f710fe00640 1 --2- 172.21.15.5:0/1769257713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f71180ae860 0x7f711806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.829+0000 7f711ce00640 1 -- 172.21.15.5:0/1769257713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f71180ae860 msgr2=0x7f711806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.829+0000 7f711ce00640 1 --2- 172.21.15.5:0/1769257713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f71180ae860 0x7f711806d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.829+0000 7f711ce00640 1 -- 172.21.15.5:0/1769257713 >> v1:172.21.15.107:6789/0 conn(0x7f7118158a20 legacy=0x7f71180a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.830+0000 7f711ce00640 1 -- 172.21.15.5:0/1769257713 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71180af630 con 0x7f7118158df0 2024-08-17T02:47:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.830+0000 7f711ce00640 1 --2- 172.21.15.5:0/1769257713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7118158df0 0x7f711806dd10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7110009f20 tx=0x7f7110009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce59e3f9a5c46dc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.831+0000 7f7117400640 1 -- 172.21.15.5:0/1769257713 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110031400 con 0x7f7118158df0 2024-08-17T02:47:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.831+0000 7f7117400640 1 -- 172.21.15.5:0/1769257713 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711002d050 con 0x7f7118158df0 2024-08-17T02:47:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.831+0000 7f7117400640 1 -- 172.21.15.5:0/1769257713 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71100317d0 con 0x7f7118158df0 2024-08-17T02:47:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.831+0000 7f711ee00640 1 -- 172.21.15.5:0/1769257713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7118158df0 msgr2=0x7f711806dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.831+0000 7f711ee00640 1 --2- 172.21.15.5:0/1769257713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7118158df0 0x7f711806dd10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7110009f20 tx=0x7f7110009840 comp rx=0 tx=0).stop 2024-08-17T02:47:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.831+0000 7f711ee00640 1 -- 172.21.15.5:0/1769257713 shutdown_connections 2024-08-17T02:47:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.831+0000 7f711ee00640 1 --2- 172.21.15.5:0/1769257713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7118158df0 0x7f711806dd10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.831+0000 7f711ee00640 1 --2- 172.21.15.5:0/1769257713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f71180ae860 0x7f711806d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.831+0000 7f711ee00640 1 -- 172.21.15.5:0/1769257713 >> 172.21.15.5:0/1769257713 conn(0x7f7118066e60 msgr2=0x7f7118067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.832+0000 7f711ee00640 1 -- 172.21.15.5:0/1769257713 shutdown_connections 2024-08-17T02:47:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.832+0000 7f711ee00640 1 -- 172.21.15.5:0/1769257713 wait complete. 2024-08-17T02:47:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.833+0000 7f711ee00640 1 Processor -- start 2024-08-17T02:47:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.833+0000 7f711ee00640 1 -- start start 2024-08-17T02:47:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.834+0000 7f711ee00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71180ae860 0x7f7118146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.834+0000 7f711ee00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7118158a20 0x7f711815ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.834+0000 7f711ee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7118158df0 0x7f711815b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.834+0000 7f711ee00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71180adbf0 con 0x7f71180ae860 2024-08-17T02:47:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.834+0000 7f711ee00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71180acfe0 con 0x7f7118158a20 2024-08-17T02:47:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.834+0000 7f711ee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71180ad2c0 con 0x7f7118158df0 2024-08-17T02:47:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.834+0000 7f7117e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71180ae860 0x7f7118146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.834+0000 7f7117e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71180ae860 0x7f7118146340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43480/0 (socket says 172.21.15.5:43480) 2024-08-17T02:47:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.834+0000 7f7117e00640 1 -- 172.21.15.5:0/3744740536 learned_addr learned my addr 172.21.15.5:0/3744740536 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.834+0000 7f711ce00640 1 --2- 172.21.15.5:0/3744740536 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7118158df0 0x7f711815b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.834+0000 7f710fe00640 1 --2- 172.21.15.5:0/3744740536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7118158a20 0x7f711815ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.835+0000 7f7117e00640 1 -- 172.21.15.5:0/3744740536 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7118158df0 msgr2=0x7f711815b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.835+0000 7f7117e00640 1 --2- 172.21.15.5:0/3744740536 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7118158df0 0x7f711815b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.835+0000 7f7117e00640 1 -- 172.21.15.5:0/3744740536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7118158a20 msgr2=0x7f711815ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:27.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.835+0000 7f7117e00640 1 --2- 172.21.15.5:0/3744740536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7118158a20 0x7f711815ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.835+0000 7f7117e00640 1 -- 172.21.15.5:0/3744740536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7110009ae0 con 0x7f71180ae860 2024-08-17T02:47:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.835+0000 7f7117e00640 1 --2- 172.21.15.5:0/3744740536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71180ae860 0x7f7118146340 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f710800c560 tx=0x7f7108007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.835+0000 7f710f400640 1 -- 172.21.15.5:0/3744740536 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108011590 con 0x7f71180ae860 2024-08-17T02:47:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.835+0000 7f710f400640 1 -- 172.21.15.5:0/3744740536 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7108011710 con 0x7f71180ae860 2024-08-17T02:47:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.835+0000 7f710f400640 1 -- 172.21.15.5:0/3744740536 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108011ad0 con 0x7f71180ae860 2024-08-17T02:47:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.835+0000 7f711ee00640 1 -- 172.21.15.5:0/3744740536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71180ad5a0 con 0x7f71180ae860 2024-08-17T02:47:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.835+0000 7f711ee00640 1 -- 172.21.15.5:0/3744740536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7118146880 con 0x7f71180ae860 2024-08-17T02:47:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.836+0000 7f711ee00640 1 -- 172.21.15.5:0/3744740536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7118063fb0 con 0x7f71180ae860 2024-08-17T02:47:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.837+0000 7f710f400640 1 -- 172.21.15.5:0/3744740536 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f710801b3b0 con 0x7f71180ae860 2024-08-17T02:47:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.838+0000 7f710f400640 1 --2- 172.21.15.5:0/3744740536 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f70f4065150 0x7f70f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.838+0000 7f710f400640 1 -- 172.21.15.5:0/3744740536 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f71080819e0 con 0x7f71180ae860 2024-08-17T02:47:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.838+0000 7f710fe00640 1 --2- 172.21.15.5:0/3744740536 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f70f4065150 0x7f70f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.839+0000 7f710fe00640 1 --2- 172.21.15.5:0/3744740536 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f70f4065150 0x7f70f4067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f711806b450 tx=0x7f7100008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:27.842+0000 7f710f400640 1 -- 172.21.15.5:0/3744740536 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f710804fab0 con 0x7f71180ae860 2024-08-17T02:47:28.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.028+0000 7f711ee00640 1 -- 172.21.15.5:0/3744740536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f711806e4c0 con 0x7f71180ae860 2024-08-17T02:47:28.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.029+0000 7f710f400640 1 -- 172.21.15.5:0/3744740536 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f7108017070 con 0x7f71180ae860 2024-08-17T02:47:28.030 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:28.030 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:59.170637+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:55.543347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:56.571235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.031+0000 7f711ee00640 1 -- 172.21.15.5:0/3744740536 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f70f4065150 msgr2=0x7f70f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.031+0000 7f711ee00640 1 --2- 172.21.15.5:0/3744740536 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f70f4065150 0x7f70f4067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f711806b450 tx=0x7f7100008040 comp rx=0 tx=0).stop 2024-08-17T02:47:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.031+0000 7f711ee00640 1 -- 172.21.15.5:0/3744740536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71180ae860 msgr2=0x7f7118146340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.031+0000 7f711ee00640 1 --2- 172.21.15.5:0/3744740536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71180ae860 0x7f7118146340 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f710800c560 tx=0x7f7108007ef0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.031+0000 7f711ee00640 1 -- 172.21.15.5:0/3744740536 shutdown_connections 2024-08-17T02:47:28.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.031+0000 7f711ee00640 1 --2- 172.21.15.5:0/3744740536 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f70f4065150 0x7f70f4067600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.031+0000 7f711ee00640 1 --2- 172.21.15.5:0/3744740536 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7118158df0 0x7f711815b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.031+0000 7f711ee00640 1 --2- 172.21.15.5:0/3744740536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7118158a20 0x7f711815ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.031+0000 7f711ee00640 1 --2- 172.21.15.5:0/3744740536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71180ae860 0x7f7118146340 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.031+0000 7f711ee00640 1 -- 172.21.15.5:0/3744740536 >> 172.21.15.5:0/3744740536 conn(0x7f7118066e60 msgr2=0x7f7118069830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:28.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.031+0000 7f711ee00640 1 -- 172.21.15.5:0/3744740536 shutdown_connections 2024-08-17T02:47:28.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.031+0000 7f711ee00640 1 -- 172.21.15.5:0/3744740536 wait complete. 2024-08-17T02:47:28.047 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:47.106425+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:55.543347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:56.571235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:47:28.048 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:28.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.200+0000 7f3055e00640 1 Processor -- start 2024-08-17T02:47:28.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.200+0000 7f3055e00640 1 -- start start 2024-08-17T02:47:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.201+0000 7f3055e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30500ae860 0x7f30500add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.201+0000 7f3055e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30500ad8a0 con 0x7f3050158e60 2024-08-17T02:47:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.201+0000 7f3055e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305006edf0 con 0x7f30500b0ac0 2024-08-17T02:47:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.201+0000 7f3055e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30500acc90 con 0x7f30500ae860 2024-08-17T02:47:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.202+0000 7f304ea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3050158e60 0x7f30500b03b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54212/0 (socket says 172.21.15.5:54212) 2024-08-17T02:47:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.202+0000 7f304ea00640 1 -- 172.21.15.5:0/931324929 learned_addr learned my addr 172.21.15.5:0/931324929 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:28.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.202+0000 7f304f400640 1 --2- 172.21.15.5:0/931324929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30500ae860 0x7f30500add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.202+0000 7f304e000640 1 -- 172.21.15.5:0/931324929 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187027635 0 0) 0x7f30500ad8a0 con 0x7f3050158e60 2024-08-17T02:47:28.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.202+0000 7f304e000640 1 -- 172.21.15.5:0/931324929 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30340034e0 con 0x7f3050158e60 2024-08-17T02:47:28.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.202+0000 7f304e000640 1 -- 172.21.15.5:0/931324929 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295479711 0 0) 0x7f305006edf0 con 0x7f30500b0ac0 2024-08-17T02:47:28.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.202+0000 7f304e000640 1 -- 172.21.15.5:0/931324929 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30500ad8a0 con 0x7f30500b0ac0 2024-08-17T02:47:28.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.202+0000 7f304f400640 1 -- 172.21.15.5:0/931324929 >> v1:172.21.15.107:6789/0 conn(0x7f30500b0ac0 legacy=0x7f30500c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.202+0000 7f304f400640 1 -- 172.21.15.5:0/931324929 >> v1:172.21.15.5:6789/0 conn(0x7f3050158e60 legacy=0x7f30500b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.202+0000 7f304f400640 1 -- 172.21.15.5:0/931324929 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30500acf70 con 0x7f30500ae860 2024-08-17T02:47:28.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.203+0000 7f304f400640 1 --2- 172.21.15.5:0/931324929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30500ae860 0x7f30500add30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3048009880 tx=0x7f30480090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ba82c560d4d30e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:28.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.204+0000 7f304e000640 1 -- 172.21.15.5:0/931324929 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304802ae10 con 0x7f30500ae860 2024-08-17T02:47:28.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.204+0000 7f304e000640 1 -- 172.21.15.5:0/931324929 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3048032440 con 0x7f30500ae860 2024-08-17T02:47:28.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.204+0000 7f304e000640 1 -- 172.21.15.5:0/931324929 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30480327e0 con 0x7f30500ae860 2024-08-17T02:47:28.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.204+0000 7f3055e00640 1 -- 172.21.15.5:0/931324929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30500ae860 msgr2=0x7f30500add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.204+0000 7f3055e00640 1 --2- 172.21.15.5:0/931324929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30500ae860 0x7f30500add30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3048009880 tx=0x7f30480090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.204+0000 7f3055e00640 1 -- 172.21.15.5:0/931324929 shutdown_connections 2024-08-17T02:47:28.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.204+0000 7f3055e00640 1 --2- 172.21.15.5:0/931324929 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30500ae860 0x7f30500add30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.204+0000 7f3055e00640 1 -- 172.21.15.5:0/931324929 >> 172.21.15.5:0/931324929 conn(0x7f30500cc390 msgr2=0x7f3050066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:28.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.205+0000 7f3055e00640 1 -- 172.21.15.5:0/931324929 shutdown_connections 2024-08-17T02:47:28.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.205+0000 7f3055e00640 1 -- 172.21.15.5:0/931324929 wait complete. 2024-08-17T02:47:28.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.206+0000 7f3055e00640 1 Processor -- start 2024-08-17T02:47:28.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.206+0000 7f3055e00640 1 -- start start 2024-08-17T02:47:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.207+0000 7f3055e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30500ae860 0x7f3050157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.207+0000 7f3055e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30500b0ac0 0x7f30501692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.207+0000 7f3055e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050158e60 0x7f305016a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.207+0000 7f3055e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3050157e40 con 0x7f3050158e60 2024-08-17T02:47:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.207+0000 7f3055e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3050169b70 con 0x7f30500ae860 2024-08-17T02:47:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.207+0000 7f3055e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3050169e50 con 0x7f30500b0ac0 2024-08-17T02:47:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.207+0000 7f304f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050158e60 0x7f305016a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.207+0000 7f304f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050158e60 0x7f305016a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43488/0 (socket says 172.21.15.5:43488) 2024-08-17T02:47:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.207+0000 7f304f400640 1 -- 172.21.15.5:0/2625174757 learned_addr learned my addr 172.21.15.5:0/2625174757 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.208+0000 7f304ea00640 1 --2- 172.21.15.5:0/2625174757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30500ae860 0x7f3050157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.208+0000 7f3046000640 1 --2- 172.21.15.5:0/2625174757 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30500b0ac0 0x7f30501692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.208+0000 7f304f400640 1 -- 172.21.15.5:0/2625174757 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30500b0ac0 msgr2=0x7f30501692d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.208+0000 7f304f400640 1 --2- 172.21.15.5:0/2625174757 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30500b0ac0 0x7f30501692d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.208+0000 7f304f400640 1 -- 172.21.15.5:0/2625174757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30500ae860 msgr2=0x7f3050157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.208+0000 7f304f400640 1 --2- 172.21.15.5:0/2625174757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30500ae860 0x7f3050157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.208+0000 7f304f400640 1 -- 172.21.15.5:0/2625174757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3048009390 con 0x7f3050158e60 2024-08-17T02:47:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.208+0000 7f304f400640 1 --2- 172.21.15.5:0/2625174757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050158e60 0x7f305016a480 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f30480097d0 tx=0x7f3048032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.208+0000 7f3046a00640 1 -- 172.21.15.5:0/2625174757 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048031a60 con 0x7f3050158e60 2024-08-17T02:47:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.208+0000 7f3046a00640 1 -- 172.21.15.5:0/2625174757 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3048031bc0 con 0x7f3050158e60 2024-08-17T02:47:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.208+0000 7f3046a00640 1 -- 172.21.15.5:0/2625174757 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304803d420 con 0x7f3050158e60 2024-08-17T02:47:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.208+0000 7f3055e00640 1 -- 172.21.15.5:0/2625174757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305016a130 con 0x7f3050158e60 2024-08-17T02:47:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.209+0000 7f3055e00640 1 -- 172.21.15.5:0/2625174757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30500ca0b0 con 0x7f3050158e60 2024-08-17T02:47:28.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.210+0000 7f3055e00640 1 -- 172.21.15.5:0/2625174757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3050063fb0 con 0x7f3050158e60 2024-08-17T02:47:28.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.210+0000 7f3046a00640 1 -- 172.21.15.5:0/2625174757 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3048039040 con 0x7f3050158e60 2024-08-17T02:47:28.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.211+0000 7f3046a00640 1 --2- 172.21.15.5:0/2625174757 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f302c065150 0x7f302c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.211+0000 7f3046a00640 1 -- 172.21.15.5:0/2625174757 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f30480a2070 con 0x7f3050158e60 2024-08-17T02:47:28.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.211+0000 7f304ea00640 1 --2- 172.21.15.5:0/2625174757 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f302c065150 0x7f302c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.212+0000 7f304ea00640 1 --2- 172.21.15.5:0/2625174757 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f302c065150 0x7f302c067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3040005bc0 tx=0x7f3040009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:28.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.215+0000 7f3046a00640 1 -- 172.21.15.5:0/2625174757 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f30480d3e40 con 0x7f3050158e60 2024-08-17T02:47:28.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.400+0000 7f3055e00640 1 -- 172.21.15.5:0/2625174757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30500ca2a0 con 0x7f3050158e60 2024-08-17T02:47:28.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.401+0000 7f3046a00640 1 -- 172.21.15.5:0/2625174757 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3048070140 con 0x7f3050158e60 2024-08-17T02:47:28.402 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:47:28.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.402+0000 7f3055e00640 1 -- 172.21.15.5:0/2625174757 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f302c065150 msgr2=0x7f302c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.402+0000 7f3055e00640 1 --2- 172.21.15.5:0/2625174757 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f302c065150 0x7f302c067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3040005bc0 tx=0x7f3040009040 comp rx=0 tx=0).stop 2024-08-17T02:47:28.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.402+0000 7f3055e00640 1 -- 172.21.15.5:0/2625174757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050158e60 msgr2=0x7f305016a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.402+0000 7f3055e00640 1 --2- 172.21.15.5:0/2625174757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050158e60 0x7f305016a480 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f30480097d0 tx=0x7f3048032000 comp rx=0 tx=0).stop 2024-08-17T02:47:28.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.403+0000 7f3055e00640 1 -- 172.21.15.5:0/2625174757 shutdown_connections 2024-08-17T02:47:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.403+0000 7f3055e00640 1 --2- 172.21.15.5:0/2625174757 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f302c065150 0x7f302c067600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.403+0000 7f3055e00640 1 --2- 172.21.15.5:0/2625174757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050158e60 0x7f305016a480 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.403+0000 7f3055e00640 1 --2- 172.21.15.5:0/2625174757 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f30500b0ac0 0x7f30501692d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.403+0000 7f3055e00640 1 --2- 172.21.15.5:0/2625174757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30500ae860 0x7f3050157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.403+0000 7f3055e00640 1 -- 172.21.15.5:0/2625174757 >> 172.21.15.5:0/2625174757 conn(0x7f30500cc390 msgr2=0x7f305006a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.403+0000 7f3055e00640 1 -- 172.21.15.5:0/2625174757 shutdown_connections 2024-08-17T02:47:28.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.403+0000 7f3055e00640 1 -- 172.21.15.5:0/2625174757 wait complete. 2024-08-17T02:47:28.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:47:28.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.573+0000 7f99a5e00640 1 Processor -- start 2024-08-17T02:47:28.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.573+0000 7f99a5e00640 1 -- start start 2024-08-17T02:47:28.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.574+0000 7f99a5e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99a0158b90 0x7f99a00b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.574+0000 7f99a5e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f99a00af130 0x7f99a00ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.574+0000 7f99a5e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a00afd20 con 0x7f99a00b2370 2024-08-17T02:47:28.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.574+0000 7f99a5e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a00affe0 con 0x7f99a0158b90 2024-08-17T02:47:28.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.574+0000 7f99a5e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a00b02c0 con 0x7f99a00af130 2024-08-17T02:47:28.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.574+0000 7f999e000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f99a00b2370 0x7f99a00aea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54214/0 (socket says 172.21.15.5:54214) 2024-08-17T02:47:28.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.574+0000 7f999e000640 1 -- 172.21.15.5:0/2901478267 learned_addr learned my addr 172.21.15.5:0/2901478267 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:28.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.574+0000 7f999ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99a0158b90 0x7f99a00b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.575+0000 7f999f400640 1 --2- 172.21.15.5:0/2901478267 >> v2:172.21.15.107:3300/0 conn(0x7f99a00af130 0x7f99a00ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.575+0000 7f999ea00640 1 -- 172.21.15.5:0/2901478267 >> v2:172.21.15.107:3300/0 conn(0x7f99a00af130 msgr2=0x7f99a00ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:28.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.575+0000 7f999ea00640 1 --2- 172.21.15.5:0/2901478267 >> v2:172.21.15.107:3300/0 conn(0x7f99a00af130 0x7f99a00ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.575+0000 7f999ea00640 1 -- 172.21.15.5:0/2901478267 >> v1:172.21.15.5:6789/0 conn(0x7f99a00b2370 legacy=0x7f99a00aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.575+0000 7f999ea00640 1 -- 172.21.15.5:0/2901478267 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a00ca3c0 con 0x7f99a0158b90 2024-08-17T02:47:28.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.575+0000 7f999f400640 1 --2- 172.21.15.5:0/2901478267 >> v2:172.21.15.107:3300/0 conn(0x7f99a00af130 0x7f99a00ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:28.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.576+0000 7f999ea00640 1 --2- 172.21.15.5:0/2901478267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a0158b90 0x7f99a00b1e30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f99a0066fc0 tx=0x7f99900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abf7a9737155362 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:28.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.576+0000 7f999d600640 1 -- 172.21.15.5:0/2901478267 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999002adb0 con 0x7f99a0158b90 2024-08-17T02:47:28.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.576+0000 7f999d600640 1 -- 172.21.15.5:0/2901478267 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9990032440 con 0x7f99a0158b90 2024-08-17T02:47:28.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.576+0000 7f999d600640 1 -- 172.21.15.5:0/2901478267 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990032820 con 0x7f99a0158b90 2024-08-17T02:47:28.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.577+0000 7f99a5e00640 1 -- 172.21.15.5:0/2901478267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a0158b90 msgr2=0x7f99a00b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.577+0000 7f99a5e00640 1 --2- 172.21.15.5:0/2901478267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a0158b90 0x7f99a00b1e30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f99a0066fc0 tx=0x7f99900090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.577+0000 7f99a5e00640 1 -- 172.21.15.5:0/2901478267 shutdown_connections 2024-08-17T02:47:28.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.577+0000 7f99a5e00640 1 --2- 172.21.15.5:0/2901478267 >> v2:172.21.15.107:3300/0 conn(0x7f99a00af130 0x7f99a00ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.577+0000 7f99a5e00640 1 --2- 172.21.15.5:0/2901478267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a0158b90 0x7f99a00b1e30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.577+0000 7f99a5e00640 1 -- 172.21.15.5:0/2901478267 >> 172.21.15.5:0/2901478267 conn(0x7f99a006e590 msgr2=0x7f99a006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:28.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.577+0000 7f99a5e00640 1 -- 172.21.15.5:0/2901478267 shutdown_connections 2024-08-17T02:47:28.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.577+0000 7f99a5e00640 1 -- 172.21.15.5:0/2901478267 wait complete. 2024-08-17T02:47:28.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.578+0000 7f99a5e00640 1 Processor -- start 2024-08-17T02:47:28.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.579+0000 7f99a5e00640 1 -- start start 2024-08-17T02:47:28.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.579+0000 7f99a5e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99a00af130 0x7f99a00c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.579+0000 7f99a5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a00b2370 0x7f99a015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.579+0000 7f99a5e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a0158b90 0x7f99a0157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.580+0000 7f99a5e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a015a320 con 0x7f99a00b2370 2024-08-17T02:47:28.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.580+0000 7f99a5e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00c7cf0 con 0x7f99a00af130 2024-08-17T02:47:28.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.580+0000 7f99a5e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00c7fd0 con 0x7f99a0158b90 2024-08-17T02:47:28.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.580+0000 7f999e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a00b2370 0x7f99a015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.580+0000 7f999e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a00b2370 0x7f99a015b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43512/0 (socket says 172.21.15.5:43512) 2024-08-17T02:47:28.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.580+0000 7f999e000640 1 -- 172.21.15.5:0/3246148483 learned_addr learned my addr 172.21.15.5:0/3246148483 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:28.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.580+0000 7f999ea00640 1 --2- 172.21.15.5:0/3246148483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99a00af130 0x7f99a00c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.580+0000 7f999f400640 1 --2- 172.21.15.5:0/3246148483 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a0158b90 0x7f99a0157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.580+0000 7f999e000640 1 -- 172.21.15.5:0/3246148483 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a0158b90 msgr2=0x7f99a0157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.580+0000 7f999e000640 1 --2- 172.21.15.5:0/3246148483 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a0158b90 0x7f99a0157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.580+0000 7f999e000640 1 -- 172.21.15.5:0/3246148483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99a00af130 msgr2=0x7f99a00c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.580+0000 7f999e000640 1 --2- 172.21.15.5:0/3246148483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99a00af130 0x7f99a00c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.580+0000 7f999e000640 1 -- 172.21.15.5:0/3246148483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9990009390 con 0x7f99a00b2370 2024-08-17T02:47:28.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.580+0000 7f999e000640 1 --2- 172.21.15.5:0/3246148483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a00b2370 0x7f99a015b0e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f998c00c7c0 tx=0x7f998c007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:28.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.581+0000 7f9996000640 1 -- 172.21.15.5:0/3246148483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c00ce90 con 0x7f99a00b2370 2024-08-17T02:47:28.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.581+0000 7f9996000640 1 -- 172.21.15.5:0/3246148483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998c005890 con 0x7f99a00b2370 2024-08-17T02:47:28.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.581+0000 7f99a5e00640 1 -- 172.21.15.5:0/3246148483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a00c82b0 con 0x7f99a00b2370 2024-08-17T02:47:28.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.581+0000 7f9996000640 1 -- 172.21.15.5:0/3246148483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c005c90 con 0x7f99a00b2370 2024-08-17T02:47:28.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.581+0000 7f99a5e00640 1 -- 172.21.15.5:0/3246148483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a0168e50 con 0x7f99a00b2370 2024-08-17T02:47:28.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.582+0000 7f99a5e00640 1 -- 172.21.15.5:0/3246148483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a0169130 con 0x7f99a00b2370 2024-08-17T02:47:28.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.583+0000 7f9996000640 1 -- 172.21.15.5:0/3246148483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f998c007300 con 0x7f99a00b2370 2024-08-17T02:47:28.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.584+0000 7f9996000640 1 --2- 172.21.15.5:0/3246148483 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9980065150 0x7f9980067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.584+0000 7f9996000640 1 -- 172.21.15.5:0/3246148483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f998c081ec0 con 0x7f99a00b2370 2024-08-17T02:47:28.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.584+0000 7f999ea00640 1 --2- 172.21.15.5:0/3246148483 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9980065150 0x7f9980067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.585+0000 7f999ea00640 1 --2- 172.21.15.5:0/3246148483 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9980065150 0x7f9980067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9990034000 tx=0x7f9990032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:28.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.587+0000 7f9996000640 1 -- 172.21.15.5:0/3246148483 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f99a0169130 con 0x7f99a00b2370 2024-08-17T02:47:28.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.771+0000 7f99a5e00640 1 -- 172.21.15.5:0/3246148483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f99a0169130 con 0x7f99a00b2370 2024-08-17T02:47:28.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.771+0000 7f9996000640 1 -- 172.21.15.5:0/3246148483 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f99a0169130 con 0x7f99a00b2370 2024-08-17T02:47:28.773 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:47:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.773+0000 7f99a5e00640 1 -- 172.21.15.5:0/3246148483 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9980065150 msgr2=0x7f9980067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.773+0000 7f99a5e00640 1 --2- 172.21.15.5:0/3246148483 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9980065150 0x7f9980067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9990034000 tx=0x7f9990032000 comp rx=0 tx=0).stop 2024-08-17T02:47:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.773+0000 7f99a5e00640 1 -- 172.21.15.5:0/3246148483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a00b2370 msgr2=0x7f99a015b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.773+0000 7f99a5e00640 1 --2- 172.21.15.5:0/3246148483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a00b2370 0x7f99a015b0e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f998c00c7c0 tx=0x7f998c007ed0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.773+0000 7f99a5e00640 1 -- 172.21.15.5:0/3246148483 shutdown_connections 2024-08-17T02:47:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.773+0000 7f99a5e00640 1 --2- 172.21.15.5:0/3246148483 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9980065150 0x7f9980067600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.773+0000 7f99a5e00640 1 --2- 172.21.15.5:0/3246148483 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f99a0158b90 0x7f99a0157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.773+0000 7f99a5e00640 1 --2- 172.21.15.5:0/3246148483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a00b2370 0x7f99a015b0e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.773+0000 7f99a5e00640 1 --2- 172.21.15.5:0/3246148483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99a00af130 0x7f99a00c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.773+0000 7f99a5e00640 1 -- 172.21.15.5:0/3246148483 >> 172.21.15.5:0/3246148483 conn(0x7f99a006e590 msgr2=0x7f99a00ca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:28.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.773+0000 7f99a5e00640 1 -- 172.21.15.5:0/3246148483 shutdown_connections 2024-08-17T02:47:28.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.774+0000 7f99a5e00640 1 -- 172.21.15.5:0/3246148483 wait complete. 2024-08-17T02:47:28.790 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:47:28.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.942+0000 7ff777800640 1 Processor -- start 2024-08-17T02:47:28.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.942+0000 7ff777800640 1 -- start start 2024-08-17T02:47:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.943+0000 7ff777800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7701589e0 0x7ff770158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.943+0000 7ff777800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff7700ca9c0 0x7ff7700cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.943+0000 7ff777800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7700cda30 0x7ff7700cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.943+0000 7ff777800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7700af810 con 0x7ff7701589e0 2024-08-17T02:47:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.943+0000 7ff777800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7700af9a0 con 0x7ff7700ca9c0 2024-08-17T02:47:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.943+0000 7ff777800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700cb340 con 0x7ff7700cda30 2024-08-17T02:47:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.944+0000 7ff774e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7701589e0 0x7ff770158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.944+0000 7ff774e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7701589e0 0x7ff770158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43516/0 (socket says 172.21.15.5:43516) 2024-08-17T02:47:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.944+0000 7ff774e00640 1 -- 172.21.15.5:0/4046604642 learned_addr learned my addr 172.21.15.5:0/4046604642 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:28.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.944+0000 7ff774e00640 1 -- 172.21.15.5:0/4046604642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7700cda30 msgr2=0x7ff7700cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:28.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.944+0000 7ff775800640 1 --2- 172.21.15.5:0/4046604642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7700cda30 0x7ff7700cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.944+0000 7ff774e00640 1 --2- 172.21.15.5:0/4046604642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7700cda30 0x7ff7700cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.944+0000 7ff76fe00640 1 --2- 172.21.15.5:0/4046604642 >> v2:172.21.15.107:3300/0 conn(0x7ff7700ca9c0 0x7ff7700cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.944+0000 7ff774e00640 1 -- 172.21.15.5:0/4046604642 >> v2:172.21.15.107:3300/0 conn(0x7ff7700ca9c0 msgr2=0x7ff7700cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:28.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.944+0000 7ff774e00640 1 --2- 172.21.15.5:0/4046604642 >> v2:172.21.15.107:3300/0 conn(0x7ff7700ca9c0 0x7ff7700cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.944+0000 7ff774e00640 1 -- 172.21.15.5:0/4046604642 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7700ce740 con 0x7ff7701589e0 2024-08-17T02:47:28.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.944+0000 7ff775800640 1 --2- 172.21.15.5:0/4046604642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7700cda30 0x7ff7700cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:28.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.944+0000 7ff76fe00640 1 --2- 172.21.15.5:0/4046604642 >> v2:172.21.15.107:3300/0 conn(0x7ff7700ca9c0 0x7ff7700cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:28.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.945+0000 7ff774e00640 1 --2- 172.21.15.5:0/4046604642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7701589e0 0x7ff770158db0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff7701592f0 tx=0x7ff7640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a85928fe49e6742 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:28.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.946+0000 7ff76f400640 1 -- 172.21.15.5:0/4046604642 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76402add0 con 0x7ff7701589e0 2024-08-17T02:47:28.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.946+0000 7ff76f400640 1 -- 172.21.15.5:0/4046604642 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff764032440 con 0x7ff7701589e0 2024-08-17T02:47:28.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.946+0000 7ff76f400640 1 -- 172.21.15.5:0/4046604642 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764032820 con 0x7ff7701589e0 2024-08-17T02:47:28.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.946+0000 7ff777800640 1 -- 172.21.15.5:0/4046604642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7701589e0 msgr2=0x7ff770158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.946+0000 7ff777800640 1 --2- 172.21.15.5:0/4046604642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7701589e0 0x7ff770158db0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff7701592f0 tx=0x7ff7640091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.946+0000 7ff777800640 1 -- 172.21.15.5:0/4046604642 shutdown_connections 2024-08-17T02:47:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.946+0000 7ff777800640 1 --2- 172.21.15.5:0/4046604642 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7700cda30 0x7ff7700cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.946+0000 7ff777800640 1 --2- 172.21.15.5:0/4046604642 >> v2:172.21.15.107:3300/0 conn(0x7ff7700ca9c0 0x7ff7700cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.946+0000 7ff777800640 1 --2- 172.21.15.5:0/4046604642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7701589e0 0x7ff770158db0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.946+0000 7ff777800640 1 -- 172.21.15.5:0/4046604642 >> 172.21.15.5:0/4046604642 conn(0x7ff77006e590 msgr2=0x7ff77006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.946+0000 7ff777800640 1 -- 172.21.15.5:0/4046604642 shutdown_connections 2024-08-17T02:47:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.946+0000 7ff777800640 1 -- 172.21.15.5:0/4046604642 wait complete. 2024-08-17T02:47:28.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.948+0000 7ff777800640 1 Processor -- start 2024-08-17T02:47:28.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.948+0000 7ff777800640 1 -- start start 2024-08-17T02:47:28.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.949+0000 7ff777800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7700ca9c0 0x7ff7700b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.949+0000 7ff777800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7700cda30 0x7ff7700cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.949+0000 7ff777800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7701589e0 0x7ff7700cff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.949+0000 7ff777800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700c9c00 con 0x7ff7701589e0 2024-08-17T02:47:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.949+0000 7ff777800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700afe30 con 0x7ff7700cda30 2024-08-17T02:47:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.949+0000 7ff777800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700b0110 con 0x7ff7700ca9c0 2024-08-17T02:47:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.949+0000 7ff775800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7701589e0 0x7ff7700cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.949+0000 7ff775800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7701589e0 0x7ff7700cff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43522/0 (socket says 172.21.15.5:43522) 2024-08-17T02:47:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.949+0000 7ff775800640 1 -- 172.21.15.5:0/2105064961 learned_addr learned my addr 172.21.15.5:0/2105064961 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.949+0000 7ff774e00640 1 --2- 172.21.15.5:0/2105064961 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7700ca9c0 0x7ff7700b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.949+0000 7ff76fe00640 1 --2- 172.21.15.5:0/2105064961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7700cda30 0x7ff7700cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.950+0000 7ff775800640 1 -- 172.21.15.5:0/2105064961 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7700ca9c0 msgr2=0x7ff7700b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.950+0000 7ff775800640 1 --2- 172.21.15.5:0/2105064961 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7700ca9c0 0x7ff7700b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.950+0000 7ff775800640 1 -- 172.21.15.5:0/2105064961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7700cda30 msgr2=0x7ff7700cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.950+0000 7ff775800640 1 --2- 172.21.15.5:0/2105064961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7700cda30 0x7ff7700cfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.950+0000 7ff775800640 1 -- 172.21.15.5:0/2105064961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff764009450 con 0x7ff7701589e0 2024-08-17T02:47:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.950+0000 7ff76fe00640 1 --2- 172.21.15.5:0/2105064961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7700cda30 0x7ff7700cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.950+0000 7ff775800640 1 --2- 172.21.15.5:0/2105064961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7701589e0 0x7ff7700cff60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff76800a380 tx=0x7ff768007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.950+0000 7ff763e00640 1 -- 172.21.15.5:0/2105064961 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76800d650 con 0x7ff7701589e0 2024-08-17T02:47:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.950+0000 7ff763e00640 1 -- 172.21.15.5:0/2105064961 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76800d7b0 con 0x7ff7701589e0 2024-08-17T02:47:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.950+0000 7ff763e00640 1 -- 172.21.15.5:0/2105064961 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76800db70 con 0x7ff7701589e0 2024-08-17T02:47:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.950+0000 7ff777800640 1 -- 172.21.15.5:0/2105064961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7700b03f0 con 0x7ff7701589e0 2024-08-17T02:47:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.950+0000 7ff777800640 1 -- 172.21.15.5:0/2105064961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7700b56a0 con 0x7ff7701589e0 2024-08-17T02:47:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.951+0000 7ff777800640 1 -- 172.21.15.5:0/2105064961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff770155ca0 con 0x7ff7701589e0 2024-08-17T02:47:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.952+0000 7ff763e00640 1 -- 172.21.15.5:0/2105064961 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff76801e3b0 con 0x7ff7701589e0 2024-08-17T02:47:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.953+0000 7ff763e00640 1 --2- 172.21.15.5:0/2105064961 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff750065220 0x7ff7500676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.953+0000 7ff763e00640 1 -- 172.21.15.5:0/2105064961 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff768082eb0 con 0x7ff7701589e0 2024-08-17T02:47:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.953+0000 7ff774e00640 1 --2- 172.21.15.5:0/2105064961 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff750065220 0x7ff7500676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.954+0000 7ff774e00640 1 --2- 172.21.15.5:0/2105064961 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff750065220 0x7ff7500676d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff764034000 tx=0x7ff764032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:28.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:28.957+0000 7ff763e00640 1 -- 172.21.15.5:0/2105064961 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff768051000 con 0x7ff7701589e0 2024-08-17T02:47:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.140+0000 7ff777800640 1 -- 172.21.15.5:0/2105064961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff7700c9d40 con 0x7ff7701589e0 2024-08-17T02:47:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.140+0000 7ff763e00640 1 -- 172.21.15.5:0/2105064961 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff76801a0a0 con 0x7ff7701589e0 2024-08-17T02:47:29.142 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:47:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.142+0000 7ff777800640 1 -- 172.21.15.5:0/2105064961 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff750065220 msgr2=0x7ff7500676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.142+0000 7ff777800640 1 --2- 172.21.15.5:0/2105064961 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff750065220 0x7ff7500676d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff764034000 tx=0x7ff764032000 comp rx=0 tx=0).stop 2024-08-17T02:47:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.142+0000 7ff777800640 1 -- 172.21.15.5:0/2105064961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7701589e0 msgr2=0x7ff7700cff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.142+0000 7ff777800640 1 --2- 172.21.15.5:0/2105064961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7701589e0 0x7ff7700cff60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff76800a380 tx=0x7ff768007900 comp rx=0 tx=0).stop 2024-08-17T02:47:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.142+0000 7ff777800640 1 -- 172.21.15.5:0/2105064961 shutdown_connections 2024-08-17T02:47:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.142+0000 7ff777800640 1 --2- 172.21.15.5:0/2105064961 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff750065220 0x7ff7500676d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.142+0000 7ff777800640 1 --2- 172.21.15.5:0/2105064961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7701589e0 0x7ff7700cff60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.142+0000 7ff777800640 1 --2- 172.21.15.5:0/2105064961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7700cda30 0x7ff7700cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.142+0000 7ff777800640 1 --2- 172.21.15.5:0/2105064961 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7700ca9c0 0x7ff7700b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.142+0000 7ff777800640 1 -- 172.21.15.5:0/2105064961 >> 172.21.15.5:0/2105064961 conn(0x7ff77006e590 msgr2=0x7ff770155fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:29.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.142+0000 7ff777800640 1 -- 172.21.15.5:0/2105064961 shutdown_connections 2024-08-17T02:47:29.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.142+0000 7ff777800640 1 -- 172.21.15.5:0/2105064961 wait complete. 2024-08-17T02:47:29.158 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.310+0000 7f0317e00640 1 Processor -- start 2024-08-17T02:47:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.310+0000 7f0317e00640 1 -- start start 2024-08-17T02:47:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.311+0000 7f0317e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f03180cadc0 0x7f03180cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.311+0000 7f0317e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03180cf600 con 0x7f0318158c90 2024-08-17T02:47:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.311+0000 7f0317e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03180cea90 con 0x7f03180cca40 2024-08-17T02:47:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.311+0000 7f0317e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03180ce890 con 0x7f03180cadc0 2024-08-17T02:47:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.311+0000 7f0316a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0318158c90 0x7f03180ce180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54228/0 (socket says 172.21.15.5:54228) 2024-08-17T02:47:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.311+0000 7f0316a00640 1 -- 172.21.15.5:0/3171564781 learned_addr learned my addr 172.21.15.5:0/3171564781 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.311+0000 7f030fe00640 1 --2- 172.21.15.5:0/3171564781 >> v2:172.21.15.5:3300/0 conn(0x7f03180cadc0 0x7f03180cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.312+0000 7f030fe00640 1 -- 172.21.15.5:0/3171564781 >> v1:172.21.15.107:6789/0 conn(0x7f03180cca40 legacy=0x7f03180af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.312+0000 7f030fe00640 1 -- 172.21.15.5:0/3171564781 >> v1:172.21.15.5:6789/0 conn(0x7f0318158c90 legacy=0x7f03180ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.312+0000 7f030fe00640 1 -- 172.21.15.5:0/3171564781 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03180ced30 con 0x7f03180cadc0 2024-08-17T02:47:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.312+0000 7f0316000640 1 -- 172.21.15.5:0/3171564781 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382704216 0 0) 0x7f03180cf600 con 0x7f0318158c90 2024-08-17T02:47:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.313+0000 7f030fe00640 1 --2- 172.21.15.5:0/3171564781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03180cadc0 0x7f03180cc500 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0300009850 tx=0x7f03000090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af1d10607dee836 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.313+0000 7f0316000640 1 -- 172.21.15.5:0/3171564781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030002ae20 con 0x7f03180cadc0 2024-08-17T02:47:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.313+0000 7f0316000640 1 -- 172.21.15.5:0/3171564781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0300032440 con 0x7f03180cadc0 2024-08-17T02:47:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.313+0000 7f0316000640 1 -- 172.21.15.5:0/3171564781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03000327e0 con 0x7f03180cadc0 2024-08-17T02:47:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.313+0000 7f0317e00640 1 -- 172.21.15.5:0/3171564781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03180cadc0 msgr2=0x7f03180cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.313+0000 7f0317e00640 1 --2- 172.21.15.5:0/3171564781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03180cadc0 0x7f03180cc500 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0300009850 tx=0x7f03000090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.314+0000 7f0317e00640 1 -- 172.21.15.5:0/3171564781 shutdown_connections 2024-08-17T02:47:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.314+0000 7f0317e00640 1 --2- 172.21.15.5:0/3171564781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03180cadc0 0x7f03180cc500 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.314+0000 7f0317e00640 1 -- 172.21.15.5:0/3171564781 >> 172.21.15.5:0/3171564781 conn(0x7f0318087a80 msgr2=0x7f031806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.314+0000 7f0317e00640 1 -- 172.21.15.5:0/3171564781 shutdown_connections 2024-08-17T02:47:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.314+0000 7f0317e00640 1 -- 172.21.15.5:0/3171564781 wait complete. 2024-08-17T02:47:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.315+0000 7f0317e00640 1 Processor -- start 2024-08-17T02:47:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.315+0000 7f0317e00640 1 -- start start 2024-08-17T02:47:29.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.316+0000 7f0317e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03180cadc0 0x7f03181522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.316+0000 7f0317e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03180cca40 0x7f03180c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.316+0000 7f0317e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0318158c90 0x7f03180c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.316+0000 7f0317e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0318152810 con 0x7f03180cadc0 2024-08-17T02:47:29.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.316+0000 7f0317e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03180c8e40 con 0x7f03180cca40 2024-08-17T02:47:29.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.316+0000 7f0317e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03180c8230 con 0x7f0318158c90 2024-08-17T02:47:29.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.316+0000 7f0316a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03180cadc0 0x7f03181522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.316+0000 7f0316a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03180cadc0 0x7f03181522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43540/0 (socket says 172.21.15.5:43540) 2024-08-17T02:47:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.316+0000 7f0316a00640 1 -- 172.21.15.5:0/1356029602 learned_addr learned my addr 172.21.15.5:0/1356029602 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.317+0000 7f030fe00640 1 --2- 172.21.15.5:0/1356029602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03180cca40 0x7f03180c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.317+0000 7f0317400640 1 --2- 172.21.15.5:0/1356029602 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0318158c90 0x7f03180c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.317+0000 7f0316a00640 1 -- 172.21.15.5:0/1356029602 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0318158c90 msgr2=0x7f03180c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.317+0000 7f0316a00640 1 --2- 172.21.15.5:0/1356029602 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0318158c90 0x7f03180c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.317+0000 7f0316a00640 1 -- 172.21.15.5:0/1356029602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03180cca40 msgr2=0x7f03180c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.317+0000 7f0316a00640 1 --2- 172.21.15.5:0/1356029602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03180cca40 0x7f03180c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.317+0000 7f0316a00640 1 -- 172.21.15.5:0/1356029602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0300009390 con 0x7f03180cadc0 2024-08-17T02:47:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.317+0000 7f0317400640 1 --2- 172.21.15.5:0/1356029602 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0318158c90 0x7f03180c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.317+0000 7f0316a00640 1 --2- 172.21.15.5:0/1356029602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03180cadc0 0x7f03181522d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f030800c510 tx=0x7f0308007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.317+0000 7f030e000640 1 -- 172.21.15.5:0/1356029602 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0308005aa0 con 0x7f03180cadc0 2024-08-17T02:47:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.318+0000 7f030e000640 1 -- 172.21.15.5:0/1356029602 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0308005c00 con 0x7f03180cadc0 2024-08-17T02:47:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.318+0000 7f030e000640 1 -- 172.21.15.5:0/1356029602 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03080070d0 con 0x7f03180cadc0 2024-08-17T02:47:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.318+0000 7f0317e00640 1 -- 172.21.15.5:0/1356029602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03180c8510 con 0x7f03180cadc0 2024-08-17T02:47:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.318+0000 7f0317e00640 1 -- 172.21.15.5:0/1356029602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03180c8ad0 con 0x7f03180cadc0 2024-08-17T02:47:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.319+0000 7f0317e00640 1 -- 172.21.15.5:0/1356029602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0318070720 con 0x7f03180cadc0 2024-08-17T02:47:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.320+0000 7f030e000640 1 -- 172.21.15.5:0/1356029602 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0308007500 con 0x7f03180cadc0 2024-08-17T02:47:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.320+0000 7f030e000640 1 --2- 172.21.15.5:0/1356029602 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f02f4065150 0x7f02f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.320+0000 7f030e000640 1 -- 172.21.15.5:0/1356029602 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0308081960 con 0x7f03180cadc0 2024-08-17T02:47:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.321+0000 7f030fe00640 1 --2- 172.21.15.5:0/1356029602 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f02f4065150 0x7f02f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.321+0000 7f030fe00640 1 --2- 172.21.15.5:0/1356029602 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f02f4065150 0x7f02f4067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0300034000 tx=0x7f0300032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.325+0000 7f030e000640 1 -- 172.21.15.5:0/1356029602 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f030804fa30 con 0x7f03180cadc0 2024-08-17T02:47:29.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.512+0000 7f0317e00640 1 -- 172.21.15.5:0/1356029602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0318152a00 con 0x7f03180cadc0 2024-08-17T02:47:29.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.513+0000 7f030e000640 1 -- 172.21.15.5:0/1356029602 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f0308017090 con 0x7f03180cadc0 2024-08-17T02:47:29.514 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:29.514 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:59.170637+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:55.543347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:56.571235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:29.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.515+0000 7f0317e00640 1 -- 172.21.15.5:0/1356029602 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f02f4065150 msgr2=0x7f02f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.515+0000 7f0317e00640 1 --2- 172.21.15.5:0/1356029602 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f02f4065150 0x7f02f4067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0300034000 tx=0x7f0300032000 comp rx=0 tx=0).stop 2024-08-17T02:47:29.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.515+0000 7f0317e00640 1 -- 172.21.15.5:0/1356029602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03180cadc0 msgr2=0x7f03181522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.515+0000 7f0317e00640 1 --2- 172.21.15.5:0/1356029602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03180cadc0 0x7f03181522d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f030800c510 tx=0x7f0308007f30 comp rx=0 tx=0).stop 2024-08-17T02:47:29.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.515+0000 7f0317e00640 1 -- 172.21.15.5:0/1356029602 shutdown_connections 2024-08-17T02:47:29.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.515+0000 7f0317e00640 1 --2- 172.21.15.5:0/1356029602 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f02f4065150 0x7f02f4067600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.515+0000 7f0317e00640 1 --2- 172.21.15.5:0/1356029602 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0318158c90 0x7f03180c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.515+0000 7f0317e00640 1 --2- 172.21.15.5:0/1356029602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03180cca40 0x7f03180c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.515+0000 7f0317e00640 1 --2- 172.21.15.5:0/1356029602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03180cadc0 0x7f03181522d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.515+0000 7f0317e00640 1 -- 172.21.15.5:0/1356029602 >> 172.21.15.5:0/1356029602 conn(0x7f0318087a80 msgr2=0x7f03180ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:29.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.515+0000 7f0317e00640 1 -- 172.21.15.5:0/1356029602 shutdown_connections 2024-08-17T02:47:29.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.515+0000 7f0317e00640 1 -- 172.21.15.5:0/1356029602 wait complete. 2024-08-17T02:47:29.532 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:47.106425+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:55.543347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:56.571235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:47:29.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:29.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.684+0000 7f65f6200640 1 Processor -- start 2024-08-17T02:47:29.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.684+0000 7f65f6200640 1 -- start start 2024-08-17T02:47:29.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.685+0000 7f65f6200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f65f0158e60 0x7f65f00add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.685+0000 7f65f6200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f00ae860 0x7f65f00ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.685+0000 7f65f6200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f00ad8a0 con 0x7f65f00b03b0 2024-08-17T02:47:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.685+0000 7f65f6200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f006edf0 con 0x7f65f0158e60 2024-08-17T02:47:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.685+0000 7f65f6200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00acc90 con 0x7f65f00ae860 2024-08-17T02:47:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.686+0000 7f65ef400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f65f0158e60 0x7f65f00add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.686+0000 7f65ef400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f65f0158e60 0x7f65f00add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43546/0 (socket says 172.21.15.5:43546) 2024-08-17T02:47:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.686+0000 7f65efe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f65f00b03b0 0x7f65f0159610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54234/0 (socket says 172.21.15.5:54234) 2024-08-17T02:47:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.686+0000 7f65efe00640 1 -- 172.21.15.5:0/1413432737 learned_addr learned my addr 172.21.15.5:0/1413432737 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.686+0000 7f65e6a00640 1 --2- 172.21.15.5:0/1413432737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f00ae860 0x7f65f00ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.686+0000 7f65ef400640 1 -- 172.21.15.5:0/1413432737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f00ae860 msgr2=0x7f65f00ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.686+0000 7f65ef400640 1 --2- 172.21.15.5:0/1413432737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f00ae860 0x7f65f00ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.686+0000 7f65ef400640 1 -- 172.21.15.5:0/1413432737 >> v1:172.21.15.5:6789/0 conn(0x7f65f00b03b0 legacy=0x7f65f0159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.686+0000 7f65ef400640 1 -- 172.21.15.5:0/1413432737 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f00acf70 con 0x7f65f0158e60 2024-08-17T02:47:29.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.686+0000 7f65eea00640 1 -- 172.21.15.5:0/1413432737 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907364163 0 0) 0x7f65f00ad8a0 con 0x7f65f00b03b0 2024-08-17T02:47:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.687+0000 7f65ef400640 1 --2- 172.21.15.5:0/1413432737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f0158e60 0x7f65f00add30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009850 tx=0x7f65e00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0efc5c897882c43 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.688+0000 7f65eea00640 1 -- 172.21.15.5:0/1413432737 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e002ad00 con 0x7f65f0158e60 2024-08-17T02:47:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.688+0000 7f65eea00640 1 -- 172.21.15.5:0/1413432737 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e002ae60 con 0x7f65f0158e60 2024-08-17T02:47:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.688+0000 7f65eea00640 1 -- 172.21.15.5:0/1413432737 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0032670 con 0x7f65f0158e60 2024-08-17T02:47:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.688+0000 7f65f6200640 1 -- 172.21.15.5:0/1413432737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f0158e60 msgr2=0x7f65f00add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.688+0000 7f65f6200640 1 --2- 172.21.15.5:0/1413432737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f0158e60 0x7f65f00add30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009850 tx=0x7f65e00090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.688+0000 7f65f6200640 1 -- 172.21.15.5:0/1413432737 shutdown_connections 2024-08-17T02:47:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.688+0000 7f65f6200640 1 --2- 172.21.15.5:0/1413432737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f00ae860 0x7f65f00ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.688+0000 7f65f6200640 1 --2- 172.21.15.5:0/1413432737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f0158e60 0x7f65f00add30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.688+0000 7f65f6200640 1 -- 172.21.15.5:0/1413432737 >> 172.21.15.5:0/1413432737 conn(0x7f65f00cc390 msgr2=0x7f65f0066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:29.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.688+0000 7f65f6200640 1 -- 172.21.15.5:0/1413432737 shutdown_connections 2024-08-17T02:47:29.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.688+0000 7f65f6200640 1 -- 172.21.15.5:0/1413432737 wait complete. 2024-08-17T02:47:29.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.690+0000 7f65f6200640 1 Processor -- start 2024-08-17T02:47:29.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.690+0000 7f65f6200640 1 -- start start 2024-08-17T02:47:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.691+0000 7f65f6200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f00ae860 0x7f65f00c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.691+0000 7f65f6200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65f00b03b0 0x7f65f014a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.691+0000 7f65f6200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f0158e60 0x7f65f014a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.691+0000 7f65f6200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f014aa90 con 0x7f65f00ae860 2024-08-17T02:47:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.691+0000 7f65f6200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00c5800 con 0x7f65f00b03b0 2024-08-17T02:47:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.691+0000 7f65f6200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00c5ae0 con 0x7f65f0158e60 2024-08-17T02:47:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.691+0000 7f65ef400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f00ae860 0x7f65f00c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.691+0000 7f65ef400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f00ae860 0x7f65f00c3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43562/0 (socket says 172.21.15.5:43562) 2024-08-17T02:47:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.691+0000 7f65ef400640 1 -- 172.21.15.5:0/3789247787 learned_addr learned my addr 172.21.15.5:0/3789247787 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.691+0000 7f65efe00640 1 --2- 172.21.15.5:0/3789247787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f0158e60 0x7f65f014a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.691+0000 7f65e6a00640 1 --2- 172.21.15.5:0/3789247787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65f00b03b0 0x7f65f014a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.691+0000 7f65ef400640 1 -- 172.21.15.5:0/3789247787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f0158e60 msgr2=0x7f65f014a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.691+0000 7f65ef400640 1 --2- 172.21.15.5:0/3789247787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f0158e60 0x7f65f014a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.691+0000 7f65ef400640 1 -- 172.21.15.5:0/3789247787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65f00b03b0 msgr2=0x7f65f014a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.691+0000 7f65ef400640 1 --2- 172.21.15.5:0/3789247787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65f00b03b0 0x7f65f014a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.691+0000 7f65ef400640 1 -- 172.21.15.5:0/3789247787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e0009390 con 0x7f65f00ae860 2024-08-17T02:47:29.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.692+0000 7f65ef400640 1 --2- 172.21.15.5:0/3789247787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f00ae860 0x7f65f00c3660 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009360 tx=0x7f65e0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.692+0000 7f65e7400640 1 -- 172.21.15.5:0/3789247787 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e003b6e0 con 0x7f65f00ae860 2024-08-17T02:47:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.692+0000 7f65e7400640 1 -- 172.21.15.5:0/3789247787 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e003b840 con 0x7f65f00ae860 2024-08-17T02:47:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.692+0000 7f65e7400640 1 -- 172.21.15.5:0/3789247787 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e003bbe0 con 0x7f65f00ae860 2024-08-17T02:47:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.692+0000 7f65f6200640 1 -- 172.21.15.5:0/3789247787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f00c5dc0 con 0x7f65f00ae860 2024-08-17T02:47:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.692+0000 7f65f6200640 1 -- 172.21.15.5:0/3789247787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f00c5420 con 0x7f65f00ae860 2024-08-17T02:47:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.693+0000 7f65f6200640 1 -- 172.21.15.5:0/3789247787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f0063fb0 con 0x7f65f00ae860 2024-08-17T02:47:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.694+0000 7f65e7400640 1 -- 172.21.15.5:0/3789247787 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f65e0043030 con 0x7f65f00ae860 2024-08-17T02:47:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.695+0000 7f65e7400640 1 --2- 172.21.15.5:0/3789247787 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f65cc065150 0x7f65cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.695+0000 7f65e7400640 1 -- 172.21.15.5:0/3789247787 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f65e0041070 con 0x7f65f00ae860 2024-08-17T02:47:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.695+0000 7f65e6a00640 1 --2- 172.21.15.5:0/3789247787 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f65cc065150 0x7f65cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:29.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.696+0000 7f65e6a00640 1 --2- 172.21.15.5:0/3789247787 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f65cc065150 0x7f65cc067600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f65f016b2b0 tx=0x7f65d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:29.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.699+0000 7f65e7400640 1 -- 172.21.15.5:0/3789247787 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f65e0070ed0 con 0x7f65f00ae860 2024-08-17T02:47:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.881+0000 7f65f6200640 1 -- 172.21.15.5:0/3789247787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65f00afdb0 con 0x7f65f00ae860 2024-08-17T02:47:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.882+0000 7f65e7400640 1 -- 172.21.15.5:0/3789247787 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f65e00370a0 con 0x7f65f00ae860 2024-08-17T02:47:29.887 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:47:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.884+0000 7f65f6200640 1 -- 172.21.15.5:0/3789247787 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f65cc065150 msgr2=0x7f65cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.884+0000 7f65f6200640 1 --2- 172.21.15.5:0/3789247787 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f65cc065150 0x7f65cc067600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f65f016b2b0 tx=0x7f65d8008040 comp rx=0 tx=0).stop 2024-08-17T02:47:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.884+0000 7f65f6200640 1 -- 172.21.15.5:0/3789247787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f00ae860 msgr2=0x7f65f00c3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.884+0000 7f65f6200640 1 --2- 172.21.15.5:0/3789247787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f00ae860 0x7f65f00c3660 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009360 tx=0x7f65e0032000 comp rx=0 tx=0).stop 2024-08-17T02:47:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.884+0000 7f65f6200640 1 -- 172.21.15.5:0/3789247787 shutdown_connections 2024-08-17T02:47:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.884+0000 7f65f6200640 1 --2- 172.21.15.5:0/3789247787 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f65cc065150 0x7f65cc067600 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.884+0000 7f65f6200640 1 --2- 172.21.15.5:0/3789247787 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65f0158e60 0x7f65f014a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.884+0000 7f65f6200640 1 --2- 172.21.15.5:0/3789247787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65f00b03b0 0x7f65f014a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.884+0000 7f65f6200640 1 --2- 172.21.15.5:0/3789247787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f00ae860 0x7f65f00c3660 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.884+0000 7f65f6200640 1 -- 172.21.15.5:0/3789247787 >> 172.21.15.5:0/3789247787 conn(0x7f65f00cc390 msgr2=0x7f65f01584c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.884+0000 7f65f6200640 1 -- 172.21.15.5:0/3789247787 shutdown_connections 2024-08-17T02:47:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:29.884+0000 7f65f6200640 1 -- 172.21.15.5:0/3789247787 wait complete. 2024-08-17T02:47:29.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:47:30.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.052+0000 7f2d2cc00640 1 Processor -- start 2024-08-17T02:47:30.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.053+0000 7f2d2cc00640 1 -- start start 2024-08-17T02:47:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.054+0000 7f2d2cc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d280b1850 0x7f2d280b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.054+0000 7f2d2cc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d281585a0 0x7f2d28158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.054+0000 7f2d2cc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d280ce770 con 0x7f2d280d0650 2024-08-17T02:47:30.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.054+0000 7f2d2cc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d280ce9b0 con 0x7f2d280b1850 2024-08-17T02:47:30.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.054+0000 7f2d2cc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d280cec90 con 0x7f2d281585a0 2024-08-17T02:47:30.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.054+0000 7f2d27400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d280b1850 0x7f2d280b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.054+0000 7f2d27400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d280b1850 0x7f2d280b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43572/0 (socket says 172.21.15.5:43572) 2024-08-17T02:47:30.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.054+0000 7f2d27400640 1 -- 172.21.15.5:0/3214217725 learned_addr learned my addr 172.21.15.5:0/3214217725 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.054+0000 7f2d27400640 1 -- 172.21.15.5:0/3214217725 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d281585a0 msgr2=0x7f2d28158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.055+0000 7f2d27400640 1 --2- 172.21.15.5:0/3214217725 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d281585a0 0x7f2d28158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.055+0000 7f2d27400640 1 -- 172.21.15.5:0/3214217725 >> v1:172.21.15.107:6789/0 conn(0x7f2d280d0650 legacy=0x7f2d280ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.055+0000 7f2d27400640 1 -- 172.21.15.5:0/3214217725 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d280cef70 con 0x7f2d280b1850 2024-08-17T02:47:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.055+0000 7f2d27400640 1 --2- 172.21.15.5:0/3214217725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d280b1850 0x7f2d280b1c20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2d28088960 tx=0x7f2d180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95bb638e2c1f17d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.056+0000 7f2d26a00640 1 -- 172.21.15.5:0/3214217725 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1802adb0 con 0x7f2d280b1850 2024-08-17T02:47:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.056+0000 7f2d26a00640 1 -- 172.21.15.5:0/3214217725 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d18032440 con 0x7f2d280b1850 2024-08-17T02:47:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.056+0000 7f2d26a00640 1 -- 172.21.15.5:0/3214217725 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18032820 con 0x7f2d280b1850 2024-08-17T02:47:30.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.056+0000 7f2d2cc00640 1 -- 172.21.15.5:0/3214217725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d280b1850 msgr2=0x7f2d280b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.056+0000 7f2d2cc00640 1 --2- 172.21.15.5:0/3214217725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d280b1850 0x7f2d280b1c20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2d28088960 tx=0x7f2d180091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.056+0000 7f2d2cc00640 1 -- 172.21.15.5:0/3214217725 shutdown_connections 2024-08-17T02:47:30.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.056+0000 7f2d2cc00640 1 --2- 172.21.15.5:0/3214217725 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d281585a0 0x7f2d28158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.056+0000 7f2d2cc00640 1 --2- 172.21.15.5:0/3214217725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d280b1850 0x7f2d280b1c20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.056+0000 7f2d2cc00640 1 -- 172.21.15.5:0/3214217725 >> 172.21.15.5:0/3214217725 conn(0x7f2d2806e590 msgr2=0x7f2d2806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:30.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.056+0000 7f2d2cc00640 1 -- 172.21.15.5:0/3214217725 shutdown_connections 2024-08-17T02:47:30.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.057+0000 7f2d2cc00640 1 -- 172.21.15.5:0/3214217725 wait complete. 2024-08-17T02:47:30.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.058+0000 7f2d2cc00640 1 Processor -- start 2024-08-17T02:47:30.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.058+0000 7f2d2cc00640 1 -- start start 2024-08-17T02:47:30.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.059+0000 7f2d2cc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d280b1850 0x7f2d280aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.059+0000 7f2d2cc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d280d0650 0x7f2d28169950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.059+0000 7f2d2cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d281585a0 0x7f2d280c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.059+0000 7f2d2cc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d280c52e0 con 0x7f2d281585a0 2024-08-17T02:47:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.059+0000 7f2d2cc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d28169e90 con 0x7f2d280b1850 2024-08-17T02:47:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.059+0000 7f2d2cc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d280c49f0 con 0x7f2d280d0650 2024-08-17T02:47:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.059+0000 7f2d27e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d281585a0 0x7f2d280c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.059+0000 7f2d27e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d281585a0 0x7f2d280c5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43588/0 (socket says 172.21.15.5:43588) 2024-08-17T02:47:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.059+0000 7f2d27e00640 1 -- 172.21.15.5:0/2416213737 learned_addr learned my addr 172.21.15.5:0/2416213737 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.059+0000 7f2d27400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d280b1850 0x7f2d280aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.059+0000 7f2d1ea00640 1 --2- 172.21.15.5:0/2416213737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d280d0650 0x7f2d28169950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.060+0000 7f2d27e00640 1 -- 172.21.15.5:0/2416213737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d280d0650 msgr2=0x7f2d28169950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.060+0000 7f2d27e00640 1 --2- 172.21.15.5:0/2416213737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d280d0650 0x7f2d28169950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.060+0000 7f2d27e00640 1 -- 172.21.15.5:0/2416213737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d280b1850 msgr2=0x7f2d280aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.060+0000 7f2d27e00640 1 --2- 172.21.15.5:0/2416213737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d280b1850 0x7f2d280aba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.060+0000 7f2d27e00640 1 -- 172.21.15.5:0/2416213737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d18009450 con 0x7f2d281585a0 2024-08-17T02:47:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.060+0000 7f2d27e00640 1 --2- 172.21.15.5:0/2416213737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d281585a0 0x7f2d280c5770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000bc30 tx=0x7f2d20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.060+0000 7f2d1f400640 1 -- 172.21.15.5:0/2416213737 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d200092e0 con 0x7f2d281585a0 2024-08-17T02:47:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.060+0000 7f2d1f400640 1 -- 172.21.15.5:0/2416213737 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2000c860 con 0x7f2d281585a0 2024-08-17T02:47:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.060+0000 7f2d2cc00640 1 -- 172.21.15.5:0/2416213737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d280c5cb0 con 0x7f2d281585a0 2024-08-17T02:47:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.060+0000 7f2d1f400640 1 -- 172.21.15.5:0/2416213737 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000cc40 con 0x7f2d281585a0 2024-08-17T02:47:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.061+0000 7f2d2cc00640 1 -- 172.21.15.5:0/2416213737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d280c4f70 con 0x7f2d281585a0 2024-08-17T02:47:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.062+0000 7f2d2cc00640 1 -- 172.21.15.5:0/2416213737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d28070720 con 0x7f2d281585a0 2024-08-17T02:47:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.062+0000 7f2d1f400640 1 -- 172.21.15.5:0/2416213737 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2d20012070 con 0x7f2d281585a0 2024-08-17T02:47:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.063+0000 7f2d1f400640 1 --2- 172.21.15.5:0/2416213737 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2d04065150 0x7f2d04067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.063+0000 7f2d1f400640 1 -- 172.21.15.5:0/2416213737 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d20082060 con 0x7f2d281585a0 2024-08-17T02:47:30.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.064+0000 7f2d27400640 1 --2- 172.21.15.5:0/2416213737 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2d04065150 0x7f2d04067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.064+0000 7f2d27400640 1 --2- 172.21.15.5:0/2416213737 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2d04065150 0x7f2d04067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2d18034000 tx=0x7f2d18032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:30.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.067+0000 7f2d1f400640 1 -- 172.21.15.5:0/2416213737 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2d20053bc0 con 0x7f2d281585a0 2024-08-17T02:47:30.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.254+0000 7f2d2cc00640 1 -- 172.21.15.5:0/2416213737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d28068140 con 0x7f2d281585a0 2024-08-17T02:47:30.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.255+0000 7f2d1f400640 1 -- 172.21.15.5:0/2416213737 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d20053750 con 0x7f2d281585a0 2024-08-17T02:47:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:47:30.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.257+0000 7f2d2cc00640 1 -- 172.21.15.5:0/2416213737 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2d04065150 msgr2=0x7f2d04067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.257+0000 7f2d2cc00640 1 --2- 172.21.15.5:0/2416213737 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2d04065150 0x7f2d04067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2d18034000 tx=0x7f2d18032000 comp rx=0 tx=0).stop 2024-08-17T02:47:30.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.257+0000 7f2d2cc00640 1 -- 172.21.15.5:0/2416213737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d281585a0 msgr2=0x7f2d280c5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.257+0000 7f2d2cc00640 1 --2- 172.21.15.5:0/2416213737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d281585a0 0x7f2d280c5770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000bc30 tx=0x7f2d20009840 comp rx=0 tx=0).stop 2024-08-17T02:47:30.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.257+0000 7f2d2cc00640 1 -- 172.21.15.5:0/2416213737 shutdown_connections 2024-08-17T02:47:30.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.257+0000 7f2d2cc00640 1 --2- 172.21.15.5:0/2416213737 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2d04065150 0x7f2d04067600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.257+0000 7f2d2cc00640 1 --2- 172.21.15.5:0/2416213737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d281585a0 0x7f2d280c5770 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.257+0000 7f2d2cc00640 1 --2- 172.21.15.5:0/2416213737 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d280d0650 0x7f2d28169950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.257+0000 7f2d2cc00640 1 --2- 172.21.15.5:0/2416213737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d280b1850 0x7f2d280aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.257+0000 7f2d2cc00640 1 -- 172.21.15.5:0/2416213737 >> 172.21.15.5:0/2416213737 conn(0x7f2d2806e590 msgr2=0x7f2d280acde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:30.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.257+0000 7f2d2cc00640 1 -- 172.21.15.5:0/2416213737 shutdown_connections 2024-08-17T02:47:30.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.258+0000 7f2d2cc00640 1 -- 172.21.15.5:0/2416213737 wait complete. 2024-08-17T02:47:30.273 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:47:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.426+0000 7f3240800640 1 Processor -- start 2024-08-17T02:47:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.426+0000 7f3240800640 1 -- start start 2024-08-17T02:47:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.427+0000 7f3240800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f32381590b0 0x7f32380b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.427+0000 7f3240800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f32380acf10 0x7f3238159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.427+0000 7f3240800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323815a4e0 con 0x7f32380afca0 2024-08-17T02:47:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.427+0000 7f3240800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32380b0980 con 0x7f32380acf10 2024-08-17T02:47:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.427+0000 7f3240800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32380c92b0 con 0x7f32381590b0 2024-08-17T02:47:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.427+0000 7f323e800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f32380acf10 0x7f3238159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.428+0000 7f323e800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f32380acf10 0x7f3238159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43600/0 (socket says 172.21.15.5:43600) 2024-08-17T02:47:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.428+0000 7f323e800640 1 -- 172.21.15.5:0/2502361015 learned_addr learned my addr 172.21.15.5:0/2502361015 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.428+0000 7f323d400640 1 --2- 172.21.15.5:0/2502361015 >> v2:172.21.15.107:3300/0 conn(0x7f32381590b0 0x7f32380b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.428+0000 7f323e800640 1 -- 172.21.15.5:0/2502361015 >> v2:172.21.15.107:3300/0 conn(0x7f32381590b0 msgr2=0x7f32380b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.428+0000 7f323e800640 1 --2- 172.21.15.5:0/2502361015 >> v2:172.21.15.107:3300/0 conn(0x7f32381590b0 0x7f32380b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.428+0000 7f323e800640 1 -- 172.21.15.5:0/2502361015 >> v1:172.21.15.107:6789/0 conn(0x7f32380afca0 legacy=0x7f32381589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.428+0000 7f323e800640 1 -- 172.21.15.5:0/2502361015 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32380ad480 con 0x7f32380acf10 2024-08-17T02:47:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.429+0000 7f323e800640 1 --2- 172.21.15.5:0/2502361015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32380acf10 0x7f3238159fa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f32380c83b0 tx=0x7f3234009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55362589d6ddd5e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.429+0000 7f323ca00640 1 -- 172.21.15.5:0/2502361015 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323402e050 con 0x7f32380acf10 2024-08-17T02:47:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.429+0000 7f323ca00640 1 -- 172.21.15.5:0/2502361015 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3234007400 con 0x7f32380acf10 2024-08-17T02:47:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.429+0000 7f323ca00640 1 -- 172.21.15.5:0/2502361015 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32340077e0 con 0x7f32380acf10 2024-08-17T02:47:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.430+0000 7f3240800640 1 -- 172.21.15.5:0/2502361015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32380acf10 msgr2=0x7f3238159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.430+0000 7f3240800640 1 --2- 172.21.15.5:0/2502361015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32380acf10 0x7f3238159fa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f32380c83b0 tx=0x7f3234009840 comp rx=0 tx=0).stop 2024-08-17T02:47:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.430+0000 7f3240800640 1 -- 172.21.15.5:0/2502361015 shutdown_connections 2024-08-17T02:47:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.430+0000 7f3240800640 1 --2- 172.21.15.5:0/2502361015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32380acf10 0x7f3238159fa0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.430+0000 7f3240800640 1 --2- 172.21.15.5:0/2502361015 >> v2:172.21.15.107:3300/0 conn(0x7f32381590b0 0x7f32380b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.430+0000 7f3240800640 1 -- 172.21.15.5:0/2502361015 >> 172.21.15.5:0/2502361015 conn(0x7f3238066e60 msgr2=0x7f3238067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.430+0000 7f3240800640 1 -- 172.21.15.5:0/2502361015 shutdown_connections 2024-08-17T02:47:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.430+0000 7f3240800640 1 -- 172.21.15.5:0/2502361015 wait complete. 2024-08-17T02:47:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.431+0000 7f3240800640 1 Processor -- start 2024-08-17T02:47:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.431+0000 7f3240800640 1 -- start start 2024-08-17T02:47:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.432+0000 7f3240800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32380acf10 0x7f3238143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.432+0000 7f3240800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32380afca0 0x7f3238145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.432+0000 7f3240800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32381590b0 0x7f3238145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.432+0000 7f3240800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3238146490 con 0x7f32380acf10 2024-08-17T02:47:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.432+0000 7f3240800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3238146770 con 0x7f32380afca0 2024-08-17T02:47:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.432+0000 7f3240800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3238146a50 con 0x7f32381590b0 2024-08-17T02:47:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.433+0000 7f323de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32380acf10 0x7f3238143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.433+0000 7f323de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32380acf10 0x7f3238143f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43614/0 (socket says 172.21.15.5:43614) 2024-08-17T02:47:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.433+0000 7f323de00640 1 -- 172.21.15.5:0/1547368084 learned_addr learned my addr 172.21.15.5:0/1547368084 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.433+0000 7f323d400640 1 --2- 172.21.15.5:0/1547368084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32380afca0 0x7f3238145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.433+0000 7f323e800640 1 --2- 172.21.15.5:0/1547368084 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32381590b0 0x7f3238145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.433+0000 7f323de00640 1 -- 172.21.15.5:0/1547368084 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32381590b0 msgr2=0x7f3238145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.433+0000 7f323de00640 1 --2- 172.21.15.5:0/1547368084 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32381590b0 0x7f3238145780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.433+0000 7f323de00640 1 -- 172.21.15.5:0/1547368084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32380afca0 msgr2=0x7f3238145240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.433+0000 7f323de00640 1 --2- 172.21.15.5:0/1547368084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32380afca0 0x7f3238145240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.433+0000 7f323de00640 1 -- 172.21.15.5:0/1547368084 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3234009ae0 con 0x7f32380acf10 2024-08-17T02:47:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.433+0000 7f323de00640 1 --2- 172.21.15.5:0/1547368084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32380acf10 0x7f3238143f30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f322c00c560 tx=0x7f322c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.434+0000 7f3231600640 1 -- 172.21.15.5:0/1547368084 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c011590 con 0x7f32380acf10 2024-08-17T02:47:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.434+0000 7f3231600640 1 -- 172.21.15.5:0/1547368084 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c011710 con 0x7f32380acf10 2024-08-17T02:47:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.434+0000 7f3231600640 1 -- 172.21.15.5:0/1547368084 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c011ad0 con 0x7f32380acf10 2024-08-17T02:47:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.434+0000 7f3240800640 1 -- 172.21.15.5:0/1547368084 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3238146d30 con 0x7f32380acf10 2024-08-17T02:47:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.434+0000 7f3240800640 1 -- 172.21.15.5:0/1547368084 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3238144470 con 0x7f32380acf10 2024-08-17T02:47:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.435+0000 7f3240800640 1 -- 172.21.15.5:0/1547368084 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3238144660 con 0x7f32380acf10 2024-08-17T02:47:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.436+0000 7f3231600640 1 -- 172.21.15.5:0/1547368084 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f322c01b3b0 con 0x7f32380acf10 2024-08-17T02:47:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.437+0000 7f3231600640 1 --2- 172.21.15.5:0/1547368084 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f321c065150 0x7f321c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.437+0000 7f3231600640 1 -- 172.21.15.5:0/1547368084 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f322c0817e0 con 0x7f32380acf10 2024-08-17T02:47:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.437+0000 7f323d400640 1 --2- 172.21.15.5:0/1547368084 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f321c065150 0x7f321c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.437+0000 7f323d400640 1 --2- 172.21.15.5:0/1547368084 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f321c065150 0x7f321c067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f323815a730 tx=0x7f3228008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.440+0000 7f3231600640 1 -- 172.21.15.5:0/1547368084 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f322c04f8b0 con 0x7f32380acf10 2024-08-17T02:47:30.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.621+0000 7f3240800640 1 -- 172.21.15.5:0/1547368084 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f323815a4e0 con 0x7f32380acf10 2024-08-17T02:47:30.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.621+0000 7f3231600640 1 -- 172.21.15.5:0/1547368084 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f323815a4e0 con 0x7f32380acf10 2024-08-17T02:47:30.623 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:47:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.623+0000 7f3240800640 1 -- 172.21.15.5:0/1547368084 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f321c065150 msgr2=0x7f321c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.623+0000 7f3240800640 1 --2- 172.21.15.5:0/1547368084 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f321c065150 0x7f321c067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f323815a730 tx=0x7f3228008040 comp rx=0 tx=0).stop 2024-08-17T02:47:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.623+0000 7f3240800640 1 -- 172.21.15.5:0/1547368084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32380acf10 msgr2=0x7f3238143f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.623+0000 7f3240800640 1 --2- 172.21.15.5:0/1547368084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32380acf10 0x7f3238143f30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f322c00c560 tx=0x7f322c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.623+0000 7f3240800640 1 -- 172.21.15.5:0/1547368084 shutdown_connections 2024-08-17T02:47:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.623+0000 7f3240800640 1 --2- 172.21.15.5:0/1547368084 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f321c065150 0x7f321c067600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.623+0000 7f3240800640 1 --2- 172.21.15.5:0/1547368084 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32381590b0 0x7f3238145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.623+0000 7f3240800640 1 --2- 172.21.15.5:0/1547368084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32380afca0 0x7f3238145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.623+0000 7f3240800640 1 --2- 172.21.15.5:0/1547368084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32380acf10 0x7f3238143f30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.623+0000 7f3240800640 1 -- 172.21.15.5:0/1547368084 >> 172.21.15.5:0/1547368084 conn(0x7f3238066e60 msgr2=0x7f32380ca8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:30.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.624+0000 7f3240800640 1 -- 172.21.15.5:0/1547368084 shutdown_connections 2024-08-17T02:47:30.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.624+0000 7f3240800640 1 -- 172.21.15.5:0/1547368084 wait complete. 2024-08-17T02:47:30.640 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:30.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.790+0000 7f54c6e00640 1 Processor -- start 2024-08-17T02:47:30.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.790+0000 7f54c6e00640 1 -- start start 2024-08-17T02:47:30.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.791+0000 7f54c6e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f54c0158c60 0x7f54c015a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.791+0000 7f54c6e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f54c00b1920 0x7f54c00b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.791+0000 7f54c6e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c015b6b0 con 0x7f54c0159030 2024-08-17T02:47:30.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.791+0000 7f54c6e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c00b0540 con 0x7f54c0158c60 2024-08-17T02:47:30.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.791+0000 7f54c6e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c015aac0 con 0x7f54c00b1920 2024-08-17T02:47:30.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.791+0000 7f54c5a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f54c0158c60 0x7f54c015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.791+0000 7f54c5a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f54c0158c60 0x7f54c015a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43620/0 (socket says 172.21.15.5:43620) 2024-08-17T02:47:30.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.791+0000 7f54c5000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f54c0159030 0x7f54c00ca8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54242/0 (socket says 172.21.15.5:54242) 2024-08-17T02:47:30.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.791+0000 7f54c5a00640 1 -- 172.21.15.5:0/2908862553 learned_addr learned my addr 172.21.15.5:0/2908862553 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:30.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.792+0000 7f54c6400640 1 --2- 172.21.15.5:0/2908862553 >> v2:172.21.15.107:3300/0 conn(0x7f54c00b1920 0x7f54c00b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.792+0000 7f54c5a00640 1 -- 172.21.15.5:0/2908862553 >> v2:172.21.15.107:3300/0 conn(0x7f54c00b1920 msgr2=0x7f54c00b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:30.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.792+0000 7f54c5a00640 1 --2- 172.21.15.5:0/2908862553 >> v2:172.21.15.107:3300/0 conn(0x7f54c00b1920 0x7f54c00b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.792+0000 7f54c5a00640 1 -- 172.21.15.5:0/2908862553 >> v1:172.21.15.5:6789/0 conn(0x7f54c0159030 legacy=0x7f54c00ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.792+0000 7f54c5a00640 1 -- 172.21.15.5:0/2908862553 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c015ad80 con 0x7f54c0158c60 2024-08-17T02:47:30.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.792+0000 7f54bfe00640 1 -- 172.21.15.5:0/2908862553 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031907938 0 0) 0x7f54c015b6b0 con 0x7f54c0159030 2024-08-17T02:47:30.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.793+0000 7f54c5a00640 1 --2- 172.21.15.5:0/2908862553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c0158c60 0x7f54c015a490 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f54c00c6b30 tx=0x7f54b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54240532c113f6a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:30.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.793+0000 7f54bfe00640 1 -- 172.21.15.5:0/2908862553 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b402ae80 con 0x7f54c0158c60 2024-08-17T02:47:30.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.793+0000 7f54bfe00640 1 -- 172.21.15.5:0/2908862553 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b4032440 con 0x7f54c0158c60 2024-08-17T02:47:30.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.793+0000 7f54bfe00640 1 -- 172.21.15.5:0/2908862553 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40327c0 con 0x7f54c0158c60 2024-08-17T02:47:30.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.793+0000 7f54c6e00640 1 -- 172.21.15.5:0/2908862553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c0158c60 msgr2=0x7f54c015a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.793+0000 7f54c6e00640 1 --2- 172.21.15.5:0/2908862553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c0158c60 0x7f54c015a490 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f54c00c6b30 tx=0x7f54b40091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.794+0000 7f54c6e00640 1 -- 172.21.15.5:0/2908862553 shutdown_connections 2024-08-17T02:47:30.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.794+0000 7f54c6e00640 1 --2- 172.21.15.5:0/2908862553 >> v2:172.21.15.107:3300/0 conn(0x7f54c00b1920 0x7f54c00b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.794+0000 7f54c6e00640 1 --2- 172.21.15.5:0/2908862553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c0158c60 0x7f54c015a490 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.794+0000 7f54c6e00640 1 -- 172.21.15.5:0/2908862553 >> 172.21.15.5:0/2908862553 conn(0x7f54c006e590 msgr2=0x7f54c006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:30.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.794+0000 7f54c6e00640 1 -- 172.21.15.5:0/2908862553 shutdown_connections 2024-08-17T02:47:30.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.794+0000 7f54c6e00640 1 -- 172.21.15.5:0/2908862553 wait complete. 2024-08-17T02:47:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.795+0000 7f54c6e00640 1 Processor -- start 2024-08-17T02:47:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.795+0000 7f54c6e00640 1 -- start start 2024-08-17T02:47:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.796+0000 7f54c6e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54c00b1920 0x7f54c00c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.796+0000 7f54c6e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54c0158c60 0x7f54c00c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.796+0000 7f54c6e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c0159030 0x7f54c014cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.796+0000 7f54c6e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c00c99f0 con 0x7f54c0159030 2024-08-17T02:47:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.796+0000 7f54c6e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c00c7bb0 con 0x7f54c00b1920 2024-08-17T02:47:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.796+0000 7f54c6e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c00c7e90 con 0x7f54c0158c60 2024-08-17T02:47:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.796+0000 7f54c6400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c0159030 0x7f54c014cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.796+0000 7f54c6400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c0159030 0x7f54c014cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43622/0 (socket says 172.21.15.5:43622) 2024-08-17T02:47:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.796+0000 7f54c6400640 1 -- 172.21.15.5:0/98456337 learned_addr learned my addr 172.21.15.5:0/98456337 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.796+0000 7f54c5a00640 1 --2- 172.21.15.5:0/98456337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54c00b1920 0x7f54c00c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.796+0000 7f54c5000640 1 --2- 172.21.15.5:0/98456337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54c0158c60 0x7f54c00c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.797+0000 7f54c6400640 1 -- 172.21.15.5:0/98456337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54c0158c60 msgr2=0x7f54c00c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.797+0000 7f54c6400640 1 --2- 172.21.15.5:0/98456337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54c0158c60 0x7f54c00c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.797+0000 7f54c6400640 1 -- 172.21.15.5:0/98456337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54c00b1920 msgr2=0x7f54c00c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.797+0000 7f54c6400640 1 --2- 172.21.15.5:0/98456337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54c00b1920 0x7f54c00c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.797+0000 7f54c6400640 1 -- 172.21.15.5:0/98456337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b4009450 con 0x7f54c0159030 2024-08-17T02:47:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.797+0000 7f54c6400640 1 --2- 172.21.15.5:0/98456337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c0159030 0x7f54c014cf70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f54b8009fa0 tx=0x7f54b8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.797+0000 7f54bcc00640 1 -- 172.21.15.5:0/98456337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800ee60 con 0x7f54c0159030 2024-08-17T02:47:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.797+0000 7f54bcc00640 1 -- 172.21.15.5:0/98456337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b8014420 con 0x7f54c0159030 2024-08-17T02:47:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.797+0000 7f54c6e00640 1 -- 172.21.15.5:0/98456337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c00c8170 con 0x7f54c0159030 2024-08-17T02:47:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.797+0000 7f54bcc00640 1 -- 172.21.15.5:0/98456337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80147e0 con 0x7f54c0159030 2024-08-17T02:47:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.797+0000 7f54c6e00640 1 -- 172.21.15.5:0/98456337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c0168ec0 con 0x7f54c0159030 2024-08-17T02:47:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.798+0000 7f54c6e00640 1 -- 172.21.15.5:0/98456337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c0169110 con 0x7f54c0159030 2024-08-17T02:47:30.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.799+0000 7f54bcc00640 1 -- 172.21.15.5:0/98456337 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f54b8014b50 con 0x7f54c0159030 2024-08-17T02:47:30.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.800+0000 7f54bcc00640 1 --2- 172.21.15.5:0/98456337 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f54a0065150 0x7f54a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:30.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.800+0000 7f54bcc00640 1 -- 172.21.15.5:0/98456337 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f54b8082be0 con 0x7f54c0159030 2024-08-17T02:47:30.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.800+0000 7f54c5a00640 1 --2- 172.21.15.5:0/98456337 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f54a0065150 0x7f54a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:30.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.801+0000 7f54c5a00640 1 --2- 172.21.15.5:0/98456337 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f54a0065150 0x7f54a0067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f54b4034000 tx=0x7f54b4032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:30.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.804+0000 7f54bcc00640 1 -- 172.21.15.5:0/98456337 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f54b8050cb0 con 0x7f54c0159030 2024-08-17T02:47:30.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.988+0000 7f54c6e00640 1 -- 172.21.15.5:0/98456337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54c0070720 con 0x7f54c0159030 2024-08-17T02:47:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.989+0000 7f54bcc00640 1 -- 172.21.15.5:0/98456337 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f54b80542d0 con 0x7f54c0159030 2024-08-17T02:47:30.990 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:30.991 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:59.170637+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:55.543347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:56.571235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.991+0000 7f54c6e00640 1 -- 172.21.15.5:0/98456337 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f54a0065150 msgr2=0x7f54a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.991+0000 7f54c6e00640 1 --2- 172.21.15.5:0/98456337 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f54a0065150 0x7f54a0067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f54b4034000 tx=0x7f54b4032000 comp rx=0 tx=0).stop 2024-08-17T02:47:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.991+0000 7f54c6e00640 1 -- 172.21.15.5:0/98456337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c0159030 msgr2=0x7f54c014cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.991+0000 7f54c6e00640 1 --2- 172.21.15.5:0/98456337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c0159030 0x7f54c014cf70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f54b8009fa0 tx=0x7f54b8009900 comp rx=0 tx=0).stop 2024-08-17T02:47:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.991+0000 7f54c6e00640 1 -- 172.21.15.5:0/98456337 shutdown_connections 2024-08-17T02:47:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.991+0000 7f54c6e00640 1 --2- 172.21.15.5:0/98456337 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f54a0065150 0x7f54a0067600 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.991+0000 7f54c6e00640 1 --2- 172.21.15.5:0/98456337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c0159030 0x7f54c014cf70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.991+0000 7f54c6e00640 1 --2- 172.21.15.5:0/98456337 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54c0158c60 0x7f54c00c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.991+0000 7f54c6e00640 1 --2- 172.21.15.5:0/98456337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54c00b1920 0x7f54c00c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.991+0000 7f54c6e00640 1 -- 172.21.15.5:0/98456337 >> 172.21.15.5:0/98456337 conn(0x7f54c006e590 msgr2=0x7f54c0159450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.991+0000 7f54c6e00640 1 -- 172.21.15.5:0/98456337 shutdown_connections 2024-08-17T02:47:30.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:30.991+0000 7f54c6e00640 1 -- 172.21.15.5:0/98456337 wait complete. 2024-08-17T02:47:31.007 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:47.106425+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:55.543347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:56.571235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:47:31.008 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.161+0000 7f2747800640 1 Processor -- start 2024-08-17T02:47:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.161+0000 7f2747800640 1 -- start start 2024-08-17T02:47:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.163+0000 7f2747800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2740158d20 0x7f27400683b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.163+0000 7f2747800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f27400af700 0x7f27400abec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.163+0000 7f2747800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27400aa640 con 0x7f27400cce30 2024-08-17T02:47:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.163+0000 7f2747800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27400688f0 con 0x7f2740158d20 2024-08-17T02:47:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.163+0000 7f2747800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27400a9ac0 con 0x7f27400af700 2024-08-17T02:47:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.163+0000 7f2744e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2740158d20 0x7f27400683b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.163+0000 7f2744e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2740158d20 0x7f27400683b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43630/0 (socket says 172.21.15.5:43630) 2024-08-17T02:47:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.163+0000 7f2744e00640 1 -- 172.21.15.5:0/3955653115 learned_addr learned my addr 172.21.15.5:0/3955653115 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.163+0000 7f273fe00640 1 --1- 172.21.15.5:0/3955653115 >> v1:172.21.15.5:6789/0 conn(0x7f27400cce30 0x7f27400aeff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54244/0 (socket says 172.21.15.5:54244) 2024-08-17T02:47:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.163+0000 7f2745800640 1 --2- 172.21.15.5:0/3955653115 >> v2:172.21.15.107:3300/0 conn(0x7f27400af700 0x7f27400abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.163+0000 7f2744e00640 1 -- 172.21.15.5:0/3955653115 >> v2:172.21.15.107:3300/0 conn(0x7f27400af700 msgr2=0x7f27400abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.163+0000 7f2744e00640 1 --2- 172.21.15.5:0/3955653115 >> v2:172.21.15.107:3300/0 conn(0x7f27400af700 0x7f27400abec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.163+0000 7f2744e00640 1 -- 172.21.15.5:0/3955653115 >> v1:172.21.15.5:6789/0 conn(0x7f27400cce30 legacy=0x7f27400aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.164+0000 7f2744e00640 1 -- 172.21.15.5:0/3955653115 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27400a9da0 con 0x7f2740158d20 2024-08-17T02:47:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.164+0000 7f2745800640 1 --2- 172.21.15.5:0/3955653115 >> v2:172.21.15.107:3300/0 conn(0x7f27400af700 0x7f27400abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.164+0000 7f273f400640 1 -- 172.21.15.5:0/3955653115 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960400525 0 0) 0x7f27400aa640 con 0x7f27400cce30 2024-08-17T02:47:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.165+0000 7f2744e00640 1 --2- 172.21.15.5:0/3955653115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2740158d20 0x7f27400683b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f274006df60 tx=0x7f27340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793467dd5a4e2319 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.165+0000 7f273f400640 1 -- 172.21.15.5:0/3955653115 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273402add0 con 0x7f2740158d20 2024-08-17T02:47:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.165+0000 7f273f400640 1 -- 172.21.15.5:0/3955653115 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2734032440 con 0x7f2740158d20 2024-08-17T02:47:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.165+0000 7f273f400640 1 -- 172.21.15.5:0/3955653115 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27340327e0 con 0x7f2740158d20 2024-08-17T02:47:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.165+0000 7f2747800640 1 -- 172.21.15.5:0/3955653115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2740158d20 msgr2=0x7f27400683b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.165+0000 7f2747800640 1 --2- 172.21.15.5:0/3955653115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2740158d20 0x7f27400683b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f274006df60 tx=0x7f27340091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.165+0000 7f2747800640 1 -- 172.21.15.5:0/3955653115 shutdown_connections 2024-08-17T02:47:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.165+0000 7f2747800640 1 --2- 172.21.15.5:0/3955653115 >> v2:172.21.15.107:3300/0 conn(0x7f27400af700 0x7f27400abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.165+0000 7f2747800640 1 --2- 172.21.15.5:0/3955653115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2740158d20 0x7f27400683b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.165+0000 7f2747800640 1 -- 172.21.15.5:0/3955653115 >> 172.21.15.5:0/3955653115 conn(0x7f27400cc1d0 msgr2=0x7f27400cc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.166+0000 7f2747800640 1 -- 172.21.15.5:0/3955653115 shutdown_connections 2024-08-17T02:47:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.166+0000 7f2747800640 1 -- 172.21.15.5:0/3955653115 wait complete. 2024-08-17T02:47:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.167+0000 7f2747800640 1 Processor -- start 2024-08-17T02:47:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.167+0000 7f2747800640 1 -- start start 2024-08-17T02:47:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.168+0000 7f2747800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27400af700 0x7f2740168f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.168+0000 7f2747800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27400cce30 0x7f27401548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.168+0000 7f2747800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2740158d20 0x7f274006b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.168+0000 7f2747800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2740154180 con 0x7f27400cce30 2024-08-17T02:47:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.168+0000 7f2747800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2740169e40 con 0x7f27400af700 2024-08-17T02:47:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.168+0000 7f2747800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274016c6f0 con 0x7f2740158d20 2024-08-17T02:47:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.168+0000 7f273fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27400cce30 0x7f27401548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.168+0000 7f273fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27400cce30 0x7f27401548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43636/0 (socket says 172.21.15.5:43636) 2024-08-17T02:47:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.168+0000 7f273fe00640 1 -- 172.21.15.5:0/872993438 learned_addr learned my addr 172.21.15.5:0/872993438 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.168+0000 7f2744e00640 1 --2- 172.21.15.5:0/872993438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27400af700 0x7f2740168f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.168+0000 7f2745800640 1 --2- 172.21.15.5:0/872993438 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2740158d20 0x7f274006b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.169+0000 7f273fe00640 1 -- 172.21.15.5:0/872993438 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2740158d20 msgr2=0x7f274006b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.169+0000 7f273fe00640 1 --2- 172.21.15.5:0/872993438 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2740158d20 0x7f274006b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.169+0000 7f273fe00640 1 -- 172.21.15.5:0/872993438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27400af700 msgr2=0x7f2740168f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.169+0000 7f273fe00640 1 --2- 172.21.15.5:0/872993438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27400af700 0x7f2740168f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.169+0000 7f273fe00640 1 -- 172.21.15.5:0/872993438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2734009450 con 0x7f27400cce30 2024-08-17T02:47:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.169+0000 7f273fe00640 1 --2- 172.21.15.5:0/872993438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27400cce30 0x7f27401548f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f272c00c5e0 tx=0x7f272c007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.169+0000 7f2733e00640 1 -- 172.21.15.5:0/872993438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c007300 con 0x7f27400cce30 2024-08-17T02:47:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.169+0000 7f2733e00640 1 -- 172.21.15.5:0/872993438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c0074a0 con 0x7f27400cce30 2024-08-17T02:47:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.169+0000 7f2733e00640 1 -- 172.21.15.5:0/872993438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c0049f0 con 0x7f27400cce30 2024-08-17T02:47:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.169+0000 7f2747800640 1 -- 172.21.15.5:0/872993438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2740154e30 con 0x7f27400cce30 2024-08-17T02:47:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.169+0000 7f2747800640 1 -- 172.21.15.5:0/872993438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2740169880 con 0x7f27400cce30 2024-08-17T02:47:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.170+0000 7f2747800640 1 -- 172.21.15.5:0/872993438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2740063fb0 con 0x7f27400cce30 2024-08-17T02:47:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.171+0000 7f2733e00640 1 -- 172.21.15.5:0/872993438 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f272c01c3b0 con 0x7f27400cce30 2024-08-17T02:47:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.172+0000 7f2733e00640 1 --2- 172.21.15.5:0/872993438 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2720065180 0x7f2720067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.172+0000 7f2733e00640 1 -- 172.21.15.5:0/872993438 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f272c0816a0 con 0x7f27400cce30 2024-08-17T02:47:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.172+0000 7f2744e00640 1 --2- 172.21.15.5:0/872993438 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2720065180 0x7f2720067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.173+0000 7f2744e00640 1 --2- 172.21.15.5:0/872993438 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2720065180 0x7f2720067630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2734034000 tx=0x7f2734032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.176+0000 7f2733e00640 1 -- 172.21.15.5:0/872993438 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f272c04ce40 con 0x7f27400cce30 2024-08-17T02:47:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.359+0000 7f2747800640 1 -- 172.21.15.5:0/872993438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f274016c830 con 0x7f27400cce30 2024-08-17T02:47:31.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.359+0000 7f2733e00640 1 -- 172.21.15.5:0/872993438 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f272c053340 con 0x7f27400cce30 2024-08-17T02:47:31.361 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:47:31.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.361+0000 7f2747800640 1 -- 172.21.15.5:0/872993438 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2720065180 msgr2=0x7f2720067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.361+0000 7f2747800640 1 --2- 172.21.15.5:0/872993438 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2720065180 0x7f2720067630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2734034000 tx=0x7f2734032000 comp rx=0 tx=0).stop 2024-08-17T02:47:31.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.361+0000 7f2747800640 1 -- 172.21.15.5:0/872993438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27400cce30 msgr2=0x7f27401548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.361+0000 7f2747800640 1 --2- 172.21.15.5:0/872993438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27400cce30 0x7f27401548f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f272c00c5e0 tx=0x7f272c007f20 comp rx=0 tx=0).stop 2024-08-17T02:47:31.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.362+0000 7f2747800640 1 -- 172.21.15.5:0/872993438 shutdown_connections 2024-08-17T02:47:31.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.362+0000 7f2747800640 1 --2- 172.21.15.5:0/872993438 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2720065180 0x7f2720067630 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.362+0000 7f2747800640 1 --2- 172.21.15.5:0/872993438 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2740158d20 0x7f274006b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.362+0000 7f2747800640 1 --2- 172.21.15.5:0/872993438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27400cce30 0x7f27401548f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.362+0000 7f2747800640 1 --2- 172.21.15.5:0/872993438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27400af700 0x7f2740168f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.362+0000 7f2747800640 1 -- 172.21.15.5:0/872993438 >> 172.21.15.5:0/872993438 conn(0x7f27400cc1d0 msgr2=0x7f27401574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.362+0000 7f2747800640 1 -- 172.21.15.5:0/872993438 shutdown_connections 2024-08-17T02:47:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.362+0000 7f2747800640 1 -- 172.21.15.5:0/872993438 wait complete. 2024-08-17T02:47:31.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:47:31.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.530+0000 7f1566800640 1 Processor -- start 2024-08-17T02:47:31.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.530+0000 7f1566800640 1 -- start start 2024-08-17T02:47:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.531+0000 7f1566800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15600ae5e0 0x7f15600ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.531+0000 7f1566800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1560068e90 0x7f15600aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.531+0000 7f1566800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15600aaa50 con 0x7f15600aeef0 2024-08-17T02:47:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.531+0000 7f1566800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1560069980 con 0x7f15600ae5e0 2024-08-17T02:47:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.531+0000 7f1566800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15600693c0 con 0x7f1560068e90 2024-08-17T02:47:31.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.531+0000 7f1565400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15600ae5e0 0x7f15600ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.531+0000 7f1565400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15600ae5e0 0x7f15600ae9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43642/0 (socket says 172.21.15.5:43642) 2024-08-17T02:47:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.531+0000 7f1565400640 1 -- 172.21.15.5:0/3730279971 learned_addr learned my addr 172.21.15.5:0/3730279971 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.531+0000 7f1564a00640 1 --2- 172.21.15.5:0/3730279971 >> v2:172.21.15.107:3300/0 conn(0x7f1560068e90 0x7f15600aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.532+0000 7f1565400640 1 -- 172.21.15.5:0/3730279971 >> v2:172.21.15.107:3300/0 conn(0x7f1560068e90 msgr2=0x7f15600aaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.532+0000 7f1565400640 1 --2- 172.21.15.5:0/3730279971 >> v2:172.21.15.107:3300/0 conn(0x7f1560068e90 0x7f15600aaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.532+0000 7f1565400640 1 -- 172.21.15.5:0/3730279971 >> v1:172.21.15.107:6789/0 conn(0x7f15600aeef0 legacy=0x7f15600ab420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.532+0000 7f1565400640 1 -- 172.21.15.5:0/3730279971 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15600696a0 con 0x7f15600ae5e0 2024-08-17T02:47:31.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.532+0000 7f1564a00640 1 --2- 172.21.15.5:0/3730279971 >> v2:172.21.15.107:3300/0 conn(0x7f1560068e90 0x7f15600aaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.533+0000 7f1565400640 1 --2- 172.21.15.5:0/3730279971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15600ae5e0 0x7f15600ae9b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f156004bdf0 tx=0x7f15540091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ab15c60d99ee5f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.533+0000 7f155fe00640 1 -- 172.21.15.5:0/3730279971 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155402ae80 con 0x7f15600ae5e0 2024-08-17T02:47:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.533+0000 7f155fe00640 1 -- 172.21.15.5:0/3730279971 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1554032440 con 0x7f15600ae5e0 2024-08-17T02:47:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.533+0000 7f155fe00640 1 -- 172.21.15.5:0/3730279971 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554032800 con 0x7f15600ae5e0 2024-08-17T02:47:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.534+0000 7f1566800640 1 -- 172.21.15.5:0/3730279971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15600ae5e0 msgr2=0x7f15600ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.534+0000 7f1566800640 1 --2- 172.21.15.5:0/3730279971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15600ae5e0 0x7f15600ae9b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f156004bdf0 tx=0x7f15540091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.534+0000 7f1566800640 1 -- 172.21.15.5:0/3730279971 shutdown_connections 2024-08-17T02:47:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.534+0000 7f1566800640 1 --2- 172.21.15.5:0/3730279971 >> v2:172.21.15.107:3300/0 conn(0x7f1560068e90 0x7f15600aaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.534+0000 7f1566800640 1 --2- 172.21.15.5:0/3730279971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15600ae5e0 0x7f15600ae9b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.534+0000 7f1566800640 1 -- 172.21.15.5:0/3730279971 >> 172.21.15.5:0/3730279971 conn(0x7f15600ce3e0 msgr2=0x7f1560095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.534+0000 7f1566800640 1 -- 172.21.15.5:0/3730279971 shutdown_connections 2024-08-17T02:47:31.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.534+0000 7f1566800640 1 -- 172.21.15.5:0/3730279971 wait complete. 2024-08-17T02:47:31.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.535+0000 7f1566800640 1 Processor -- start 2024-08-17T02:47:31.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.535+0000 7f1566800640 1 -- start start 2024-08-17T02:47:31.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.536+0000 7f1566800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1560068e90 0x7f15600c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.536+0000 7f1566800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15600ae5e0 0x7f156014d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.536+0000 7f1566800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15600aeef0 0x7f15600c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.536+0000 7f1566800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15600cb960 con 0x7f15600aeef0 2024-08-17T02:47:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.536+0000 7f1566800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156014d9c0 con 0x7f15600ae5e0 2024-08-17T02:47:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.536+0000 7f1566800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15600c9920 con 0x7f1560068e90 2024-08-17T02:47:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.537+0000 7f1565e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15600aeef0 0x7f15600c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.537+0000 7f1565e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15600aeef0 0x7f15600c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43656/0 (socket says 172.21.15.5:43656) 2024-08-17T02:47:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.537+0000 7f1565e00640 1 -- 172.21.15.5:0/2358620454 learned_addr learned my addr 172.21.15.5:0/2358620454 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.537+0000 7f1565e00640 1 -- 172.21.15.5:0/2358620454 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1560068e90 msgr2=0x7f15600c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.537+0000 7f1565e00640 1 --2- 172.21.15.5:0/2358620454 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1560068e90 0x7f15600c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.537+0000 7f1565e00640 1 -- 172.21.15.5:0/2358620454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15600ae5e0 msgr2=0x7f156014d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.537+0000 7f1564a00640 1 --2- 172.21.15.5:0/2358620454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15600ae5e0 0x7f156014d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.537+0000 7f1565e00640 1 --2- 172.21.15.5:0/2358620454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15600ae5e0 0x7f156014d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.537+0000 7f1565e00640 1 -- 172.21.15.5:0/2358620454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1554009450 con 0x7f15600aeef0 2024-08-17T02:47:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.537+0000 7f1564a00640 1 --2- 172.21.15.5:0/2358620454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15600ae5e0 0x7f156014d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.537+0000 7f1565e00640 1 --2- 172.21.15.5:0/2358620454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15600aeef0 0x7f15600c7250 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f155800c7c0 tx=0x7f15580015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.538+0000 7f155cc00640 1 -- 172.21.15.5:0/2358620454 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155800a640 con 0x7f15600aeef0 2024-08-17T02:47:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.538+0000 7f155cc00640 1 -- 172.21.15.5:0/2358620454 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155800a7c0 con 0x7f15600aeef0 2024-08-17T02:47:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.538+0000 7f155cc00640 1 -- 172.21.15.5:0/2358620454 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155800ab80 con 0x7f15600aeef0 2024-08-17T02:47:31.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.538+0000 7f1566800640 1 -- 172.21.15.5:0/2358620454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15600c9c00 con 0x7f15600aeef0 2024-08-17T02:47:31.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.538+0000 7f1566800640 1 -- 172.21.15.5:0/2358620454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15600c7790 con 0x7f15600aeef0 2024-08-17T02:47:31.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.539+0000 7f1566800640 1 -- 172.21.15.5:0/2358620454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1560070720 con 0x7f15600aeef0 2024-08-17T02:47:31.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.540+0000 7f155cc00640 1 -- 172.21.15.5:0/2358620454 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1558003030 con 0x7f15600aeef0 2024-08-17T02:47:31.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.541+0000 7f155cc00640 1 --2- 172.21.15.5:0/2358620454 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1540065150 0x7f1540067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.541+0000 7f155cc00640 1 -- 172.21.15.5:0/2358620454 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1558082480 con 0x7f15600aeef0 2024-08-17T02:47:31.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.541+0000 7f1565400640 1 --2- 172.21.15.5:0/2358620454 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1540065150 0x7f1540067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.542+0000 7f1565400640 1 --2- 172.21.15.5:0/2358620454 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1540065150 0x7f1540067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1554034000 tx=0x7f1554032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:31.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.545+0000 7f155cc00640 1 -- 172.21.15.5:0/2358620454 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f15580504a0 con 0x7f15600aeef0 2024-08-17T02:47:31.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.727+0000 7f1566800640 1 -- 172.21.15.5:0/2358620454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15600cbaa0 con 0x7f15600aeef0 2024-08-17T02:47:31.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.728+0000 7f155cc00640 1 -- 172.21.15.5:0/2358620454 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1558053ac0 con 0x7f15600aeef0 2024-08-17T02:47:31.729 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:47:31.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.730+0000 7f1566800640 1 -- 172.21.15.5:0/2358620454 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1540065150 msgr2=0x7f1540067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.730+0000 7f1566800640 1 --2- 172.21.15.5:0/2358620454 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1540065150 0x7f1540067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1554034000 tx=0x7f1554032000 comp rx=0 tx=0).stop 2024-08-17T02:47:31.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.730+0000 7f1566800640 1 -- 172.21.15.5:0/2358620454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15600aeef0 msgr2=0x7f15600c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.730+0000 7f1566800640 1 --2- 172.21.15.5:0/2358620454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15600aeef0 0x7f15600c7250 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f155800c7c0 tx=0x7f15580015f0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.730+0000 7f1566800640 1 -- 172.21.15.5:0/2358620454 shutdown_connections 2024-08-17T02:47:31.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.730+0000 7f1566800640 1 --2- 172.21.15.5:0/2358620454 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f1540065150 0x7f1540067600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.730+0000 7f1566800640 1 --2- 172.21.15.5:0/2358620454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15600aeef0 0x7f15600c7250 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.730+0000 7f1566800640 1 --2- 172.21.15.5:0/2358620454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15600ae5e0 0x7f156014d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.730+0000 7f1566800640 1 --2- 172.21.15.5:0/2358620454 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1560068e90 0x7f15600c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.730+0000 7f1566800640 1 -- 172.21.15.5:0/2358620454 >> 172.21.15.5:0/2358620454 conn(0x7f15600ce3e0 msgr2=0x7f156006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:31.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.730+0000 7f1566800640 1 -- 172.21.15.5:0/2358620454 shutdown_connections 2024-08-17T02:47:31.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.730+0000 7f1566800640 1 -- 172.21.15.5:0/2358620454 wait complete. 2024-08-17T02:47:31.746 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:47:31.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.898+0000 7f02f1c00640 1 Processor -- start 2024-08-17T02:47:31.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.898+0000 7f02f1c00640 1 -- start start 2024-08-17T02:47:31.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.899+0000 7f02f1c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02ec158e10 0x7f02ec068180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.899+0000 7f02f1c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02ec0c40a0 con 0x7f02ec068dd0 2024-08-17T02:47:31.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.899+0000 7f02f1c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02ec069240 con 0x7f02ec1591e0 2024-08-17T02:47:31.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.899+0000 7f02f1c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02ec0694e0 con 0x7f02ec158e10 2024-08-17T02:47:31.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.900+0000 7f02eaa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02ec158e10 0x7f02ec068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.900+0000 7f02eaa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02ec158e10 0x7f02ec068180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43670/0 (socket says 172.21.15.5:43670) 2024-08-17T02:47:31.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.900+0000 7f02eaa00640 1 -- 172.21.15.5:0/3744313527 learned_addr learned my addr 172.21.15.5:0/3744313527 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.900+0000 7f02eaa00640 1 -- 172.21.15.5:0/3744313527 >> v1:172.21.15.107:6789/0 conn(0x7f02ec1591e0 legacy=0x7f02ec0686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.900+0000 7f02eaa00640 1 -- 172.21.15.5:0/3744313527 >> v1:172.21.15.5:6789/0 conn(0x7f02ec068dd0 legacy=0x7f02ec0cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.900+0000 7f02eaa00640 1 -- 172.21.15.5:0/3744313527 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ec0c3a50 con 0x7f02ec158e10 2024-08-17T02:47:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.900+0000 7f02e9600640 1 -- 172.21.15.5:0/3744313527 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966005162 0 0) 0x7f02ec0c40a0 con 0x7f02ec068dd0 2024-08-17T02:47:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.901+0000 7f02eaa00640 1 --2- 172.21.15.5:0/3744313527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02ec158e10 0x7f02ec068180 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009910 tx=0x7f02dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35cfe82ef2266a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.901+0000 7f02e9600640 1 -- 172.21.15.5:0/3744313527 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc032440 con 0x7f02ec158e10 2024-08-17T02:47:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.901+0000 7f02e9600640 1 -- 172.21.15.5:0/3744313527 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02dc0325a0 con 0x7f02ec158e10 2024-08-17T02:47:31.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.901+0000 7f02e9600640 1 -- 172.21.15.5:0/3744313527 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc032940 con 0x7f02ec158e10 2024-08-17T02:47:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.902+0000 7f02f1c00640 1 -- 172.21.15.5:0/3744313527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02ec158e10 msgr2=0x7f02ec068180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.902+0000 7f02f1c00640 1 --2- 172.21.15.5:0/3744313527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02ec158e10 0x7f02ec068180 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009910 tx=0x7f02dc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.902+0000 7f02f1c00640 1 -- 172.21.15.5:0/3744313527 shutdown_connections 2024-08-17T02:47:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.902+0000 7f02f1c00640 1 --2- 172.21.15.5:0/3744313527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02ec158e10 0x7f02ec068180 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.902+0000 7f02f1c00640 1 -- 172.21.15.5:0/3744313527 >> 172.21.15.5:0/3744313527 conn(0x7f02ec0ce590 msgr2=0x7f02ec0ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.902+0000 7f02f1c00640 1 -- 172.21.15.5:0/3744313527 shutdown_connections 2024-08-17T02:47:31.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.902+0000 7f02f1c00640 1 -- 172.21.15.5:0/3744313527 wait complete. 2024-08-17T02:47:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.903+0000 7f02f1c00640 1 Processor -- start 2024-08-17T02:47:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.904+0000 7f02f1c00640 1 -- start start 2024-08-17T02:47:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.904+0000 7f02f1c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02ec068dd0 0x7f02ec14ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.904+0000 7f02f1c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02ec158e10 0x7f02ec0c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.904+0000 7f02f1c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02ec1591e0 0x7f02ec0af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.904+0000 7f02f1c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec0c7080 con 0x7f02ec1591e0 2024-08-17T02:47:31.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.904+0000 7f02f1c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec0ab270 con 0x7f02ec158e10 2024-08-17T02:47:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.904+0000 7f02f1c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec0aaf40 con 0x7f02ec068dd0 2024-08-17T02:47:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.905+0000 7f02eb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02ec1591e0 0x7f02ec0af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.905+0000 7f02eb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02ec1591e0 0x7f02ec0af7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43674/0 (socket says 172.21.15.5:43674) 2024-08-17T02:47:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.905+0000 7f02eb400640 1 -- 172.21.15.5:0/4178219263 learned_addr learned my addr 172.21.15.5:0/4178219263 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.905+0000 7f02eaa00640 1 --2- 172.21.15.5:0/4178219263 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02ec068dd0 0x7f02ec14ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.905+0000 7f02ea000640 1 --2- 172.21.15.5:0/4178219263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02ec158e10 0x7f02ec0c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.905+0000 7f02eb400640 1 -- 172.21.15.5:0/4178219263 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02ec068dd0 msgr2=0x7f02ec14ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.905+0000 7f02eb400640 1 --2- 172.21.15.5:0/4178219263 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02ec068dd0 0x7f02ec14ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.905+0000 7f02eb400640 1 -- 172.21.15.5:0/4178219263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02ec158e10 msgr2=0x7f02ec0c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.905+0000 7f02eb400640 1 --2- 172.21.15.5:0/4178219263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02ec158e10 0x7f02ec0c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.905+0000 7f02eb400640 1 -- 172.21.15.5:0/4178219263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc009450 con 0x7f02ec1591e0 2024-08-17T02:47:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.905+0000 7f02ea000640 1 --2- 172.21.15.5:0/4178219263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02ec158e10 0x7f02ec0c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:31.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.905+0000 7f02eb400640 1 --2- 172.21.15.5:0/4178219263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02ec1591e0 0x7f02ec0af7a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f02e400c860 tx=0x7f02e4001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.906+0000 7f02e2000640 1 -- 172.21.15.5:0/4178219263 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e400ce50 con 0x7f02ec1591e0 2024-08-17T02:47:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.906+0000 7f02e2000640 1 -- 172.21.15.5:0/4178219263 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e400a850 con 0x7f02ec1591e0 2024-08-17T02:47:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.906+0000 7f02e2000640 1 -- 172.21.15.5:0/4178219263 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e400ac10 con 0x7f02ec1591e0 2024-08-17T02:47:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.906+0000 7f02f1c00640 1 -- 172.21.15.5:0/4178219263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ec0c8120 con 0x7f02ec1591e0 2024-08-17T02:47:31.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.906+0000 7f02f1c00640 1 -- 172.21.15.5:0/4178219263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ec0c6da0 con 0x7f02ec1591e0 2024-08-17T02:47:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.907+0000 7f02f1c00640 1 -- 172.21.15.5:0/4178219263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02ec0c78f0 con 0x7f02ec1591e0 2024-08-17T02:47:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.908+0000 7f02e2000640 1 -- 172.21.15.5:0/4178219263 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f02e4003030 con 0x7f02ec1591e0 2024-08-17T02:47:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.909+0000 7f02e2000640 1 --2- 172.21.15.5:0/4178219263 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f02cc065150 0x7f02cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.909+0000 7f02e2000640 1 -- 172.21.15.5:0/4178219263 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f02e4082560 con 0x7f02ec1591e0 2024-08-17T02:47:31.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.909+0000 7f02eaa00640 1 --2- 172.21.15.5:0/4178219263 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f02cc065150 0x7f02cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:31.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.910+0000 7f02eaa00640 1 --2- 172.21.15.5:0/4178219263 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f02cc065150 0x7f02cc067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f02dc034000 tx=0x7f02dc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:31.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:31.913+0000 7f02e2000640 1 -- 172.21.15.5:0/4178219263 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f02e4050580 con 0x7f02ec1591e0 2024-08-17T02:47:32.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.096+0000 7f02f1c00640 1 -- 172.21.15.5:0/4178219263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f02ec063fb0 con 0x7f02ec1591e0 2024-08-17T02:47:32.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.097+0000 7f02e2000640 1 -- 172.21.15.5:0/4178219263 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f02e4053ba0 con 0x7f02ec1591e0 2024-08-17T02:47:32.098 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:47:32.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.099+0000 7f02f1c00640 1 -- 172.21.15.5:0/4178219263 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f02cc065150 msgr2=0x7f02cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.099+0000 7f02f1c00640 1 --2- 172.21.15.5:0/4178219263 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f02cc065150 0x7f02cc067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f02dc034000 tx=0x7f02dc032000 comp rx=0 tx=0).stop 2024-08-17T02:47:32.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.099+0000 7f02f1c00640 1 -- 172.21.15.5:0/4178219263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02ec1591e0 msgr2=0x7f02ec0af7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.099+0000 7f02f1c00640 1 --2- 172.21.15.5:0/4178219263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02ec1591e0 0x7f02ec0af7a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f02e400c860 tx=0x7f02e4001630 comp rx=0 tx=0).stop 2024-08-17T02:47:32.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.099+0000 7f02f1c00640 1 -- 172.21.15.5:0/4178219263 shutdown_connections 2024-08-17T02:47:32.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.099+0000 7f02f1c00640 1 --2- 172.21.15.5:0/4178219263 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f02cc065150 0x7f02cc067600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.099+0000 7f02f1c00640 1 --2- 172.21.15.5:0/4178219263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02ec1591e0 0x7f02ec0af7a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.099+0000 7f02f1c00640 1 --2- 172.21.15.5:0/4178219263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02ec158e10 0x7f02ec0c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.099+0000 7f02f1c00640 1 --2- 172.21.15.5:0/4178219263 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02ec068dd0 0x7f02ec14ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.099+0000 7f02f1c00640 1 -- 172.21.15.5:0/4178219263 >> 172.21.15.5:0/4178219263 conn(0x7f02ec0ce590 msgr2=0x7f02ec0cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:32.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.099+0000 7f02f1c00640 1 -- 172.21.15.5:0/4178219263 shutdown_connections 2024-08-17T02:47:32.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.099+0000 7f02f1c00640 1 -- 172.21.15.5:0/4178219263 wait complete. 2024-08-17T02:47:32.183 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:47:32.183 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:47:32.183 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:32.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.333+0000 7f975ce00640 1 Processor -- start 2024-08-17T02:47:32.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.334+0000 7f975ce00640 1 -- start start 2024-08-17T02:47:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.335+0000 7f975ce00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9758156f90 0x7f97580b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.335+0000 7f975ce00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f975815a590 0x7f975813fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.335+0000 7f975ce00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975806d7c0 con 0x7f97580b0e30 2024-08-17T02:47:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.335+0000 7f975ce00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975815ab30 con 0x7f975815a590 2024-08-17T02:47:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.335+0000 7f975ce00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975815ae10 con 0x7f9758156f90 2024-08-17T02:47:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.335+0000 7f9757e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f975815a590 0x7f975813fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.335+0000 7f9757e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f975815a590 0x7f975813fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43688/0 (socket says 172.21.15.5:43688) 2024-08-17T02:47:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.335+0000 7f9757e00640 1 -- 172.21.15.5:0/3253169421 learned_addr learned my addr 172.21.15.5:0/3253169421 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.335+0000 7f974fe00640 1 --2- 172.21.15.5:0/3253169421 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9758156f90 0x7f97580b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.336+0000 7f9757e00640 1 -- 172.21.15.5:0/3253169421 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9758156f90 msgr2=0x7f97580b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.336+0000 7f9757e00640 1 --2- 172.21.15.5:0/3253169421 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9758156f90 0x7f97580b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.336+0000 7f9757e00640 1 -- 172.21.15.5:0/3253169421 >> v1:172.21.15.107:6789/0 conn(0x7f97580b0e30 legacy=0x7f97580cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.336+0000 7f9757e00640 1 -- 172.21.15.5:0/3253169421 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975815b0f0 con 0x7f975815a590 2024-08-17T02:47:32.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.337+0000 7f9757e00640 1 --2- 172.21.15.5:0/3253169421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975815a590 0x7f975813fcc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9750009f20 tx=0x7f9750009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22efb720c4013807 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:32.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.337+0000 7f9756a00640 1 -- 172.21.15.5:0/3253169421 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750031400 con 0x7f975815a590 2024-08-17T02:47:32.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.337+0000 7f9756a00640 1 -- 172.21.15.5:0/3253169421 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975002d050 con 0x7f975815a590 2024-08-17T02:47:32.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.337+0000 7f9756a00640 1 -- 172.21.15.5:0/3253169421 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97500317d0 con 0x7f975815a590 2024-08-17T02:47:32.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.337+0000 7f975ce00640 1 -- 172.21.15.5:0/3253169421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975815a590 msgr2=0x7f975813fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.337+0000 7f975ce00640 1 --2- 172.21.15.5:0/3253169421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975815a590 0x7f975813fcc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9750009f20 tx=0x7f9750009840 comp rx=0 tx=0).stop 2024-08-17T02:47:32.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.337+0000 7f975ce00640 1 -- 172.21.15.5:0/3253169421 shutdown_connections 2024-08-17T02:47:32.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.337+0000 7f975ce00640 1 --2- 172.21.15.5:0/3253169421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f975815a590 0x7f975813fcc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.337+0000 7f975ce00640 1 --2- 172.21.15.5:0/3253169421 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9758156f90 0x7f97580b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.337+0000 7f975ce00640 1 -- 172.21.15.5:0/3253169421 >> 172.21.15.5:0/3253169421 conn(0x7f9758062af0 msgr2=0x7f9758062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:32.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.338+0000 7f975ce00640 1 -- 172.21.15.5:0/3253169421 shutdown_connections 2024-08-17T02:47:32.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.338+0000 7f975ce00640 1 -- 172.21.15.5:0/3253169421 wait complete. 2024-08-17T02:47:32.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.339+0000 7f975ce00640 1 Processor -- start 2024-08-17T02:47:32.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.339+0000 7f975ce00640 1 -- start start 2024-08-17T02:47:32.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.340+0000 7f975ce00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97580b0e30 0x7f9758159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.340+0000 7f975ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9758156f90 0x7f975814b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.340+0000 7f975ce00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f975815a590 0x7f97581584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.340+0000 7f975ce00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9758159a10 con 0x7f9758156f90 2024-08-17T02:47:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.340+0000 7f975ce00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9758158e00 con 0x7f975815a590 2024-08-17T02:47:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.340+0000 7f975ce00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97581590e0 con 0x7f97580b0e30 2024-08-17T02:47:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.340+0000 7f974fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9758156f90 0x7f975814b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.340+0000 7f974fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9758156f90 0x7f975814b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43694/0 (socket says 172.21.15.5:43694) 2024-08-17T02:47:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.340+0000 7f974fe00640 1 -- 172.21.15.5:0/3193981224 learned_addr learned my addr 172.21.15.5:0/3193981224 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.341+0000 7f9757400640 1 --2- 172.21.15.5:0/3193981224 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97580b0e30 0x7f9758159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.341+0000 7f974fe00640 1 -- 172.21.15.5:0/3193981224 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97580b0e30 msgr2=0x7f9758159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.341+0000 7f9757e00640 1 --2- 172.21.15.5:0/3193981224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f975815a590 0x7f97581584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.341+0000 7f974fe00640 1 --2- 172.21.15.5:0/3193981224 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97580b0e30 0x7f9758159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.341+0000 7f974fe00640 1 -- 172.21.15.5:0/3193981224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f975815a590 msgr2=0x7f97581584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.341+0000 7f974fe00640 1 --2- 172.21.15.5:0/3193981224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f975815a590 0x7f97581584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.341+0000 7f974fe00640 1 -- 172.21.15.5:0/3193981224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9750009ae0 con 0x7f9758156f90 2024-08-17T02:47:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.341+0000 7f9757400640 1 --2- 172.21.15.5:0/3193981224 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97580b0e30 0x7f9758159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.341+0000 7f9757e00640 1 --2- 172.21.15.5:0/3193981224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f975815a590 0x7f97581584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.341+0000 7f974fe00640 1 --2- 172.21.15.5:0/3193981224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9758156f90 0x7f975814b060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f974000ea20 tx=0x7f97400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.341+0000 7f974ea00640 1 -- 172.21.15.5:0/3193981224 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974000ca10 con 0x7f9758156f90 2024-08-17T02:47:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.341+0000 7f974ea00640 1 -- 172.21.15.5:0/3193981224 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974000cb70 con 0x7f9758156f90 2024-08-17T02:47:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.341+0000 7f975ce00640 1 -- 172.21.15.5:0/3193981224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97581593c0 con 0x7f9758156f90 2024-08-17T02:47:32.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.341+0000 7f974ea00640 1 -- 172.21.15.5:0/3193981224 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740013470 con 0x7f9758156f90 2024-08-17T02:47:32.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.341+0000 7f975ce00640 1 -- 172.21.15.5:0/3193981224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97581589f0 con 0x7f9758156f90 2024-08-17T02:47:32.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.343+0000 7f975ce00640 1 -- 172.21.15.5:0/3193981224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975813c1c0 con 0x7f9758156f90 2024-08-17T02:47:32.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.343+0000 7f974ea00640 1 -- 172.21.15.5:0/3193981224 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9740013860 con 0x7f9758156f90 2024-08-17T02:47:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.345+0000 7f974ea00640 1 --2- 172.21.15.5:0/3193981224 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9734065150 0x7f9734067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.345+0000 7f974ea00640 1 -- 172.21.15.5:0/3193981224 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9740082940 con 0x7f9758156f90 2024-08-17T02:47:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.345+0000 7f9757400640 1 --2- 172.21.15.5:0/3193981224 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9734065150 0x7f9734067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.345+0000 7f9757400640 1 --2- 172.21.15.5:0/3193981224 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9734065150 0x7f9734067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f97480017a0 tx=0x7f9748009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:32.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.349+0000 7f974ea00640 1 -- 172.21.15.5:0/3193981224 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f975813c1c0 con 0x7f9758156f90 2024-08-17T02:47:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.536+0000 7f975ce00640 1 -- 172.21.15.5:0/3193981224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f975813c1c0 con 0x7f9758156f90 2024-08-17T02:47:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.537+0000 7f974ea00640 1 -- 172.21.15.5:0/3193981224 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f975813c1c0 con 0x7f9758156f90 2024-08-17T02:47:32.539 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:32.539 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:59.170637+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:55.543347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:56.571235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.539+0000 7f975ce00640 1 -- 172.21.15.5:0/3193981224 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9734065150 msgr2=0x7f9734067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.539+0000 7f975ce00640 1 --2- 172.21.15.5:0/3193981224 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9734065150 0x7f9734067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f97480017a0 tx=0x7f9748009040 comp rx=0 tx=0).stop 2024-08-17T02:47:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.539+0000 7f975ce00640 1 -- 172.21.15.5:0/3193981224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9758156f90 msgr2=0x7f975814b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.539+0000 7f975ce00640 1 --2- 172.21.15.5:0/3193981224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9758156f90 0x7f975814b060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f974000ea20 tx=0x7f97400090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.540+0000 7f975ce00640 1 -- 172.21.15.5:0/3193981224 shutdown_connections 2024-08-17T02:47:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.540+0000 7f975ce00640 1 --2- 172.21.15.5:0/3193981224 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9734065150 0x7f9734067600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.540+0000 7f975ce00640 1 --2- 172.21.15.5:0/3193981224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f975815a590 0x7f97581584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.540+0000 7f975ce00640 1 --2- 172.21.15.5:0/3193981224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9758156f90 0x7f975814b060 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.540+0000 7f975ce00640 1 --2- 172.21.15.5:0/3193981224 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97580b0e30 0x7f9758159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.540+0000 7f975ce00640 1 -- 172.21.15.5:0/3193981224 >> 172.21.15.5:0/3193981224 conn(0x7f9758062af0 msgr2=0x7f975806ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:32.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.540+0000 7f975ce00640 1 -- 172.21.15.5:0/3193981224 shutdown_connections 2024-08-17T02:47:32.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.540+0000 7f975ce00640 1 -- 172.21.15.5:0/3193981224 wait complete. 2024-08-17T02:47:32.557 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:47.106425+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:55.543347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:56.571235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:47:32.558 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.711+0000 7fd07e000640 1 Processor -- start 2024-08-17T02:47:32.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.711+0000 7fd07e000640 1 -- start start 2024-08-17T02:47:32.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.712+0000 7fd07e000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd078158e60 0x7fd0780add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.712+0000 7fd07e000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0780ae860 0x7fd0780ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.712+0000 7fd07e000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0780b03b0 0x7fd0780b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.712+0000 7fd07e000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0780ad8a0 con 0x7fd0780ae860 2024-08-17T02:47:32.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.712+0000 7fd07e000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0780b0d10 con 0x7fd078158e60 2024-08-17T02:47:32.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.712+0000 7fd07e000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd07806edf0 con 0x7fd0780b03b0 2024-08-17T02:47:32.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.712+0000 7fd06fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0780ae860 0x7fd0780ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.712+0000 7fd06fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0780ae860 0x7fd0780ac5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43706/0 (socket says 172.21.15.5:43706) 2024-08-17T02:47:32.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.712+0000 7fd06fe00640 1 -- 172.21.15.5:0/895556341 learned_addr learned my addr 172.21.15.5:0/895556341 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:32.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.713+0000 7fd077e00640 1 --2- 172.21.15.5:0/895556341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0780b03b0 0x7fd0780b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.713+0000 7fd077400640 1 --2- 172.21.15.5:0/895556341 >> v2:172.21.15.107:3300/0 conn(0x7fd078158e60 0x7fd0780add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.713+0000 7fd06fe00640 1 -- 172.21.15.5:0/895556341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0780b03b0 msgr2=0x7fd0780b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:32.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.713+0000 7fd06fe00640 1 --2- 172.21.15.5:0/895556341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0780b03b0 0x7fd0780b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.713+0000 7fd06fe00640 1 -- 172.21.15.5:0/895556341 >> v2:172.21.15.107:3300/0 conn(0x7fd078158e60 msgr2=0x7fd0780add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:32.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.713+0000 7fd06fe00640 1 --2- 172.21.15.5:0/895556341 >> v2:172.21.15.107:3300/0 conn(0x7fd078158e60 0x7fd0780add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.713+0000 7fd06fe00640 1 -- 172.21.15.5:0/895556341 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0780acc90 con 0x7fd0780ae860 2024-08-17T02:47:32.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.714+0000 7fd06fe00640 1 --2- 172.21.15.5:0/895556341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0780ae860 0x7fd0780ac5d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd078068890 tx=0x7fd0600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c0aef7d13d89a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:32.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.714+0000 7fd076a00640 1 -- 172.21.15.5:0/895556341 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06002add0 con 0x7fd0780ae860 2024-08-17T02:47:32.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.714+0000 7fd076a00640 1 -- 172.21.15.5:0/895556341 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd060032440 con 0x7fd0780ae860 2024-08-17T02:47:32.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.714+0000 7fd076a00640 1 -- 172.21.15.5:0/895556341 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060032820 con 0x7fd0780ae860 2024-08-17T02:47:32.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.714+0000 7fd07e000640 1 -- 172.21.15.5:0/895556341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0780ae860 msgr2=0x7fd0780ac5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.714+0000 7fd07e000640 1 --2- 172.21.15.5:0/895556341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0780ae860 0x7fd0780ac5d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd078068890 tx=0x7fd0600091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.715+0000 7fd07e000640 1 -- 172.21.15.5:0/895556341 shutdown_connections 2024-08-17T02:47:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.715+0000 7fd07e000640 1 --2- 172.21.15.5:0/895556341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0780b03b0 0x7fd0780b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.715+0000 7fd07e000640 1 --2- 172.21.15.5:0/895556341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0780ae860 0x7fd0780ac5d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.715+0000 7fd07e000640 1 --2- 172.21.15.5:0/895556341 >> v2:172.21.15.107:3300/0 conn(0x7fd078158e60 0x7fd0780add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.715+0000 7fd07e000640 1 -- 172.21.15.5:0/895556341 >> 172.21.15.5:0/895556341 conn(0x7fd0780cc390 msgr2=0x7fd078066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.715+0000 7fd07e000640 1 -- 172.21.15.5:0/895556341 shutdown_connections 2024-08-17T02:47:32.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.715+0000 7fd07e000640 1 -- 172.21.15.5:0/895556341 wait complete. 2024-08-17T02:47:32.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.716+0000 7fd07e000640 1 Processor -- start 2024-08-17T02:47:32.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.716+0000 7fd07e000640 1 -- start start 2024-08-17T02:47:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.717+0000 7fd07e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0780ae860 0x7fd078140030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.717+0000 7fd07e000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0780b03b0 0x7fd078150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.717+0000 7fd07e000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd078158e60 0x7fd078149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.717+0000 7fd07e000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07814d350 con 0x7fd0780ae860 2024-08-17T02:47:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.717+0000 7fd07e000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07814c780 con 0x7fd0780b03b0 2024-08-17T02:47:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.717+0000 7fd07e000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0781517b0 con 0x7fd078158e60 2024-08-17T02:47:32.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.717+0000 7fd077400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0780ae860 0x7fd078140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.717+0000 7fd077400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0780ae860 0x7fd078140030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43714/0 (socket says 172.21.15.5:43714) 2024-08-17T02:47:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.717+0000 7fd077400640 1 -- 172.21.15.5:0/2161733356 learned_addr learned my addr 172.21.15.5:0/2161733356 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.718+0000 7fd06fe00640 1 --2- 172.21.15.5:0/2161733356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0780b03b0 0x7fd078150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.718+0000 7fd077e00640 1 --2- 172.21.15.5:0/2161733356 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd078158e60 0x7fd078149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.718+0000 7fd077400640 1 -- 172.21.15.5:0/2161733356 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd078158e60 msgr2=0x7fd078149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.718+0000 7fd077400640 1 --2- 172.21.15.5:0/2161733356 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd078158e60 0x7fd078149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.718+0000 7fd077400640 1 -- 172.21.15.5:0/2161733356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0780b03b0 msgr2=0x7fd078150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.718+0000 7fd077400640 1 --2- 172.21.15.5:0/2161733356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0780b03b0 0x7fd078150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.718+0000 7fd077400640 1 -- 172.21.15.5:0/2161733356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd060009450 con 0x7fd0780ae860 2024-08-17T02:47:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.718+0000 7fd077400640 1 --2- 172.21.15.5:0/2161733356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0780ae860 0x7fd078140030 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd06800d8c0 tx=0x7fd068008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.718+0000 7fd06ea00640 1 -- 172.21.15.5:0/2161733356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06800de50 con 0x7fd0780ae860 2024-08-17T02:47:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.718+0000 7fd06ea00640 1 -- 172.21.15.5:0/2161733356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0680098b0 con 0x7fd0780ae860 2024-08-17T02:47:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.718+0000 7fd06ea00640 1 -- 172.21.15.5:0/2161733356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068009c50 con 0x7fd0780ae860 2024-08-17T02:47:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.718+0000 7fd07e000640 1 -- 172.21.15.5:0/2161733356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07814cc90 con 0x7fd0780ae860 2024-08-17T02:47:32.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.719+0000 7fd07e000640 1 -- 172.21.15.5:0/2161733356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd078150030 con 0x7fd0780ae860 2024-08-17T02:47:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.720+0000 7fd07e000640 1 -- 172.21.15.5:0/2161733356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd078063fb0 con 0x7fd0780ae860 2024-08-17T02:47:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.720+0000 7fd06ea00640 1 -- 172.21.15.5:0/2161733356 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd068014620 con 0x7fd0780ae860 2024-08-17T02:47:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.721+0000 7fd06ea00640 1 --2- 172.21.15.5:0/2161733356 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd054065150 0x7fd054067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.721+0000 7fd06ea00640 1 -- 172.21.15.5:0/2161733356 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd068082c60 con 0x7fd0780ae860 2024-08-17T02:47:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.722+0000 7fd06fe00640 1 --2- 172.21.15.5:0/2161733356 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd054065150 0x7fd054067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.722+0000 7fd06fe00640 1 --2- 172.21.15.5:0/2161733356 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd054065150 0x7fd054067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd060034000 tx=0x7fd060032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.725+0000 7fd06ea00640 1 -- 172.21.15.5:0/2161733356 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd068050c80 con 0x7fd0780ae860 2024-08-17T02:47:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.911+0000 7fd07e000640 1 -- 172.21.15.5:0/2161733356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0780635f0 con 0x7fd0780ae860 2024-08-17T02:47:32.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.912+0000 7fd06ea00640 1 -- 172.21.15.5:0/2161733356 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0680542a0 con 0x7fd0780ae860 2024-08-17T02:47:32.913 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:47:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.914+0000 7fd07e000640 1 -- 172.21.15.5:0/2161733356 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd054065150 msgr2=0x7fd054067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.914+0000 7fd07e000640 1 --2- 172.21.15.5:0/2161733356 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd054065150 0x7fd054067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd060034000 tx=0x7fd060032000 comp rx=0 tx=0).stop 2024-08-17T02:47:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.914+0000 7fd07e000640 1 -- 172.21.15.5:0/2161733356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0780ae860 msgr2=0x7fd078140030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.914+0000 7fd07e000640 1 --2- 172.21.15.5:0/2161733356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0780ae860 0x7fd078140030 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd06800d8c0 tx=0x7fd068008040 comp rx=0 tx=0).stop 2024-08-17T02:47:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.914+0000 7fd07e000640 1 -- 172.21.15.5:0/2161733356 shutdown_connections 2024-08-17T02:47:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.914+0000 7fd07e000640 1 --2- 172.21.15.5:0/2161733356 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd054065150 0x7fd054067600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.914+0000 7fd07e000640 1 --2- 172.21.15.5:0/2161733356 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd078158e60 0x7fd078149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.914+0000 7fd07e000640 1 --2- 172.21.15.5:0/2161733356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0780b03b0 0x7fd078150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.914+0000 7fd07e000640 1 --2- 172.21.15.5:0/2161733356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0780ae860 0x7fd078140030 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:32.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.914+0000 7fd07e000640 1 -- 172.21.15.5:0/2161733356 >> 172.21.15.5:0/2161733356 conn(0x7fd0780cc390 msgr2=0x7fd0780ac030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:32.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.914+0000 7fd07e000640 1 -- 172.21.15.5:0/2161733356 shutdown_connections 2024-08-17T02:47:32.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:32.914+0000 7fd07e000640 1 -- 172.21.15.5:0/2161733356 wait complete. 2024-08-17T02:47:32.930 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:47:33.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.083+0000 7f3fd3c00640 1 Processor -- start 2024-08-17T02:47:33.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.084+0000 7f3fd3c00640 1 -- start start 2024-08-17T02:47:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.085+0000 7f3fd3c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3fcc0ca050 0x7f3fcc156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.085+0000 7f3fd3c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fcc0add30 0x7f3fcc15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.085+0000 7f3fd3c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fcc15b5e0 con 0x7f3fcc0ad960 2024-08-17T02:47:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.085+0000 7f3fd3c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fcc0cb160 con 0x7f3fcc0ca050 2024-08-17T02:47:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.085+0000 7f3fd3c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0b0d10 con 0x7f3fcc0add30 2024-08-17T02:47:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.085+0000 7f3fd1c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fcc0add30 0x7f3fcc15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.085+0000 7f3fd1c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fcc0add30 0x7f3fcc15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:50778/0 (socket says 172.21.15.5:50778) 2024-08-17T02:47:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.085+0000 7f3fd1c00640 1 -- 172.21.15.5:0/3580898702 learned_addr learned my addr 172.21.15.5:0/3580898702 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.085+0000 7f3fcbe00640 1 --2- 172.21.15.5:0/3580898702 >> v2:172.21.15.107:3300/0 conn(0x7f3fcc0ca050 0x7f3fcc156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.086+0000 7f3fd1c00640 1 -- 172.21.15.5:0/3580898702 >> v2:172.21.15.107:3300/0 conn(0x7f3fcc0ca050 msgr2=0x7f3fcc156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.086+0000 7f3fd1c00640 1 --2- 172.21.15.5:0/3580898702 >> v2:172.21.15.107:3300/0 conn(0x7f3fcc0ca050 0x7f3fcc156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.086+0000 7f3fd1c00640 1 -- 172.21.15.5:0/3580898702 >> v1:172.21.15.107:6789/0 conn(0x7f3fcc0ad960 legacy=0x7f3fcc156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.086+0000 7f3fd1c00640 1 -- 172.21.15.5:0/3580898702 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc0ca550 con 0x7f3fcc0add30 2024-08-17T02:47:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.087+0000 7f3fd1c00640 1 --2- 172.21.15.5:0/3580898702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fcc0add30 0x7f3fcc15b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009f20 tx=0x7f3fc4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b5a1731c1eb113a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.087+0000 7f3fcb400640 1 -- 172.21.15.5:0/3580898702 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4032450 con 0x7f3fcc0add30 2024-08-17T02:47:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.087+0000 7f3fcb400640 1 -- 172.21.15.5:0/3580898702 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc40325b0 con 0x7f3fcc0add30 2024-08-17T02:47:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.087+0000 7f3fcb400640 1 -- 172.21.15.5:0/3580898702 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4032990 con 0x7f3fcc0add30 2024-08-17T02:47:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.088+0000 7f3fd3c00640 1 -- 172.21.15.5:0/3580898702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fcc0add30 msgr2=0x7f3fcc15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.088+0000 7f3fd3c00640 1 --2- 172.21.15.5:0/3580898702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fcc0add30 0x7f3fcc15b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009f20 tx=0x7f3fc4009840 comp rx=0 tx=0).stop 2024-08-17T02:47:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.088+0000 7f3fd3c00640 1 -- 172.21.15.5:0/3580898702 shutdown_connections 2024-08-17T02:47:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.088+0000 7f3fd3c00640 1 --2- 172.21.15.5:0/3580898702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fcc0add30 0x7f3fcc15b0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.088+0000 7f3fd3c00640 1 --2- 172.21.15.5:0/3580898702 >> v2:172.21.15.107:3300/0 conn(0x7f3fcc0ca050 0x7f3fcc156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.088+0000 7f3fd3c00640 1 -- 172.21.15.5:0/3580898702 >> 172.21.15.5:0/3580898702 conn(0x7f3fcc066e60 msgr2=0x7f3fcc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.088+0000 7f3fd3c00640 1 -- 172.21.15.5:0/3580898702 shutdown_connections 2024-08-17T02:47:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.088+0000 7f3fd3c00640 1 -- 172.21.15.5:0/3580898702 wait complete. 2024-08-17T02:47:33.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.089+0000 7f3fd3c00640 1 Processor -- start 2024-08-17T02:47:33.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.089+0000 7f3fd3c00640 1 -- start start 2024-08-17T02:47:33.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.090+0000 7f3fd3c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fcc0ad960 0x7f3fcc157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.090+0000 7f3fd3c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fcc0add30 0x7f3fcc157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.090+0000 7f3fd3c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fcc0ca050 0x7f3fcc14fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.090+0000 7f3fd3c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc157930 con 0x7f3fcc0ca050 2024-08-17T02:47:33.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.090+0000 7f3fd3c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0ace30 con 0x7f3fcc0ad960 2024-08-17T02:47:33.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.090+0000 7f3fd3c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0ac9a0 con 0x7f3fcc0add30 2024-08-17T02:47:33.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.091+0000 7f3fd1c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fcc0ca050 0x7f3fcc14fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.091+0000 7f3fd1c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fcc0ca050 0x7f3fcc14fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43730/0 (socket says 172.21.15.5:43730) 2024-08-17T02:47:33.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.091+0000 7f3fd1c00640 1 -- 172.21.15.5:0/3113990858 learned_addr learned my addr 172.21.15.5:0/3113990858 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.091+0000 7f3fcbe00640 1 --2- 172.21.15.5:0/3113990858 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fcc0add30 0x7f3fcc157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.091+0000 7f3fd1200640 1 --2- 172.21.15.5:0/3113990858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fcc0ad960 0x7f3fcc157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.091+0000 7f3fd1c00640 1 -- 172.21.15.5:0/3113990858 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fcc0add30 msgr2=0x7f3fcc157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.091+0000 7f3fd1c00640 1 --2- 172.21.15.5:0/3113990858 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fcc0add30 0x7f3fcc157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.091+0000 7f3fd1c00640 1 -- 172.21.15.5:0/3113990858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fcc0ad960 msgr2=0x7f3fcc157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.091+0000 7f3fd1c00640 1 --2- 172.21.15.5:0/3113990858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fcc0ad960 0x7f3fcc157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.091+0000 7f3fd1c00640 1 -- 172.21.15.5:0/3113990858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc4009ae0 con 0x7f3fcc0ca050 2024-08-17T02:47:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.092+0000 7f3fd1c00640 1 --2- 172.21.15.5:0/3113990858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fcc0ca050 0x7f3fcc14fff0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009f80 tx=0x7f3fc4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.092+0000 7f3fbfe00640 1 -- 172.21.15.5:0/3113990858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4032450 con 0x7f3fcc0ca050 2024-08-17T02:47:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.092+0000 7f3fbfe00640 1 -- 172.21.15.5:0/3113990858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc4008e50 con 0x7f3fcc0ca050 2024-08-17T02:47:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.092+0000 7f3fd3c00640 1 -- 172.21.15.5:0/3113990858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fcc0ac070 con 0x7f3fcc0ca050 2024-08-17T02:47:33.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.092+0000 7f3fbfe00640 1 -- 172.21.15.5:0/3113990858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc403c680 con 0x7f3fcc0ca050 2024-08-17T02:47:33.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.092+0000 7f3fd3c00640 1 -- 172.21.15.5:0/3113990858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fcc0ac630 con 0x7f3fcc0ca050 2024-08-17T02:47:33.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.093+0000 7f3fd3c00640 1 -- 172.21.15.5:0/3113990858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fcc0acb30 con 0x7f3fcc0ca050 2024-08-17T02:47:33.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.094+0000 7f3fbfe00640 1 -- 172.21.15.5:0/3113990858 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3fc4039050 con 0x7f3fcc0ca050 2024-08-17T02:47:33.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.095+0000 7f3fbfe00640 1 --2- 172.21.15.5:0/3113990858 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3fac065150 0x7f3fac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.095+0000 7f3fbfe00640 1 -- 172.21.15.5:0/3113990858 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3fc402e050 con 0x7f3fcc0ca050 2024-08-17T02:47:33.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.095+0000 7f3fd1200640 1 --2- 172.21.15.5:0/3113990858 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3fac065150 0x7f3fac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.096+0000 7f3fd1200640 1 --2- 172.21.15.5:0/3113990858 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3fac065150 0x7f3fac067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00037c0 tx=0x7f3fc0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:33.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.099+0000 7f3fbfe00640 1 -- 172.21.15.5:0/3113990858 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3fc40715e0 con 0x7f3fcc0ca050 2024-08-17T02:47:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.287+0000 7f3fd3c00640 1 -- 172.21.15.5:0/3113990858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3fcc1576a0 con 0x7f3fcc0ca050 2024-08-17T02:47:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.287+0000 7f3fbfe00640 1 -- 172.21.15.5:0/3113990858 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3fc4074c00 con 0x7f3fcc0ca050 2024-08-17T02:47:33.288 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:47:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.289+0000 7f3fd3c00640 1 -- 172.21.15.5:0/3113990858 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3fac065150 msgr2=0x7f3fac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.289+0000 7f3fd3c00640 1 --2- 172.21.15.5:0/3113990858 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3fac065150 0x7f3fac067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00037c0 tx=0x7f3fc0009040 comp rx=0 tx=0).stop 2024-08-17T02:47:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.289+0000 7f3fd3c00640 1 -- 172.21.15.5:0/3113990858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fcc0ca050 msgr2=0x7f3fcc14fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.289+0000 7f3fd3c00640 1 --2- 172.21.15.5:0/3113990858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fcc0ca050 0x7f3fcc14fff0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009f80 tx=0x7f3fc4037000 comp rx=0 tx=0).stop 2024-08-17T02:47:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.289+0000 7f3fd3c00640 1 -- 172.21.15.5:0/3113990858 shutdown_connections 2024-08-17T02:47:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.289+0000 7f3fd3c00640 1 --2- 172.21.15.5:0/3113990858 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3fac065150 0x7f3fac067600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.289+0000 7f3fd3c00640 1 --2- 172.21.15.5:0/3113990858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fcc0ca050 0x7f3fcc14fff0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.289+0000 7f3fd3c00640 1 --2- 172.21.15.5:0/3113990858 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fcc0add30 0x7f3fcc157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.289+0000 7f3fd3c00640 1 --2- 172.21.15.5:0/3113990858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fcc0ad960 0x7f3fcc157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.289+0000 7f3fd3c00640 1 -- 172.21.15.5:0/3113990858 >> 172.21.15.5:0/3113990858 conn(0x7f3fcc066e60 msgr2=0x7f3fcc154b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:33.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.290+0000 7f3fd3c00640 1 -- 172.21.15.5:0/3113990858 shutdown_connections 2024-08-17T02:47:33.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.290+0000 7f3fd3c00640 1 -- 172.21.15.5:0/3113990858 wait complete. 2024-08-17T02:47:33.307 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:47:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.459+0000 7f2ba9a00640 1 Processor -- start 2024-08-17T02:47:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.459+0000 7f2ba9a00640 1 -- start start 2024-08-17T02:47:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.461+0000 7f2ba9a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba4156900 0x7f2ba40b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.461+0000 7f2ba9a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ba40ae180 0x7f2ba40aab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.461+0000 7f2ba9a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba40b0b10 con 0x7f2ba40ae7d0 2024-08-17T02:47:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.461+0000 7f2ba9a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba40b0df0 con 0x7f2ba40ae180 2024-08-17T02:47:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.461+0000 7f2ba9a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40b10d0 con 0x7f2ba4156900 2024-08-17T02:47:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.461+0000 7f2ba9000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ba40ae180 0x7f2ba40aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.461+0000 7f2ba9000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ba40ae180 0x7f2ba40aab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43744/0 (socket says 172.21.15.5:43744) 2024-08-17T02:47:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.461+0000 7f2ba9000640 1 -- 172.21.15.5:0/1550573740 learned_addr learned my addr 172.21.15.5:0/1550573740 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.461+0000 7f2ba3e00640 1 --2- 172.21.15.5:0/1550573740 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba4156900 0x7f2ba40b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.461+0000 7f2ba9000640 1 -- 172.21.15.5:0/1550573740 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba4156900 msgr2=0x7f2ba40b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.461+0000 7f2ba9000640 1 --2- 172.21.15.5:0/1550573740 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba4156900 0x7f2ba40b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.461+0000 7f2ba9000640 1 -- 172.21.15.5:0/1550573740 >> v1:172.21.15.5:6789/0 conn(0x7f2ba40ae7d0 legacy=0x7f2ba40ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.461+0000 7f2ba9000640 1 -- 172.21.15.5:0/1550573740 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba40b13b0 con 0x7f2ba40ae180 2024-08-17T02:47:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.462+0000 7f2ba9000640 1 --2- 172.21.15.5:0/1550573740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba40ae180 0x7f2ba40aab20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009f20 tx=0x7f2b9c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6d753f26a5ccce server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.463+0000 7f2ba3400640 1 -- 172.21.15.5:0/1550573740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c031400 con 0x7f2ba40ae180 2024-08-17T02:47:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.463+0000 7f2ba3400640 1 -- 172.21.15.5:0/1550573740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c02d050 con 0x7f2ba40ae180 2024-08-17T02:47:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.463+0000 7f2ba3400640 1 -- 172.21.15.5:0/1550573740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0317d0 con 0x7f2ba40ae180 2024-08-17T02:47:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.463+0000 7f2ba9a00640 1 -- 172.21.15.5:0/1550573740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba40ae180 msgr2=0x7f2ba40aab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.463+0000 7f2ba9a00640 1 --2- 172.21.15.5:0/1550573740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba40ae180 0x7f2ba40aab20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009f20 tx=0x7f2b9c009840 comp rx=0 tx=0).stop 2024-08-17T02:47:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.463+0000 7f2ba9a00640 1 -- 172.21.15.5:0/1550573740 shutdown_connections 2024-08-17T02:47:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.463+0000 7f2ba9a00640 1 --2- 172.21.15.5:0/1550573740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba40ae180 0x7f2ba40aab20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.463+0000 7f2ba9a00640 1 --2- 172.21.15.5:0/1550573740 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba4156900 0x7f2ba40b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.463+0000 7f2ba9a00640 1 -- 172.21.15.5:0/1550573740 >> 172.21.15.5:0/1550573740 conn(0x7f2ba4067930 msgr2=0x7f2ba40cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.463+0000 7f2ba9a00640 1 -- 172.21.15.5:0/1550573740 shutdown_connections 2024-08-17T02:47:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.463+0000 7f2ba9a00640 1 -- 172.21.15.5:0/1550573740 wait complete. 2024-08-17T02:47:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.465+0000 7f2ba9a00640 1 Processor -- start 2024-08-17T02:47:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.465+0000 7f2ba9a00640 1 -- start start 2024-08-17T02:47:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.466+0000 7f2ba9a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba40ae180 0x7f2ba4154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.466+0000 7f2ba9a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba40ae7d0 0x7f2ba4168ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.466+0000 7f2ba9a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba4156900 0x7f2ba41693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.466+0000 7f2ba9a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba4169920 con 0x7f2ba40ae7d0 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.466+0000 7f2ba9a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba4142fd0 con 0x7f2ba40ae180 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.466+0000 7f2ba9a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40a98b0 con 0x7f2ba4156900 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.466+0000 7f2b9be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba40ae7d0 0x7f2ba4168ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.466+0000 7f2b9be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba40ae7d0 0x7f2ba4168ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43752/0 (socket says 172.21.15.5:43752) 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.466+0000 7f2b9be00640 1 -- 172.21.15.5:0/1713951101 learned_addr learned my addr 172.21.15.5:0/1713951101 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.466+0000 7f2ba9000640 1 --2- 172.21.15.5:0/1713951101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba4156900 0x7f2ba41693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.466+0000 7f2ba3e00640 1 --2- 172.21.15.5:0/1713951101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba40ae180 0x7f2ba4154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.467+0000 7f2b9be00640 1 -- 172.21.15.5:0/1713951101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba4156900 msgr2=0x7f2ba41693e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.467+0000 7f2b9be00640 1 --2- 172.21.15.5:0/1713951101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba4156900 0x7f2ba41693e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.467+0000 7f2b9be00640 1 -- 172.21.15.5:0/1713951101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba40ae180 msgr2=0x7f2ba4154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.467+0000 7f2b9be00640 1 --2- 172.21.15.5:0/1713951101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba40ae180 0x7f2ba4154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.467+0000 7f2b9be00640 1 -- 172.21.15.5:0/1713951101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c009ae0 con 0x7f2ba40ae7d0 2024-08-17T02:47:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.467+0000 7f2ba9000640 1 --2- 172.21.15.5:0/1713951101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba4156900 0x7f2ba41693e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.467+0000 7f2b9be00640 1 --2- 172.21.15.5:0/1713951101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba40ae7d0 0x7f2ba4168ea0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00c560 tx=0x7f2b8c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.467+0000 7f2b9b400640 1 -- 172.21.15.5:0/1713951101 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c011590 con 0x7f2ba40ae7d0 2024-08-17T02:47:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.467+0000 7f2b9b400640 1 -- 172.21.15.5:0/1713951101 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c011710 con 0x7f2ba40ae7d0 2024-08-17T02:47:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.467+0000 7f2b9b400640 1 -- 172.21.15.5:0/1713951101 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c011ad0 con 0x7f2ba40ae7d0 2024-08-17T02:47:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.467+0000 7f2ba9a00640 1 -- 172.21.15.5:0/1713951101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba40a9b90 con 0x7f2ba40ae7d0 2024-08-17T02:47:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.467+0000 7f2ba9a00640 1 -- 172.21.15.5:0/1713951101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba40aa150 con 0x7f2ba40ae7d0 2024-08-17T02:47:33.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.468+0000 7f2ba9a00640 1 -- 172.21.15.5:0/1713951101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba4070720 con 0x7f2ba40ae7d0 2024-08-17T02:47:33.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.469+0000 7f2b9b400640 1 -- 172.21.15.5:0/1713951101 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2b8c01b3b0 con 0x7f2ba40ae7d0 2024-08-17T02:47:33.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.470+0000 7f2b9b400640 1 --2- 172.21.15.5:0/1713951101 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2b80065180 0x7f2b80067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.470+0000 7f2b9b400640 1 -- 172.21.15.5:0/1713951101 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2b8c081980 con 0x7f2ba40ae7d0 2024-08-17T02:47:33.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.470+0000 7f2ba3e00640 1 --2- 172.21.15.5:0/1713951101 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2b80065180 0x7f2b80067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.471+0000 7f2ba3e00640 1 --2- 172.21.15.5:0/1713951101 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2b80065180 0x7f2b80067630 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009d20 tx=0x7f2b940090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:33.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.474+0000 7f2b9b400640 1 -- 172.21.15.5:0/1713951101 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2b8c04fa50 con 0x7f2ba40ae7d0 2024-08-17T02:47:33.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.654+0000 7f2ba9a00640 1 -- 172.21.15.5:0/1713951101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ba40ad3c0 con 0x7f2ba40ae7d0 2024-08-17T02:47:33.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.654+0000 7f2b9b400640 1 -- 172.21.15.5:0/1713951101 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2b8c017070 con 0x7f2ba40ae7d0 2024-08-17T02:47:33.656 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:47:33.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.656+0000 7f2ba9a00640 1 -- 172.21.15.5:0/1713951101 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2b80065180 msgr2=0x7f2b80067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.656+0000 7f2ba9a00640 1 --2- 172.21.15.5:0/1713951101 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2b80065180 0x7f2b80067630 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009d20 tx=0x7f2b940090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.656+0000 7f2ba9a00640 1 -- 172.21.15.5:0/1713951101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba40ae7d0 msgr2=0x7f2ba4168ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.656+0000 7f2ba9a00640 1 --2- 172.21.15.5:0/1713951101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba40ae7d0 0x7f2ba4168ea0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00c560 tx=0x7f2b8c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.656+0000 7f2ba9a00640 1 -- 172.21.15.5:0/1713951101 shutdown_connections 2024-08-17T02:47:33.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.657+0000 7f2ba9a00640 1 --2- 172.21.15.5:0/1713951101 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2b80065180 0x7f2b80067630 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.657+0000 7f2ba9a00640 1 --2- 172.21.15.5:0/1713951101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ba4156900 0x7f2ba41693e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.657+0000 7f2ba9a00640 1 --2- 172.21.15.5:0/1713951101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba40ae7d0 0x7f2ba4168ea0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.657+0000 7f2ba9a00640 1 --2- 172.21.15.5:0/1713951101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ba40ae180 0x7f2ba4154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.657+0000 7f2ba9a00640 1 -- 172.21.15.5:0/1713951101 >> 172.21.15.5:0/1713951101 conn(0x7f2ba4067930 msgr2=0x7f2ba406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.657+0000 7f2ba9a00640 1 -- 172.21.15.5:0/1713951101 shutdown_connections 2024-08-17T02:47:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.657+0000 7f2ba9a00640 1 -- 172.21.15.5:0/1713951101 wait complete. 2024-08-17T02:47:33.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:47:33.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.823+0000 7ff842600640 1 Processor -- start 2024-08-17T02:47:33.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.823+0000 7ff842600640 1 -- start start 2024-08-17T02:47:33.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.824+0000 7ff842600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff83c0ad960 0x7ff83c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.824+0000 7ff842600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff83c0add30 0x7ff83c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.824+0000 7ff842600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83c15b5e0 con 0x7ff83c0ca050 2024-08-17T02:47:33.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.825+0000 7ff842600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff83c0cb160 con 0x7ff83c0ad960 2024-08-17T02:47:33.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.825+0000 7ff842600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c0b0d10 con 0x7ff83c0add30 2024-08-17T02:47:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.825+0000 7ff83be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff83c0add30 0x7ff83c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.825+0000 7ff83be00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff83c0add30 0x7ff83c156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:50824/0 (socket says 172.21.15.5:50824) 2024-08-17T02:47:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.825+0000 7ff83be00640 1 -- 172.21.15.5:0/1379839914 learned_addr learned my addr 172.21.15.5:0/1379839914 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.825+0000 7ff833e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff83c0ca050 0x7ff83c156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:38504/0 (socket says 172.21.15.5:38504) 2024-08-17T02:47:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.825+0000 7ff83b400640 1 --2- 172.21.15.5:0/1379839914 >> v2:172.21.15.107:3300/0 conn(0x7ff83c0ad960 0x7ff83c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.825+0000 7ff83be00640 1 -- 172.21.15.5:0/1379839914 >> v2:172.21.15.107:3300/0 conn(0x7ff83c0ad960 msgr2=0x7ff83c15b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.826+0000 7ff83be00640 1 --2- 172.21.15.5:0/1379839914 >> v2:172.21.15.107:3300/0 conn(0x7ff83c0ad960 0x7ff83c15b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.826+0000 7ff83be00640 1 -- 172.21.15.5:0/1379839914 >> v1:172.21.15.107:6789/0 conn(0x7ff83c0ca050 legacy=0x7ff83c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.825+0000 7ff83aa00640 1 -- 172.21.15.5:0/1379839914 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965343862 0 0) 0x7ff824001110 con 0x7ff83c0ca050 2024-08-17T02:47:33.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.826+0000 7ff83be00640 1 -- 172.21.15.5:0/1379839914 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c0ca550 con 0x7ff83c0add30 2024-08-17T02:47:33.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.827+0000 7ff83be00640 1 --2- 172.21.15.5:0/1379839914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff83c0add30 0x7ff83c156b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff834009f20 tx=0x7ff834009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea8b1b3b7b29146b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:33.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.827+0000 7ff83aa00640 1 -- 172.21.15.5:0/1379839914 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834032450 con 0x7ff83c0add30 2024-08-17T02:47:33.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.827+0000 7ff83aa00640 1 -- 172.21.15.5:0/1379839914 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8340325b0 con 0x7ff83c0add30 2024-08-17T02:47:33.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.827+0000 7ff83aa00640 1 -- 172.21.15.5:0/1379839914 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834032950 con 0x7ff83c0add30 2024-08-17T02:47:33.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.827+0000 7ff842600640 1 -- 172.21.15.5:0/1379839914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff83c0add30 msgr2=0x7ff83c156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.827+0000 7ff842600640 1 --2- 172.21.15.5:0/1379839914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff83c0add30 0x7ff83c156b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff834009f20 tx=0x7ff834009840 comp rx=0 tx=0).stop 2024-08-17T02:47:33.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.827+0000 7ff842600640 1 -- 172.21.15.5:0/1379839914 shutdown_connections 2024-08-17T02:47:33.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.828+0000 7ff842600640 1 --2- 172.21.15.5:0/1379839914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff83c0add30 0x7ff83c156b30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.828+0000 7ff842600640 1 --2- 172.21.15.5:0/1379839914 >> v2:172.21.15.107:3300/0 conn(0x7ff83c0ad960 0x7ff83c15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.828+0000 7ff842600640 1 -- 172.21.15.5:0/1379839914 >> 172.21.15.5:0/1379839914 conn(0x7ff83c066e60 msgr2=0x7ff83c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:33.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.828+0000 7ff842600640 1 -- 172.21.15.5:0/1379839914 shutdown_connections 2024-08-17T02:47:33.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.828+0000 7ff842600640 1 -- 172.21.15.5:0/1379839914 wait complete. 2024-08-17T02:47:33.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.829+0000 7ff842600640 1 Processor -- start 2024-08-17T02:47:33.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.829+0000 7ff842600640 1 -- start start 2024-08-17T02:47:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.830+0000 7ff842600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff83c0ad960 0x7ff83c157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.830+0000 7ff842600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff83c0add30 0x7ff83c0acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.830+0000 7ff842600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff83c0ca050 0x7ff83c147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.830+0000 7ff842600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c0ad4b0 con 0x7ff83c0ca050 2024-08-17T02:47:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.830+0000 7ff842600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c159670 con 0x7ff83c0ad960 2024-08-17T02:47:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.830+0000 7ff842600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c1585d0 con 0x7ff83c0add30 2024-08-17T02:47:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.830+0000 7ff83be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff83c0ca050 0x7ff83c147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.830+0000 7ff83be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff83c0ca050 0x7ff83c147f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43764/0 (socket says 172.21.15.5:43764) 2024-08-17T02:47:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.830+0000 7ff83be00640 1 -- 172.21.15.5:0/514287378 learned_addr learned my addr 172.21.15.5:0/514287378 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.830+0000 7ff833e00640 1 --2- 172.21.15.5:0/514287378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff83c0add30 0x7ff83c0acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.830+0000 7ff83b400640 1 --2- 172.21.15.5:0/514287378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff83c0ad960 0x7ff83c157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.831+0000 7ff83be00640 1 -- 172.21.15.5:0/514287378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff83c0add30 msgr2=0x7ff83c0acf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.831+0000 7ff83be00640 1 --2- 172.21.15.5:0/514287378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff83c0add30 0x7ff83c0acf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.831+0000 7ff83be00640 1 -- 172.21.15.5:0/514287378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff83c0ad960 msgr2=0x7ff83c157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.831+0000 7ff83be00640 1 --2- 172.21.15.5:0/514287378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff83c0ad960 0x7ff83c157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.831+0000 7ff83be00640 1 -- 172.21.15.5:0/514287378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff834009ae0 con 0x7ff83c0ca050 2024-08-17T02:47:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.831+0000 7ff833e00640 1 --2- 172.21.15.5:0/514287378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff83c0add30 0x7ff83c0acf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:33.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.831+0000 7ff83be00640 1 --2- 172.21.15.5:0/514287378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff83c0ca050 0x7ff83c147f50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff834009f20 tx=0x7ff834037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:33.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.831+0000 7ff832a00640 1 -- 172.21.15.5:0/514287378 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834032450 con 0x7ff83c0ca050 2024-08-17T02:47:33.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.831+0000 7ff832a00640 1 -- 172.21.15.5:0/514287378 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff834032930 con 0x7ff83c0ca050 2024-08-17T02:47:33.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.831+0000 7ff842600640 1 -- 172.21.15.5:0/514287378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83c1588b0 con 0x7ff83c0ca050 2024-08-17T02:47:33.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.831+0000 7ff832a00640 1 -- 172.21.15.5:0/514287378 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83403c660 con 0x7ff83c0ca050 2024-08-17T02:47:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.832+0000 7ff842600640 1 -- 172.21.15.5:0/514287378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83c158e70 con 0x7ff83c0ca050 2024-08-17T02:47:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.832+0000 7ff842600640 1 -- 172.21.15.5:0/514287378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83c063fb0 con 0x7ff83c0ca050 2024-08-17T02:47:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.833+0000 7ff832a00640 1 -- 172.21.15.5:0/514287378 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff834039050 con 0x7ff83c0ca050 2024-08-17T02:47:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.834+0000 7ff832a00640 1 --2- 172.21.15.5:0/514287378 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff818065150 0x7ff818067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.834+0000 7ff832a00640 1 -- 172.21.15.5:0/514287378 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff83402e050 con 0x7ff83c0ca050 2024-08-17T02:47:33.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.834+0000 7ff83b400640 1 --2- 172.21.15.5:0/514287378 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff818065150 0x7ff818067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:33.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.835+0000 7ff83b400640 1 --2- 172.21.15.5:0/514287378 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff818065150 0x7ff818067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009d20 tx=0x7ff82c0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:33.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:33.838+0000 7ff832a00640 1 -- 172.21.15.5:0/514287378 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff834070e90 con 0x7ff83c0ca050 2024-08-17T02:47:34.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.085+0000 7ff842600640 1 -- 172.21.15.5:0/514287378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7ff83c154cc0 con 0x7ff83c0ca050 2024-08-17T02:47:34.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.307+0000 7ff832a00640 1 -- 172.21.15.5:0/514287378 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v56) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff83403d030 con 0x7ff83c0ca050 2024-08-17T02:47:34.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.309+0000 7ff842600640 1 -- 172.21.15.5:0/514287378 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff818065150 msgr2=0x7ff818067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.309+0000 7ff842600640 1 --2- 172.21.15.5:0/514287378 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff818065150 0x7ff818067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009d20 tx=0x7ff82c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.309+0000 7ff842600640 1 -- 172.21.15.5:0/514287378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff83c0ca050 msgr2=0x7ff83c147f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.309+0000 7ff842600640 1 --2- 172.21.15.5:0/514287378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff83c0ca050 0x7ff83c147f50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff834009f20 tx=0x7ff834037000 comp rx=0 tx=0).stop 2024-08-17T02:47:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.309+0000 7ff842600640 1 -- 172.21.15.5:0/514287378 shutdown_connections 2024-08-17T02:47:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.309+0000 7ff842600640 1 --2- 172.21.15.5:0/514287378 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff818065150 0x7ff818067600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.309+0000 7ff842600640 1 --2- 172.21.15.5:0/514287378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff83c0ca050 0x7ff83c147f50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.309+0000 7ff842600640 1 --2- 172.21.15.5:0/514287378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff83c0add30 0x7ff83c0acf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.309+0000 7ff842600640 1 --2- 172.21.15.5:0/514287378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff83c0ad960 0x7ff83c157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.309+0000 7ff842600640 1 -- 172.21.15.5:0/514287378 >> 172.21.15.5:0/514287378 conn(0x7ff83c066e60 msgr2=0x7ff83c1534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.309+0000 7ff842600640 1 -- 172.21.15.5:0/514287378 shutdown_connections 2024-08-17T02:47:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.309+0000 7ff842600640 1 -- 172.21.15.5:0/514287378 wait complete. 2024-08-17T02:47:34.326 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:47:34.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.479+0000 7eff74400640 1 Processor -- start 2024-08-17T02:47:34.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.479+0000 7eff74400640 1 -- start start 2024-08-17T02:47:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.480+0000 7eff74400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff6c158b90 0x7eff6c0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.480+0000 7eff74400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7eff6c0b2370 0x7eff6c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.480+0000 7eff74400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6c0af380 con 0x7eff6c0aef60 2024-08-17T02:47:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.480+0000 7eff74400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c0afd20 con 0x7eff6c0b2370 2024-08-17T02:47:34.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.480+0000 7eff74400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c0affe0 con 0x7eff6c158b90 2024-08-17T02:47:34.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.481+0000 7eff71a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff6c158b90 0x7eff6c0b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.481+0000 7eff71a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff6c158b90 0x7eff6c0b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:50850/0 (socket says 172.21.15.5:50850) 2024-08-17T02:47:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.481+0000 7eff71a00640 1 -- 172.21.15.5:0/17786066 learned_addr learned my addr 172.21.15.5:0/17786066 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.481+0000 7eff71000640 1 --2- 172.21.15.5:0/17786066 >> v2:172.21.15.107:3300/0 conn(0x7eff6c0b2370 0x7eff6c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.481+0000 7eff71a00640 1 -- 172.21.15.5:0/17786066 >> v2:172.21.15.107:3300/0 conn(0x7eff6c0b2370 msgr2=0x7eff6c0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.481+0000 7eff71a00640 1 --2- 172.21.15.5:0/17786066 >> v2:172.21.15.107:3300/0 conn(0x7eff6c0b2370 0x7eff6c0aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.481+0000 7eff71a00640 1 -- 172.21.15.5:0/17786066 >> v1:172.21.15.107:6789/0 conn(0x7eff6c0aef60 legacy=0x7eff6c068630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.481+0000 7eff6be00640 1 -- 172.21.15.5:0/17786066 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955951828 0 0) 0x7eff6c0af380 con 0x7eff6c0aef60 2024-08-17T02:47:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.481+0000 7eff71a00640 1 -- 172.21.15.5:0/17786066 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c0b02c0 con 0x7eff6c158b90 2024-08-17T02:47:34.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.482+0000 7eff71a00640 1 --2- 172.21.15.5:0/17786066 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff6c158b90 0x7eff6c0b1e30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7eff60009910 tx=0x7eff600091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae3c98f55fcc9761 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:34.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.482+0000 7eff6be00640 1 -- 172.21.15.5:0/17786066 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6002ae40 con 0x7eff6c158b90 2024-08-17T02:47:34.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.482+0000 7eff6be00640 1 -- 172.21.15.5:0/17786066 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff60032440 con 0x7eff6c158b90 2024-08-17T02:47:34.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.482+0000 7eff6be00640 1 -- 172.21.15.5:0/17786066 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600327e0 con 0x7eff6c158b90 2024-08-17T02:47:34.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.483+0000 7eff74400640 1 -- 172.21.15.5:0/17786066 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff6c158b90 msgr2=0x7eff6c0b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.483+0000 7eff74400640 1 --2- 172.21.15.5:0/17786066 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff6c158b90 0x7eff6c0b1e30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7eff60009910 tx=0x7eff600091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.483+0000 7eff74400640 1 -- 172.21.15.5:0/17786066 shutdown_connections 2024-08-17T02:47:34.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.483+0000 7eff74400640 1 --2- 172.21.15.5:0/17786066 >> v2:172.21.15.107:3300/0 conn(0x7eff6c0b2370 0x7eff6c0aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.483+0000 7eff74400640 1 --2- 172.21.15.5:0/17786066 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff6c158b90 0x7eff6c0b1e30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.483+0000 7eff74400640 1 -- 172.21.15.5:0/17786066 >> 172.21.15.5:0/17786066 conn(0x7eff6c06e590 msgr2=0x7eff6c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:34.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.483+0000 7eff74400640 1 -- 172.21.15.5:0/17786066 shutdown_connections 2024-08-17T02:47:34.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.483+0000 7eff74400640 1 -- 172.21.15.5:0/17786066 wait complete. 2024-08-17T02:47:34.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.484+0000 7eff74400640 1 Processor -- start 2024-08-17T02:47:34.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.485+0000 7eff74400640 1 -- start start 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.485+0000 7eff74400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff6c0aef60 0x7eff6c144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.485+0000 7eff74400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff6c0b2370 0x7eff6c0ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.485+0000 7eff74400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff6c158b90 0x7eff6c0c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.486+0000 7eff74400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c159d10 con 0x7eff6c0b2370 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.486+0000 7eff74400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c145120 con 0x7eff6c158b90 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.486+0000 7eff74400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c159100 con 0x7eff6c0aef60 2024-08-17T02:47:34.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.486+0000 7eff71000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff6c0b2370 0x7eff6c0ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.486+0000 7eff71000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff6c0b2370 0x7eff6c0ae790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43772/0 (socket says 172.21.15.5:43772) 2024-08-17T02:47:34.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.486+0000 7eff71000640 1 -- 172.21.15.5:0/2227703995 learned_addr learned my addr 172.21.15.5:0/2227703995 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:34.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.486+0000 7eff71a00640 1 --2- 172.21.15.5:0/2227703995 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff6c0aef60 0x7eff6c144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.486+0000 7eff72400640 1 --2- 172.21.15.5:0/2227703995 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff6c158b90 0x7eff6c0c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.486+0000 7eff71000640 1 -- 172.21.15.5:0/2227703995 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff6c0aef60 msgr2=0x7eff6c144be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.486+0000 7eff71000640 1 --2- 172.21.15.5:0/2227703995 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff6c0aef60 0x7eff6c144be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.486+0000 7eff71000640 1 -- 172.21.15.5:0/2227703995 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff6c158b90 msgr2=0x7eff6c0c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.486+0000 7eff71000640 1 --2- 172.21.15.5:0/2227703995 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff6c158b90 0x7eff6c0c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.486+0000 7eff71000640 1 -- 172.21.15.5:0/2227703995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff60009450 con 0x7eff6c0b2370 2024-08-17T02:47:34.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.487+0000 7eff71000640 1 --2- 172.21.15.5:0/2227703995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff6c0b2370 0x7eff6c0ae790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7eff5800ea20 tx=0x7eff580090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:34.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.487+0000 7eff68c00640 1 -- 172.21.15.5:0/2227703995 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5800ca10 con 0x7eff6c0b2370 2024-08-17T02:47:34.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.487+0000 7eff68c00640 1 -- 172.21.15.5:0/2227703995 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5800cb70 con 0x7eff6c0b2370 2024-08-17T02:47:34.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.487+0000 7eff68c00640 1 -- 172.21.15.5:0/2227703995 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58013470 con 0x7eff6c0b2370 2024-08-17T02:47:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.487+0000 7eff74400640 1 -- 172.21.15.5:0/2227703995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6c1593e0 con 0x7eff6c0b2370 2024-08-17T02:47:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.487+0000 7eff74400640 1 -- 172.21.15.5:0/2227703995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6c1599a0 con 0x7eff6c0b2370 2024-08-17T02:47:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.488+0000 7eff74400640 1 -- 172.21.15.5:0/2227703995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6c159ec0 con 0x7eff6c0b2370 2024-08-17T02:47:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.489+0000 7eff68c00640 1 -- 172.21.15.5:0/2227703995 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7eff58013860 con 0x7eff6c0b2370 2024-08-17T02:47:34.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.489+0000 7eff68c00640 1 --2- 172.21.15.5:0/2227703995 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7eff4c065150 0x7eff4c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:34.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.490+0000 7eff68c00640 1 -- 172.21.15.5:0/2227703995 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff58082940 con 0x7eff6c0b2370 2024-08-17T02:47:34.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.490+0000 7eff71a00640 1 --2- 172.21.15.5:0/2227703995 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7eff4c065150 0x7eff4c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:34.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.490+0000 7eff71a00640 1 --2- 172.21.15.5:0/2227703995 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7eff4c065150 0x7eff4c067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7eff60034000 tx=0x7eff60032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:34.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.494+0000 7eff68c00640 1 -- 172.21.15.5:0/2227703995 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7eff6c159ec0 con 0x7eff6c0b2370 2024-08-17T02:47:34.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.676+0000 7eff74400640 1 -- 172.21.15.5:0/2227703995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7eff6c063fb0 con 0x7eff6c0b2370 2024-08-17T02:47:34.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.680+0000 7eff68c00640 1 -- 172.21.15.5:0/2227703995 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7eff58050a20 con 0x7eff6c0b2370 2024-08-17T02:47:34.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.682+0000 7eff74400640 1 -- 172.21.15.5:0/2227703995 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7eff4c065150 msgr2=0x7eff4c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.682+0000 7eff74400640 1 --2- 172.21.15.5:0/2227703995 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7eff4c065150 0x7eff4c067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7eff60034000 tx=0x7eff60032000 comp rx=0 tx=0).stop 2024-08-17T02:47:34.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.682+0000 7eff74400640 1 -- 172.21.15.5:0/2227703995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff6c0b2370 msgr2=0x7eff6c0ae790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:34.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.682+0000 7eff74400640 1 --2- 172.21.15.5:0/2227703995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff6c0b2370 0x7eff6c0ae790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7eff5800ea20 tx=0x7eff580090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.682+0000 7eff74400640 1 -- 172.21.15.5:0/2227703995 shutdown_connections 2024-08-17T02:47:34.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.682+0000 7eff74400640 1 --2- 172.21.15.5:0/2227703995 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7eff4c065150 0x7eff4c067600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.682+0000 7eff74400640 1 --2- 172.21.15.5:0/2227703995 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff6c158b90 0x7eff6c0c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.682+0000 7eff74400640 1 --2- 172.21.15.5:0/2227703995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff6c0b2370 0x7eff6c0ae790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.682+0000 7eff74400640 1 --2- 172.21.15.5:0/2227703995 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff6c0aef60 0x7eff6c144be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:34.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.682+0000 7eff74400640 1 -- 172.21.15.5:0/2227703995 >> 172.21.15.5:0/2227703995 conn(0x7eff6c06e590 msgr2=0x7eff6c0cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:34.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.683+0000 7eff74400640 1 -- 172.21.15.5:0/2227703995 shutdown_connections 2024-08-17T02:47:34.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:34.683+0000 7eff74400640 1 -- 172.21.15.5:0/2227703995 wait complete. 2024-08-17T02:47:34.699 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:47:34.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:47:34.798 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:47:34.905 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:47:34.905 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:47:34.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:47:34.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-17T02:47:34.966 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:47:34.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:34.967 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:47:35.008 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:47:35.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:47:35.008 DEBUG:teuthology.orchestra.run.smithi107:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-08-17T02:47:35.074 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:47:35.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:35.074 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:47:35.124 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-08-17T02:47:35.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:47:35.124 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-08-17T02:47:35.184 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:47:35.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:35.184 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:47:35.220 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-08-17T02:47:35.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:47:35.220 DEBUG:teuthology.orchestra.run.smithi107:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-08-17T02:47:35.280 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:47:35.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:35.280 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:47:35.317 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:47:35.318 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.468+0000 7f36d1800640 1 Processor -- start 2024-08-17T02:47:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.468+0000 7f36d1800640 1 -- start start 2024-08-17T02:47:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.469+0000 7f36d1800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36cc159dd0 0x7f36cc15a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.469+0000 7f36d1800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36cc0cc5a0 0x7f36cc0cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.469+0000 7f36d1800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36cc0ce830 con 0x7f36cc153070 2024-08-17T02:47:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.469+0000 7f36d1800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36cc0cdca0 con 0x7f36cc159dd0 2024-08-17T02:47:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.469+0000 7f36d1800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc0cdf40 con 0x7f36cc0cc5a0 2024-08-17T02:47:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.469+0000 7f36c3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36cc159dd0 0x7f36cc15a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.469+0000 7f36c3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36cc159dd0 0x7f36cc15a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43784/0 (socket says 172.21.15.5:43784) 2024-08-17T02:47:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.469+0000 7f36c3400640 1 -- 172.21.15.5:0/1375805038 learned_addr learned my addr 172.21.15.5:0/1375805038 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:35.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.469+0000 7f36d0e00640 1 --2- 172.21.15.5:0/1375805038 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36cc0cc5a0 0x7f36cc0cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.470+0000 7f36c3400640 1 -- 172.21.15.5:0/1375805038 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36cc0cc5a0 msgr2=0x7f36cc0cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:35.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.470+0000 7f36c3400640 1 --2- 172.21.15.5:0/1375805038 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36cc0cc5a0 0x7f36cc0cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.470+0000 7f36c3400640 1 -- 172.21.15.5:0/1375805038 >> v1:172.21.15.5:6789/0 conn(0x7f36cc153070 legacy=0x7f36cc0cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.470+0000 7f36c3400640 1 -- 172.21.15.5:0/1375805038 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36cc0ccf60 con 0x7f36cc159dd0 2024-08-17T02:47:35.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.471+0000 7f36c3400640 1 --2- 172.21.15.5:0/1375805038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36cc159dd0 0x7f36cc15a2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009910 tx=0x7f36b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72b9e5e44a9f27d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:35.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.471+0000 7f36cb400640 1 -- 172.21.15.5:0/1375805038 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b402add0 con 0x7f36cc159dd0 2024-08-17T02:47:35.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.471+0000 7f36cb400640 1 -- 172.21.15.5:0/1375805038 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b4032440 con 0x7f36cc159dd0 2024-08-17T02:47:35.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.471+0000 7f36cb400640 1 -- 172.21.15.5:0/1375805038 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4032820 con 0x7f36cc159dd0 2024-08-17T02:47:35.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.472+0000 7f36d1800640 1 -- 172.21.15.5:0/1375805038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36cc159dd0 msgr2=0x7f36cc15a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.472+0000 7f36d1800640 1 --2- 172.21.15.5:0/1375805038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36cc159dd0 0x7f36cc15a2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009910 tx=0x7f36b40091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.472+0000 7f36d1800640 1 -- 172.21.15.5:0/1375805038 shutdown_connections 2024-08-17T02:47:35.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.472+0000 7f36d1800640 1 --2- 172.21.15.5:0/1375805038 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36cc0cc5a0 0x7f36cc0cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.472+0000 7f36d1800640 1 --2- 172.21.15.5:0/1375805038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36cc159dd0 0x7f36cc15a2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.472+0000 7f36d1800640 1 -- 172.21.15.5:0/1375805038 >> 172.21.15.5:0/1375805038 conn(0x7f36cc087a80 msgr2=0x7f36cc06e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:35.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.472+0000 7f36d1800640 1 -- 172.21.15.5:0/1375805038 shutdown_connections 2024-08-17T02:47:35.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.472+0000 7f36d1800640 1 -- 172.21.15.5:0/1375805038 wait complete. 2024-08-17T02:47:35.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.473+0000 7f36d1800640 1 Processor -- start 2024-08-17T02:47:35.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.473+0000 7f36d1800640 1 -- start start 2024-08-17T02:47:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.474+0000 7f36d1800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36cc0cc5a0 0x7f36cc15e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.474+0000 7f36d1800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36cc153070 0x7f36cc153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.474+0000 7f36d1800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36cc159dd0 0x7f36cc1525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.474+0000 7f36d1800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc1551e0 con 0x7f36cc159dd0 2024-08-17T02:47:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.474+0000 7f36d1800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc168aa0 con 0x7f36cc0cc5a0 2024-08-17T02:47:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.474+0000 7f36d1800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc154390 con 0x7f36cc153070 2024-08-17T02:47:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.474+0000 7f36d0e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36cc159dd0 0x7f36cc1525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.474+0000 7f36d0e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36cc159dd0 0x7f36cc1525c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43788/0 (socket says 172.21.15.5:43788) 2024-08-17T02:47:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.474+0000 7f36d0e00640 1 -- 172.21.15.5:0/558205330 learned_addr learned my addr 172.21.15.5:0/558205330 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.474+0000 7f36c3400640 1 --2- 172.21.15.5:0/558205330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36cc153070 0x7f36cc153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.475+0000 7f36cbe00640 1 --2- 172.21.15.5:0/558205330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36cc0cc5a0 0x7f36cc15e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.475+0000 7f36d0e00640 1 -- 172.21.15.5:0/558205330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36cc153070 msgr2=0x7f36cc153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.475+0000 7f36d0e00640 1 --2- 172.21.15.5:0/558205330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36cc153070 0x7f36cc153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.475+0000 7f36d0e00640 1 -- 172.21.15.5:0/558205330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36cc0cc5a0 msgr2=0x7f36cc15e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.475+0000 7f36d0e00640 1 --2- 172.21.15.5:0/558205330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36cc0cc5a0 0x7f36cc15e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.475+0000 7f36d0e00640 1 -- 172.21.15.5:0/558205330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b4009450 con 0x7f36cc159dd0 2024-08-17T02:47:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.475+0000 7f36d0e00640 1 --2- 172.21.15.5:0/558205330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36cc159dd0 0x7f36cc1525c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009e90 tx=0x7f36c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.475+0000 7f36c3e00640 1 -- 172.21.15.5:0/558205330 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c400cdb0 con 0x7f36cc159dd0 2024-08-17T02:47:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.475+0000 7f36c3e00640 1 -- 172.21.15.5:0/558205330 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c400f040 con 0x7f36cc159dd0 2024-08-17T02:47:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.475+0000 7f36c3e00640 1 -- 172.21.15.5:0/558205330 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c40146d0 con 0x7f36cc159dd0 2024-08-17T02:47:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.475+0000 7f36d1800640 1 -- 172.21.15.5:0/558205330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36cc154660 con 0x7f36cc159dd0 2024-08-17T02:47:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.476+0000 7f36d1800640 1 -- 172.21.15.5:0/558205330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36cc154c20 con 0x7f36cc159dd0 2024-08-17T02:47:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.476+0000 7f36d1800640 1 -- 172.21.15.5:0/558205330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36cc168c40 con 0x7f36cc159dd0 2024-08-17T02:47:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.477+0000 7f36c3e00640 1 -- 172.21.15.5:0/558205330 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f36c4014a80 con 0x7f36cc159dd0 2024-08-17T02:47:35.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.478+0000 7f36c3e00640 1 --2- 172.21.15.5:0/558205330 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f36a8065150 0x7f36a8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.478+0000 7f36c3e00640 1 -- 172.21.15.5:0/558205330 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f36c4083260 con 0x7f36cc159dd0 2024-08-17T02:47:35.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.478+0000 7f36cbe00640 1 --2- 172.21.15.5:0/558205330 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f36a8065150 0x7f36a8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.479+0000 7f36cbe00640 1 --2- 172.21.15.5:0/558205330 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f36a8065150 0x7f36a8067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f36bc007fd0 tx=0x7f36bc007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:35.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.482+0000 7f36c3e00640 1 -- 172.21.15.5:0/558205330 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f36c4051330 con 0x7f36cc159dd0 2024-08-17T02:47:35.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.704+0000 7f36d1800640 1 -- 172.21.15.5:0/558205330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36cc070720 con 0x7f36cc159dd0 2024-08-17T02:47:35.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.704+0000 7f36c3e00640 1 -- 172.21.15.5:0/558205330 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f36c4054950 con 0x7f36cc159dd0 2024-08-17T02:47:35.706 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:35.706 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/3624354828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3624354828},{"type":"v1","addr":"172.21.15.5:6836","nonce":3624354828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2614098803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2614098803},{"type":"v1","addr":"172.21.15.107:6835","nonce":2614098803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1090239725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1090239725},{"type":"v1","addr":"172.21.15.5:6837","nonce":1090239725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:57.590268+0000","modified":"2024-08-17T02:47:01.184380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6834/2631760450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2631760450},{"type":"v1","addr":"172.21.15.107:6834","nonce":2631760450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:47:35.706 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-08-17T02:47:35.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.706+0000 7f36d1800640 1 -- 172.21.15.5:0/558205330 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f36a8065150 msgr2=0x7f36a8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.706+0000 7f36d1800640 1 --2- 172.21.15.5:0/558205330 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f36a8065150 0x7f36a8067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f36bc007fd0 tx=0x7f36bc007e30 comp rx=0 tx=0).stop 2024-08-17T02:47:35.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.706+0000 7f36d1800640 1 -- 172.21.15.5:0/558205330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36cc159dd0 msgr2=0x7f36cc1525c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.706+0000 7f36d1800640 1 --2- 172.21.15.5:0/558205330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36cc159dd0 0x7f36cc1525c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009e90 tx=0x7f36c400b040 comp rx=0 tx=0).stop 2024-08-17T02:47:35.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.706+0000 7f36d1800640 1 -- 172.21.15.5:0/558205330 shutdown_connections 2024-08-17T02:47:35.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.706+0000 7f36d1800640 1 --2- 172.21.15.5:0/558205330 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f36a8065150 0x7f36a8067600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.706+0000 7f36d1800640 1 --2- 172.21.15.5:0/558205330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36cc159dd0 0x7f36cc1525c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.706+0000 7f36d1800640 1 --2- 172.21.15.5:0/558205330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36cc153070 0x7f36cc153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.706+0000 7f36d1800640 1 --2- 172.21.15.5:0/558205330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36cc0cc5a0 0x7f36cc15e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.707+0000 7f36d1800640 1 -- 172.21.15.5:0/558205330 >> 172.21.15.5:0/558205330 conn(0x7f36cc087a80 msgr2=0x7f36cc0c4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:35.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.707+0000 7f36d1800640 1 -- 172.21.15.5:0/558205330 shutdown_connections 2024-08-17T02:47:35.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.707+0000 7f36d1800640 1 -- 172.21.15.5:0/558205330 wait complete. 2024-08-17T02:47:35.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.872+0000 7f9173200640 1 Processor -- start 2024-08-17T02:47:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.872+0000 7f9173200640 1 -- start start 2024-08-17T02:47:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.874+0000 7f9173200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91740b0e30 0x7f91740b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.874+0000 7f9173200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9174156f90 0x7f91740cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.874+0000 7f9173200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917406d7c0 con 0x7f917415a590 2024-08-17T02:47:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.874+0000 7f9173200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91740cb5b0 con 0x7f91740b0e30 2024-08-17T02:47:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.874+0000 7f9173200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917415ab30 con 0x7f9174156f90 2024-08-17T02:47:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.874+0000 7f9171e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91740b0e30 0x7f91740b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.874+0000 7f9171e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91740b0e30 0x7f91740b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40028/0 (socket says 172.21.15.5:40028) 2024-08-17T02:47:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.874+0000 7f9171e00640 1 -- 172.21.15.5:0/3390316368 learned_addr learned my addr 172.21.15.5:0/3390316368 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.874+0000 7f9172800640 1 --1- 172.21.15.5:0/3390316368 >> v1:172.21.15.5:6789/0 conn(0x7f917415a590 0x7f917413fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56114/0 (socket says 172.21.15.5:56114) 2024-08-17T02:47:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.874+0000 7f916be00640 1 --2- 172.21.15.5:0/3390316368 >> v2:172.21.15.107:3300/0 conn(0x7f9174156f90 0x7f91740cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.875+0000 7f9171e00640 1 -- 172.21.15.5:0/3390316368 >> v2:172.21.15.107:3300/0 conn(0x7f9174156f90 msgr2=0x7f91740cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:35.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.875+0000 7f9171e00640 1 --2- 172.21.15.5:0/3390316368 >> v2:172.21.15.107:3300/0 conn(0x7f9174156f90 0x7f91740cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.875+0000 7f9171e00640 1 -- 172.21.15.5:0/3390316368 >> v1:172.21.15.5:6789/0 conn(0x7f917415a590 legacy=0x7f917413fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.875+0000 7f9171e00640 1 -- 172.21.15.5:0/3390316368 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917415ae10 con 0x7f91740b0e30 2024-08-17T02:47:35.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.875+0000 7f9171400640 1 -- 172.21.15.5:0/3390316368 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221152410 0 0) 0x7f917406d7c0 con 0x7f917415a590 2024-08-17T02:47:35.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.876+0000 7f9171e00640 1 --2- 172.21.15.5:0/3390316368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91740b0e30 0x7f91740b1200 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f91740c8180 tx=0x7f91640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f63ef227676173 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:35.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.876+0000 7f9171400640 1 -- 172.21.15.5:0/3390316368 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916402ae80 con 0x7f91740b0e30 2024-08-17T02:47:35.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.876+0000 7f9171400640 1 -- 172.21.15.5:0/3390316368 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9164032440 con 0x7f91740b0e30 2024-08-17T02:47:35.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.876+0000 7f9171400640 1 -- 172.21.15.5:0/3390316368 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640327c0 con 0x7f91740b0e30 2024-08-17T02:47:35.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.876+0000 7f9173200640 1 -- 172.21.15.5:0/3390316368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91740b0e30 msgr2=0x7f91740b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.876+0000 7f9173200640 1 --2- 172.21.15.5:0/3390316368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91740b0e30 0x7f91740b1200 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f91740c8180 tx=0x7f91640091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.876+0000 7f9173200640 1 -- 172.21.15.5:0/3390316368 shutdown_connections 2024-08-17T02:47:35.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.876+0000 7f9173200640 1 --2- 172.21.15.5:0/3390316368 >> v2:172.21.15.107:3300/0 conn(0x7f9174156f90 0x7f91740cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.876+0000 7f9173200640 1 --2- 172.21.15.5:0/3390316368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91740b0e30 0x7f91740b1200 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.876+0000 7f9173200640 1 -- 172.21.15.5:0/3390316368 >> 172.21.15.5:0/3390316368 conn(0x7f9174062af0 msgr2=0x7f9174062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:35.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.877+0000 7f9173200640 1 -- 172.21.15.5:0/3390316368 shutdown_connections 2024-08-17T02:47:35.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.877+0000 7f9173200640 1 -- 172.21.15.5:0/3390316368 wait complete. 2024-08-17T02:47:35.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.878+0000 7f9173200640 1 Processor -- start 2024-08-17T02:47:35.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.878+0000 7f9173200640 1 -- start start 2024-08-17T02:47:35.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.879+0000 7f9173200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91740b0e30 0x7f9174151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.879+0000 7f9173200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9174156f90 0x7f917414e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.879+0000 7f9173200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f917415a590 0x7f917413dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.879+0000 7f9173200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91741516d0 con 0x7f917415a590 2024-08-17T02:47:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.879+0000 7f9173200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917413c6c0 con 0x7f91740b0e30 2024-08-17T02:47:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.879+0000 7f9173200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917414e9e0 con 0x7f9174156f90 2024-08-17T02:47:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.879+0000 7f9172800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f917415a590 0x7f917413dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.879+0000 7f9172800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f917415a590 0x7f917413dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40036/0 (socket says 172.21.15.5:40036) 2024-08-17T02:47:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.879+0000 7f9172800640 1 -- 172.21.15.5:0/1209706639 learned_addr learned my addr 172.21.15.5:0/1209706639 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.879+0000 7f9171e00640 1 --2- 172.21.15.5:0/1209706639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91740b0e30 0x7f9174151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.879+0000 7f916be00640 1 --2- 172.21.15.5:0/1209706639 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9174156f90 0x7f917414e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.880+0000 7f9172800640 1 -- 172.21.15.5:0/1209706639 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9174156f90 msgr2=0x7f917414e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.880+0000 7f9172800640 1 --2- 172.21.15.5:0/1209706639 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9174156f90 0x7f917414e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.880+0000 7f9172800640 1 -- 172.21.15.5:0/1209706639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91740b0e30 msgr2=0x7f9174151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.880+0000 7f9172800640 1 --2- 172.21.15.5:0/1209706639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91740b0e30 0x7f9174151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.880+0000 7f9172800640 1 -- 172.21.15.5:0/1209706639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9164009450 con 0x7f917415a590 2024-08-17T02:47:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.880+0000 7f9171e00640 1 --2- 172.21.15.5:0/1209706639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91740b0e30 0x7f9174151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.880+0000 7f9172800640 1 --2- 172.21.15.5:0/1209706639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f917415a590 0x7f917413dba0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f916c00c960 tx=0x7f916c0016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.880+0000 7f9169600640 1 -- 172.21.15.5:0/1209706639 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c005d60 con 0x7f917415a590 2024-08-17T02:47:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.880+0000 7f9169600640 1 -- 172.21.15.5:0/1209706639 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c00a640 con 0x7f917415a590 2024-08-17T02:47:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.880+0000 7f9173200640 1 -- 172.21.15.5:0/1209706639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9174137260 con 0x7f917415a590 2024-08-17T02:47:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.880+0000 7f9169600640 1 -- 172.21.15.5:0/1209706639 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00aa00 con 0x7f917415a590 2024-08-17T02:47:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.880+0000 7f9173200640 1 -- 172.21.15.5:0/1209706639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9174137820 con 0x7f917415a590 2024-08-17T02:47:35.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.881+0000 7f9173200640 1 -- 172.21.15.5:0/1209706639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9174070720 con 0x7f917415a590 2024-08-17T02:47:35.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.882+0000 7f9169600640 1 -- 172.21.15.5:0/1209706639 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f916c0070f0 con 0x7f917415a590 2024-08-17T02:47:35.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.883+0000 7f9169600640 1 --2- 172.21.15.5:0/1209706639 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9150065150 0x7f9150067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:35.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.883+0000 7f9169600640 1 -- 172.21.15.5:0/1209706639 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f916c082300 con 0x7f917415a590 2024-08-17T02:47:35.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.883+0000 7f9171e00640 1 --2- 172.21.15.5:0/1209706639 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9150065150 0x7f9150067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:35.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.884+0000 7f9171e00640 1 --2- 172.21.15.5:0/1209706639 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9150065150 0x7f9150067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9164034000 tx=0x7f9164032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:35.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:35.887+0000 7f9169600640 1 -- 172.21.15.5:0/1209706639 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f916c0503a0 con 0x7f917415a590 2024-08-17T02:47:36.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.069+0000 7f9173200640 1 -- 172.21.15.5:0/1209706639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f917406a470 con 0x7f917415a590 2024-08-17T02:47:36.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.070+0000 7f9169600640 1 -- 172.21.15.5:0/1209706639 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f916c0539c0 con 0x7f917415a590 2024-08-17T02:47:36.071 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:36.071 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:59.170637+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:55.543347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:56.571235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.072+0000 7f9173200640 1 -- 172.21.15.5:0/1209706639 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9150065150 msgr2=0x7f9150067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.072+0000 7f9173200640 1 --2- 172.21.15.5:0/1209706639 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9150065150 0x7f9150067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9164034000 tx=0x7f9164032000 comp rx=0 tx=0).stop 2024-08-17T02:47:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.072+0000 7f9173200640 1 -- 172.21.15.5:0/1209706639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f917415a590 msgr2=0x7f917413dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.072+0000 7f9173200640 1 --2- 172.21.15.5:0/1209706639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f917415a590 0x7f917413dba0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f916c00c960 tx=0x7f916c0016c0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.072+0000 7f9173200640 1 -- 172.21.15.5:0/1209706639 shutdown_connections 2024-08-17T02:47:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.072+0000 7f9173200640 1 --2- 172.21.15.5:0/1209706639 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9150065150 0x7f9150067600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.072+0000 7f9173200640 1 --2- 172.21.15.5:0/1209706639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f917415a590 0x7f917413dba0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.072+0000 7f9173200640 1 --2- 172.21.15.5:0/1209706639 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9174156f90 0x7f917414e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.072+0000 7f9173200640 1 --2- 172.21.15.5:0/1209706639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91740b0e30 0x7f9174151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.072+0000 7f9173200640 1 -- 172.21.15.5:0/1209706639 >> 172.21.15.5:0/1209706639 conn(0x7f9174062af0 msgr2=0x7f91741552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.072+0000 7f9173200640 1 -- 172.21.15.5:0/1209706639 shutdown_connections 2024-08-17T02:47:36.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.072+0000 7f9173200640 1 -- 172.21.15.5:0/1209706639 wait complete. 2024-08-17T02:47:36.088 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:47.106425+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:55.543347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:56.571235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:47:36.088 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:36.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.241+0000 7ff94f200640 1 Processor -- start 2024-08-17T02:47:36.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.241+0000 7ff94f200640 1 -- start start 2024-08-17T02:47:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.242+0000 7ff94f200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff948156bd0 0x7ff9480b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.242+0000 7ff94f200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff948156fa0 0x7ff9480caef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.242+0000 7ff94f200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9480ac040 con 0x7ff9480adf90 2024-08-17T02:47:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.242+0000 7ff94f200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff948067810 con 0x7ff948156bd0 2024-08-17T02:47:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.242+0000 7ff94f200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9480ab150 con 0x7ff948156fa0 2024-08-17T02:47:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.243+0000 7ff947e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff948156bd0 0x7ff9480b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.243+0000 7ff947e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff948156bd0 0x7ff9480b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40040/0 (socket says 172.21.15.5:40040) 2024-08-17T02:47:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.243+0000 7ff947e00640 1 -- 172.21.15.5:0/3891960380 learned_addr learned my addr 172.21.15.5:0/3891960380 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.243+0000 7ff94d200640 1 --2- 172.21.15.5:0/3891960380 >> v2:172.21.15.107:3300/0 conn(0x7ff948156fa0 0x7ff9480caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.243+0000 7ff947e00640 1 -- 172.21.15.5:0/3891960380 >> v2:172.21.15.107:3300/0 conn(0x7ff948156fa0 msgr2=0x7ff9480caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.243+0000 7ff947e00640 1 --2- 172.21.15.5:0/3891960380 >> v2:172.21.15.107:3300/0 conn(0x7ff948156fa0 0x7ff9480caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.243+0000 7ff947e00640 1 -- 172.21.15.5:0/3891960380 >> v1:172.21.15.107:6789/0 conn(0x7ff9480adf90 legacy=0x7ff9480ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.243+0000 7ff947e00640 1 -- 172.21.15.5:0/3891960380 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9480ab430 con 0x7ff948156bd0 2024-08-17T02:47:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.244+0000 7ff947e00640 1 --2- 172.21.15.5:0/3891960380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948156bd0 0x7ff9480b0b70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff938009910 tx=0x7ff9380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61ca57c0cf9b5f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.244+0000 7ff947400640 1 -- 172.21.15.5:0/3891960380 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93802ae60 con 0x7ff948156bd0 2024-08-17T02:47:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.244+0000 7ff947400640 1 -- 172.21.15.5:0/3891960380 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff938032440 con 0x7ff948156bd0 2024-08-17T02:47:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.245+0000 7ff947400640 1 -- 172.21.15.5:0/3891960380 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9380327e0 con 0x7ff948156bd0 2024-08-17T02:47:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.245+0000 7ff94f200640 1 -- 172.21.15.5:0/3891960380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948156bd0 msgr2=0x7ff9480b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.245+0000 7ff94f200640 1 --2- 172.21.15.5:0/3891960380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948156bd0 0x7ff9480b0b70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff938009910 tx=0x7ff9380091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.245+0000 7ff94f200640 1 -- 172.21.15.5:0/3891960380 shutdown_connections 2024-08-17T02:47:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.245+0000 7ff94f200640 1 --2- 172.21.15.5:0/3891960380 >> v2:172.21.15.107:3300/0 conn(0x7ff948156fa0 0x7ff9480caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.245+0000 7ff94f200640 1 --2- 172.21.15.5:0/3891960380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948156bd0 0x7ff9480b0b70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.245+0000 7ff94f200640 1 -- 172.21.15.5:0/3891960380 >> 172.21.15.5:0/3891960380 conn(0x7ff9480cc390 msgr2=0x7ff948066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.245+0000 7ff94f200640 1 -- 172.21.15.5:0/3891960380 shutdown_connections 2024-08-17T02:47:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.245+0000 7ff94f200640 1 -- 172.21.15.5:0/3891960380 wait complete. 2024-08-17T02:47:36.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.247+0000 7ff94f200640 1 Processor -- start 2024-08-17T02:47:36.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.247+0000 7ff94f200640 1 -- start start 2024-08-17T02:47:36.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.248+0000 7ff94f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9480adf90 0x7ff9481488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.248+0000 7ff94f200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff948156bd0 0x7ff948157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.248+0000 7ff94f200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948156fa0 0x7ff94814f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.248+0000 7ff94f200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94814ebb0 con 0x7ff948156fa0 2024-08-17T02:47:36.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.248+0000 7ff94f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94814ee90 con 0x7ff9480adf90 2024-08-17T02:47:36.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.248+0000 7ff94f200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94814f170 con 0x7ff948156bd0 2024-08-17T02:47:36.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.248+0000 7ff94d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948156fa0 0x7ff94814f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.248+0000 7ff94d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948156fa0 0x7ff94814f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40042/0 (socket says 172.21.15.5:40042) 2024-08-17T02:47:36.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.248+0000 7ff94d200640 1 -- 172.21.15.5:0/1215742304 learned_addr learned my addr 172.21.15.5:0/1215742304 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:36.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.248+0000 7ff947e00640 1 --2- 172.21.15.5:0/1215742304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9480adf90 0x7ff9481488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.248+0000 7ff93fe00640 1 --2- 172.21.15.5:0/1215742304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff948156bd0 0x7ff948157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.248+0000 7ff94d200640 1 -- 172.21.15.5:0/1215742304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff948156bd0 msgr2=0x7ff948157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.248+0000 7ff94d200640 1 --2- 172.21.15.5:0/1215742304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff948156bd0 0x7ff948157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.248+0000 7ff94d200640 1 -- 172.21.15.5:0/1215742304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9480adf90 msgr2=0x7ff9481488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.248+0000 7ff94d200640 1 --2- 172.21.15.5:0/1215742304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9480adf90 0x7ff9481488d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.248+0000 7ff94d200640 1 -- 172.21.15.5:0/1215742304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff938009450 con 0x7ff948156fa0 2024-08-17T02:47:36.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.249+0000 7ff94d200640 1 --2- 172.21.15.5:0/1215742304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948156fa0 0x7ff94814f970 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff940009d70 tx=0x7ff94000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:36.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.249+0000 7ff93f400640 1 -- 172.21.15.5:0/1215742304 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000cd40 con 0x7ff948156fa0 2024-08-17T02:47:36.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.249+0000 7ff93f400640 1 -- 172.21.15.5:0/1215742304 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94000f040 con 0x7ff948156fa0 2024-08-17T02:47:36.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.249+0000 7ff93f400640 1 -- 172.21.15.5:0/1215742304 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000cea0 con 0x7ff948156fa0 2024-08-17T02:47:36.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.249+0000 7ff94f200640 1 -- 172.21.15.5:0/1215742304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94814f450 con 0x7ff948156fa0 2024-08-17T02:47:36.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.249+0000 7ff94f200640 1 -- 172.21.15.5:0/1215742304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94814e8c0 con 0x7ff948156fa0 2024-08-17T02:47:36.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.250+0000 7ff94f200640 1 -- 172.21.15.5:0/1215742304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94814f670 con 0x7ff948156fa0 2024-08-17T02:47:36.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.251+0000 7ff93f400640 1 -- 172.21.15.5:0/1215742304 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff940014920 con 0x7ff948156fa0 2024-08-17T02:47:36.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.252+0000 7ff93f400640 1 --2- 172.21.15.5:0/1215742304 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff924065150 0x7ff924067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.252+0000 7ff93f400640 1 -- 172.21.15.5:0/1215742304 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff940083080 con 0x7ff948156fa0 2024-08-17T02:47:36.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.252+0000 7ff947e00640 1 --2- 172.21.15.5:0/1215742304 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff924065150 0x7ff924067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.253+0000 7ff947e00640 1 --2- 172.21.15.5:0/1215742304 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff924065150 0x7ff924067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff938034000 tx=0x7ff938032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:36.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.256+0000 7ff93f400640 1 -- 172.21.15.5:0/1215742304 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff9400b4e40 con 0x7ff948156fa0 2024-08-17T02:47:36.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.438+0000 7ff94f200640 1 -- 172.21.15.5:0/1215742304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff94814ecf0 con 0x7ff948156fa0 2024-08-17T02:47:36.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.439+0000 7ff93f400640 1 -- 172.21.15.5:0/1215742304 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff940018020 con 0x7ff948156fa0 2024-08-17T02:47:36.440 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:47:36.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.441+0000 7ff94f200640 1 -- 172.21.15.5:0/1215742304 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff924065150 msgr2=0x7ff924067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.441+0000 7ff94f200640 1 --2- 172.21.15.5:0/1215742304 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff924065150 0x7ff924067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff938034000 tx=0x7ff938032000 comp rx=0 tx=0).stop 2024-08-17T02:47:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.441+0000 7ff94f200640 1 -- 172.21.15.5:0/1215742304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948156fa0 msgr2=0x7ff94814f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.441+0000 7ff94f200640 1 --2- 172.21.15.5:0/1215742304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948156fa0 0x7ff94814f970 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff940009d70 tx=0x7ff94000b040 comp rx=0 tx=0).stop 2024-08-17T02:47:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.441+0000 7ff94f200640 1 -- 172.21.15.5:0/1215742304 shutdown_connections 2024-08-17T02:47:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.441+0000 7ff94f200640 1 --2- 172.21.15.5:0/1215742304 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff924065150 0x7ff924067600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.441+0000 7ff94f200640 1 --2- 172.21.15.5:0/1215742304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948156fa0 0x7ff94814f970 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.441+0000 7ff94f200640 1 --2- 172.21.15.5:0/1215742304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff948156bd0 0x7ff948157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.441+0000 7ff94f200640 1 --2- 172.21.15.5:0/1215742304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9480adf90 0x7ff9481488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.441+0000 7ff94f200640 1 -- 172.21.15.5:0/1215742304 >> 172.21.15.5:0/1215742304 conn(0x7ff9480cc390 msgr2=0x7ff9481554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.441+0000 7ff94f200640 1 -- 172.21.15.5:0/1215742304 shutdown_connections 2024-08-17T02:47:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.441+0000 7ff94f200640 1 -- 172.21.15.5:0/1215742304 wait complete. 2024-08-17T02:47:36.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:47:36.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.610+0000 7f33cec00640 1 Processor -- start 2024-08-17T02:47:36.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.610+0000 7f33cec00640 1 -- start start 2024-08-17T02:47:36.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.611+0000 7f33cec00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33c80aea20 0x7f33c80aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.611+0000 7f33cec00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c80af3a0 con 0x7f33c8158b90 2024-08-17T02:47:36.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.611+0000 7f33cec00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c80afd20 con 0x7f33c80ca8e0 2024-08-17T02:47:36.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.611+0000 7f33cec00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c80affe0 con 0x7f33c80aea20 2024-08-17T02:47:36.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.612+0000 7f33c7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33c80aea20 0x7f33c80aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.612+0000 7f33c7e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f33c8158b90 0x7f33c80b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56122/0 (socket says 172.21.15.5:56122) 2024-08-17T02:47:36.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.612+0000 7f33c7e00640 1 -- 172.21.15.5:0/1943295485 learned_addr learned my addr 172.21.15.5:0/1943295485 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:36.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.612+0000 7f33c7400640 1 -- 172.21.15.5:0/1943295485 >> v1:172.21.15.107:6789/0 conn(0x7f33c80ca8e0 legacy=0x7f33c80cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.612+0000 7f33c7400640 1 -- 172.21.15.5:0/1943295485 >> v1:172.21.15.5:6789/0 conn(0x7f33c8158b90 legacy=0x7f33c80b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.612+0000 7f33c7400640 1 -- 172.21.15.5:0/1943295485 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c80b02c0 con 0x7f33c80aea20 2024-08-17T02:47:36.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.612+0000 7f33c6a00640 1 -- 172.21.15.5:0/1943295485 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136974968 0 0) 0x7f33c80af3a0 con 0x7f33c8158b90 2024-08-17T02:47:36.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.613+0000 7f33c7400640 1 --2- 172.21.15.5:0/1943295485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c80aea20 0x7f33c80aee60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009850 tx=0x7f33b40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7891ae6d66603812 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:36.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.613+0000 7f33c6a00640 1 -- 172.21.15.5:0/1943295485 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b402ae20 con 0x7f33c80aea20 2024-08-17T02:47:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.613+0000 7f33c6a00640 1 -- 172.21.15.5:0/1943295485 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b4032440 con 0x7f33c80aea20 2024-08-17T02:47:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.614+0000 7f33c6a00640 1 -- 172.21.15.5:0/1943295485 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b40327e0 con 0x7f33c80aea20 2024-08-17T02:47:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.614+0000 7f33cec00640 1 -- 172.21.15.5:0/1943295485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c80aea20 msgr2=0x7f33c80aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.614+0000 7f33cec00640 1 --2- 172.21.15.5:0/1943295485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c80aea20 0x7f33c80aee60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009850 tx=0x7f33b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.614+0000 7f33cec00640 1 -- 172.21.15.5:0/1943295485 shutdown_connections 2024-08-17T02:47:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.614+0000 7f33cec00640 1 --2- 172.21.15.5:0/1943295485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c80aea20 0x7f33c80aee60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.614+0000 7f33cec00640 1 -- 172.21.15.5:0/1943295485 >> 172.21.15.5:0/1943295485 conn(0x7f33c806e590 msgr2=0x7f33c806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.614+0000 7f33cec00640 1 -- 172.21.15.5:0/1943295485 shutdown_connections 2024-08-17T02:47:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.614+0000 7f33cec00640 1 -- 172.21.15.5:0/1943295485 wait complete. 2024-08-17T02:47:36.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.615+0000 7f33cec00640 1 Processor -- start 2024-08-17T02:47:36.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.616+0000 7f33cec00640 1 -- start start 2024-08-17T02:47:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.616+0000 7f33cec00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c80aea20 0x7f33c815ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.616+0000 7f33cec00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33c80ca8e0 0x7f33c80adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.616+0000 7f33cec00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33c8158b90 0x7f33c80c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.616+0000 7f33cec00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c816a820 con 0x7f33c80aea20 2024-08-17T02:47:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.616+0000 7f33cec00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c815b6a0 con 0x7f33c8158b90 2024-08-17T02:47:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.616+0000 7f33cec00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c816a1d0 con 0x7f33c80ca8e0 2024-08-17T02:47:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.617+0000 7f33c7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c80aea20 0x7f33c815ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.617+0000 7f33c7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c80aea20 0x7f33c815ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40056/0 (socket says 172.21.15.5:40056) 2024-08-17T02:47:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.617+0000 7f33c7e00640 1 -- 172.21.15.5:0/3892791972 learned_addr learned my addr 172.21.15.5:0/3892791972 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.617+0000 7f33c7400640 1 --2- 172.21.15.5:0/3892791972 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33c80ca8e0 0x7f33c80adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.617+0000 7f33ccc00640 1 --2- 172.21.15.5:0/3892791972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33c8158b90 0x7f33c80c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.617+0000 7f33c7e00640 1 -- 172.21.15.5:0/3892791972 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33c80ca8e0 msgr2=0x7f33c80adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.617+0000 7f33c7e00640 1 --2- 172.21.15.5:0/3892791972 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33c80ca8e0 0x7f33c80adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.617+0000 7f33c7e00640 1 -- 172.21.15.5:0/3892791972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33c8158b90 msgr2=0x7f33c80c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.617+0000 7f33c7e00640 1 --2- 172.21.15.5:0/3892791972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33c8158b90 0x7f33c80c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.617+0000 7f33c7e00640 1 -- 172.21.15.5:0/3892791972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b4009390 con 0x7f33c80aea20 2024-08-17T02:47:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.617+0000 7f33ccc00640 1 --2- 172.21.15.5:0/3892791972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33c8158b90 0x7f33c80c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.617+0000 7f33c7e00640 1 --2- 172.21.15.5:0/3892791972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c80aea20 0x7f33c815ae50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f33b800c5b0 tx=0x7f33b8007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:36.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.618+0000 7f33bf400640 1 -- 172.21.15.5:0/3892791972 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8005aa0 con 0x7f33c80aea20 2024-08-17T02:47:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.618+0000 7f33bf400640 1 -- 172.21.15.5:0/3892791972 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b8005c20 con 0x7f33c80aea20 2024-08-17T02:47:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.618+0000 7f33bf400640 1 -- 172.21.15.5:0/3892791972 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b80070f0 con 0x7f33c80aea20 2024-08-17T02:47:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.618+0000 7f33cec00640 1 -- 172.21.15.5:0/3892791972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c816a4b0 con 0x7f33c80aea20 2024-08-17T02:47:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.618+0000 7f33cec00640 1 -- 172.21.15.5:0/3892791972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c80ae050 con 0x7f33c80aea20 2024-08-17T02:47:36.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.619+0000 7f33cec00640 1 -- 172.21.15.5:0/3892791972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c816a030 con 0x7f33c80aea20 2024-08-17T02:47:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.620+0000 7f33bf400640 1 -- 172.21.15.5:0/3892791972 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f33b8007520 con 0x7f33c80aea20 2024-08-17T02:47:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.620+0000 7f33bf400640 1 --2- 172.21.15.5:0/3892791972 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f33a8065150 0x7f33a8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.621+0000 7f33bf400640 1 -- 172.21.15.5:0/3892791972 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f33b8081ee0 con 0x7f33c80aea20 2024-08-17T02:47:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.621+0000 7f33c7400640 1 --2- 172.21.15.5:0/3892791972 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f33a8065150 0x7f33a8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.621+0000 7f33c7400640 1 --2- 172.21.15.5:0/3892791972 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f33a8065150 0x7f33a8067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f33b4034000 tx=0x7f33b4032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:36.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.624+0000 7f33bf400640 1 -- 172.21.15.5:0/3892791972 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f33c816a030 con 0x7f33c80aea20 2024-08-17T02:47:36.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.804+0000 7f33cec00640 1 -- 172.21.15.5:0/3892791972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33c816a030 con 0x7f33c80aea20 2024-08-17T02:47:36.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.805+0000 7f33bf400640 1 -- 172.21.15.5:0/3892791972 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33c816a030 con 0x7f33c80aea20 2024-08-17T02:47:36.806 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:47:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.807+0000 7f33cec00640 1 -- 172.21.15.5:0/3892791972 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f33a8065150 msgr2=0x7f33a8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.807+0000 7f33cec00640 1 --2- 172.21.15.5:0/3892791972 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f33a8065150 0x7f33a8067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f33b4034000 tx=0x7f33b4032000 comp rx=0 tx=0).stop 2024-08-17T02:47:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.807+0000 7f33cec00640 1 -- 172.21.15.5:0/3892791972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c80aea20 msgr2=0x7f33c815ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.807+0000 7f33cec00640 1 --2- 172.21.15.5:0/3892791972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c80aea20 0x7f33c815ae50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f33b800c5b0 tx=0x7f33b8007d00 comp rx=0 tx=0).stop 2024-08-17T02:47:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.807+0000 7f33cec00640 1 -- 172.21.15.5:0/3892791972 shutdown_connections 2024-08-17T02:47:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.807+0000 7f33cec00640 1 --2- 172.21.15.5:0/3892791972 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f33a8065150 0x7f33a8067600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.807+0000 7f33cec00640 1 --2- 172.21.15.5:0/3892791972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33c8158b90 0x7f33c80c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.807+0000 7f33cec00640 1 --2- 172.21.15.5:0/3892791972 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33c80ca8e0 0x7f33c80adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.807+0000 7f33cec00640 1 --2- 172.21.15.5:0/3892791972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c80aea20 0x7f33c815ae50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.807+0000 7f33cec00640 1 -- 172.21.15.5:0/3892791972 >> 172.21.15.5:0/3892791972 conn(0x7f33c806e590 msgr2=0x7f33c80b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:36.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.807+0000 7f33cec00640 1 -- 172.21.15.5:0/3892791972 shutdown_connections 2024-08-17T02:47:36.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.807+0000 7f33cec00640 1 -- 172.21.15.5:0/3892791972 wait complete. 2024-08-17T02:47:36.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:47:36.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.976+0000 7f8580a00640 1 Processor -- start 2024-08-17T02:47:36.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.977+0000 7f8580a00640 1 -- start start 2024-08-17T02:47:36.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.978+0000 7f8580a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f857c158a40 0x7f857c0abe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.978+0000 7f8580a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857c0686f0 con 0x7f857c0af9b0 2024-08-17T02:47:36.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.978+0000 7f8580a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857c0b0270 con 0x7f857c0ac380 2024-08-17T02:47:36.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.978+0000 7f8580a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857c0ac800 con 0x7f857c158a40 2024-08-17T02:47:36.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.978+0000 7f857be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f857c0af9b0 0x7f857c068b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56126/0 (socket says 172.21.15.5:56126) 2024-08-17T02:47:36.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.978+0000 7f857be00640 1 -- 172.21.15.5:0/3773011804 learned_addr learned my addr 172.21.15.5:0/3773011804 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:36.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.978+0000 7f857b400640 1 --2- 172.21.15.5:0/3773011804 >> v2:172.21.15.107:3300/0 conn(0x7f857c158a40 0x7f857c0abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.979+0000 7f857aa00640 1 -- 172.21.15.5:0/3773011804 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560889607 0 0) 0x7f857c0686f0 con 0x7f857c0af9b0 2024-08-17T02:47:36.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.979+0000 7f857aa00640 1 -- 172.21.15.5:0/3773011804 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85600034e0 con 0x7f857c0af9b0 2024-08-17T02:47:36.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.979+0000 7f857aa00640 1 -- 172.21.15.5:0/3773011804 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341755451 0 0) 0x7f857c0b0270 con 0x7f857c0ac380 2024-08-17T02:47:36.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.979+0000 7f857aa00640 1 -- 172.21.15.5:0/3773011804 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f857c0686f0 con 0x7f857c0ac380 2024-08-17T02:47:36.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.979+0000 7f857b400640 1 -- 172.21.15.5:0/3773011804 >> v1:172.21.15.107:6789/0 conn(0x7f857c0ac380 legacy=0x7f857c0af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.979+0000 7f857b400640 1 -- 172.21.15.5:0/3773011804 >> v1:172.21.15.5:6789/0 conn(0x7f857c0af9b0 legacy=0x7f857c068b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.979+0000 7f857b400640 1 -- 172.21.15.5:0/3773011804 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c0aff90 con 0x7f857c158a40 2024-08-17T02:47:36.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.980+0000 7f857b400640 1 --2- 172.21.15.5:0/3773011804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c158a40 0x7f857c0abe40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f856c009850 tx=0x7f856c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=173a342a7f852d43 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:36.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.980+0000 7f857aa00640 1 -- 172.21.15.5:0/3773011804 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c02ad00 con 0x7f857c158a40 2024-08-17T02:47:36.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.980+0000 7f857aa00640 1 -- 172.21.15.5:0/3773011804 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c02ae60 con 0x7f857c158a40 2024-08-17T02:47:36.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.980+0000 7f857aa00640 1 -- 172.21.15.5:0/3773011804 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c032670 con 0x7f857c158a40 2024-08-17T02:47:36.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.981+0000 7f8580a00640 1 -- 172.21.15.5:0/3773011804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c158a40 msgr2=0x7f857c0abe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.981+0000 7f8580a00640 1 --2- 172.21.15.5:0/3773011804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c158a40 0x7f857c0abe40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f856c009850 tx=0x7f856c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.981+0000 7f8580a00640 1 -- 172.21.15.5:0/3773011804 shutdown_connections 2024-08-17T02:47:36.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.981+0000 7f8580a00640 1 --2- 172.21.15.5:0/3773011804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c158a40 0x7f857c0abe40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.981+0000 7f8580a00640 1 -- 172.21.15.5:0/3773011804 >> 172.21.15.5:0/3773011804 conn(0x7f857c0ce400 msgr2=0x7f857c095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:36.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.981+0000 7f8580a00640 1 -- 172.21.15.5:0/3773011804 shutdown_connections 2024-08-17T02:47:36.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.981+0000 7f8580a00640 1 -- 172.21.15.5:0/3773011804 wait complete. 2024-08-17T02:47:36.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.983+0000 7f8580a00640 1 Processor -- start 2024-08-17T02:47:36.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.983+0000 7f8580a00640 1 -- start start 2024-08-17T02:47:36.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.983+0000 7f8580a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c0ac380 0x7f857c14de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.984+0000 7f8580a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f857c0af9b0 0x7f857c1525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.984+0000 7f8580a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f857c158a40 0x7f857c154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.984+0000 7f8580a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0b30f0 con 0x7f857c0af9b0 2024-08-17T02:47:36.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.984+0000 7f8580a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c1545d0 con 0x7f857c0ac380 2024-08-17T02:47:36.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.984+0000 7f8580a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c14e360 con 0x7f857c158a40 2024-08-17T02:47:36.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.984+0000 7f8573e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f857c0af9b0 0x7f857c1525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.984+0000 7f8573e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f857c0af9b0 0x7f857c1525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40072/0 (socket says 172.21.15.5:40072) 2024-08-17T02:47:36.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.984+0000 7f8573e00640 1 -- 172.21.15.5:0/1160215820 learned_addr learned my addr 172.21.15.5:0/1160215820 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:36.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.984+0000 7f857b400640 1 --2- 172.21.15.5:0/1160215820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c0ac380 0x7f857c14de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.984+0000 7f857be00640 1 --2- 172.21.15.5:0/1160215820 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f857c158a40 0x7f857c154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.984+0000 7f8573e00640 1 -- 172.21.15.5:0/1160215820 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f857c158a40 msgr2=0x7f857c154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.984+0000 7f8573e00640 1 --2- 172.21.15.5:0/1160215820 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f857c158a40 0x7f857c154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.984+0000 7f8573e00640 1 -- 172.21.15.5:0/1160215820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c0ac380 msgr2=0x7f857c14de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.984+0000 7f8573e00640 1 --2- 172.21.15.5:0/1160215820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c0ac380 0x7f857c14de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.984+0000 7f8573e00640 1 -- 172.21.15.5:0/1160215820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c009390 con 0x7f857c0af9b0 2024-08-17T02:47:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.984+0000 7f857b400640 1 --2- 172.21.15.5:0/1160215820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c0ac380 0x7f857c14de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.985+0000 7f8573e00640 1 --2- 172.21.15.5:0/1160215820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f857c0af9b0 0x7f857c1525f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8564002ee0 tx=0x7f8564007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.985+0000 7f8572a00640 1 -- 172.21.15.5:0/1160215820 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564011590 con 0x7f857c0af9b0 2024-08-17T02:47:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.985+0000 7f8572a00640 1 -- 172.21.15.5:0/1160215820 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8564011710 con 0x7f857c0af9b0 2024-08-17T02:47:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.985+0000 7f8580a00640 1 -- 172.21.15.5:0/1160215820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857c152b30 con 0x7f857c0af9b0 2024-08-17T02:47:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.985+0000 7f8572a00640 1 -- 172.21.15.5:0/1160215820 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564011ad0 con 0x7f857c0af9b0 2024-08-17T02:47:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.985+0000 7f8580a00640 1 -- 172.21.15.5:0/1160215820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857c154260 con 0x7f857c0af9b0 2024-08-17T02:47:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.986+0000 7f8580a00640 1 -- 172.21.15.5:0/1160215820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857c154760 con 0x7f857c0af9b0 2024-08-17T02:47:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.987+0000 7f8572a00640 1 -- 172.21.15.5:0/1160215820 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f856401c460 con 0x7f857c0af9b0 2024-08-17T02:47:36.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.988+0000 7f8572a00640 1 --2- 172.21.15.5:0/1160215820 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8558065150 0x7f8558067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:36.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.988+0000 7f8572a00640 1 -- 172.21.15.5:0/1160215820 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8564082230 con 0x7f857c0af9b0 2024-08-17T02:47:36.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.988+0000 7f857b400640 1 --2- 172.21.15.5:0/1160215820 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8558065150 0x7f8558067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:36.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.989+0000 7f857b400640 1 --2- 172.21.15.5:0/1160215820 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8558065150 0x7f8558067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f856c034000 tx=0x7f856c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:36.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:36.992+0000 7f8572a00640 1 -- 172.21.15.5:0/1160215820 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8564050250 con 0x7f857c0af9b0 2024-08-17T02:47:37.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.174+0000 7f8580a00640 1 -- 172.21.15.5:0/1160215820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f857c070720 con 0x7f857c0af9b0 2024-08-17T02:47:37.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.174+0000 7f8572a00640 1 -- 172.21.15.5:0/1160215820 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8564053870 con 0x7f857c0af9b0 2024-08-17T02:47:37.176 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:47:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.177+0000 7f8580a00640 1 -- 172.21.15.5:0/1160215820 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8558065150 msgr2=0x7f8558067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.177+0000 7f8580a00640 1 --2- 172.21.15.5:0/1160215820 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8558065150 0x7f8558067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f856c034000 tx=0x7f856c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.177+0000 7f8580a00640 1 -- 172.21.15.5:0/1160215820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f857c0af9b0 msgr2=0x7f857c1525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.177+0000 7f8580a00640 1 --2- 172.21.15.5:0/1160215820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f857c0af9b0 0x7f857c1525f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8564002ee0 tx=0x7f8564007d30 comp rx=0 tx=0).stop 2024-08-17T02:47:37.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.177+0000 7f8580a00640 1 -- 172.21.15.5:0/1160215820 shutdown_connections 2024-08-17T02:47:37.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.177+0000 7f8580a00640 1 --2- 172.21.15.5:0/1160215820 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8558065150 0x7f8558067600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.177+0000 7f8580a00640 1 --2- 172.21.15.5:0/1160215820 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f857c158a40 0x7f857c154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.177+0000 7f8580a00640 1 --2- 172.21.15.5:0/1160215820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f857c0af9b0 0x7f857c1525f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.177+0000 7f8580a00640 1 --2- 172.21.15.5:0/1160215820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f857c0ac380 0x7f857c14de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.177+0000 7f8580a00640 1 -- 172.21.15.5:0/1160215820 >> 172.21.15.5:0/1160215820 conn(0x7f857c0ce400 msgr2=0x7f857c06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:37.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.177+0000 7f8580a00640 1 -- 172.21.15.5:0/1160215820 shutdown_connections 2024-08-17T02:47:37.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.177+0000 7f8580a00640 1 -- 172.21.15.5:0/1160215820 wait complete. 2024-08-17T02:47:37.195 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:37.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.347+0000 7faf16200640 1 Processor -- start 2024-08-17T02:47:37.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.348+0000 7faf16200640 1 -- start start 2024-08-17T02:47:37.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.349+0000 7faf16200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faf1015a490 0x7faf100ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:37.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.349+0000 7faf16200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1015b6b0 con 0x7faf100b1920 2024-08-17T02:47:37.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.349+0000 7faf16200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1015aac0 con 0x7faf10158c60 2024-08-17T02:47:37.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.349+0000 7faf16200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf100b0540 con 0x7faf1015a490 2024-08-17T02:47:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.349+0000 7faf15800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faf100b1920 0x7faf100b1d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56138/0 (socket says 172.21.15.5:56138) 2024-08-17T02:47:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.349+0000 7faf15800640 1 -- 172.21.15.5:0/4089416341 learned_addr learned my addr 172.21.15.5:0/4089416341 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.349+0000 7faf0fe00640 1 --2- 172.21.15.5:0/4089416341 >> v2:172.21.15.107:3300/0 conn(0x7faf1015a490 0x7faf100ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.350+0000 7faf0f400640 1 -- 172.21.15.5:0/4089416341 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638950365 0 0) 0x7faf1015b6b0 con 0x7faf100b1920 2024-08-17T02:47:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.350+0000 7faf0f400640 1 -- 172.21.15.5:0/4089416341 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef80034e0 con 0x7faf100b1920 2024-08-17T02:47:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.350+0000 7faf0fe00640 1 -- 172.21.15.5:0/4089416341 >> v1:172.21.15.107:6789/0 conn(0x7faf10158c60 legacy=0x7faf10159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.350+0000 7faf0fe00640 1 -- 172.21.15.5:0/4089416341 >> v1:172.21.15.5:6789/0 conn(0x7faf100b1920 legacy=0x7faf100b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.350+0000 7faf0fe00640 1 -- 172.21.15.5:0/4089416341 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1015ad80 con 0x7faf1015a490 2024-08-17T02:47:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.351+0000 7faf0fe00640 1 --2- 172.21.15.5:0/4089416341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf1015a490 0x7faf100ca8b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faefc009850 tx=0x7faefc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90f0090fba07ed31 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.351+0000 7faf0f400640 1 -- 172.21.15.5:0/4089416341 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc02ad90 con 0x7faf1015a490 2024-08-17T02:47:37.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.351+0000 7faf0f400640 1 -- 172.21.15.5:0/4089416341 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc032440 con 0x7faf1015a490 2024-08-17T02:47:37.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.351+0000 7faf0f400640 1 -- 172.21.15.5:0/4089416341 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0327e0 con 0x7faf1015a490 2024-08-17T02:47:37.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.352+0000 7faf16200640 1 -- 172.21.15.5:0/4089416341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf1015a490 msgr2=0x7faf100ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.352+0000 7faf16200640 1 --2- 172.21.15.5:0/4089416341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf1015a490 0x7faf100ca8b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faefc009850 tx=0x7faefc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.352+0000 7faf16200640 1 -- 172.21.15.5:0/4089416341 shutdown_connections 2024-08-17T02:47:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.352+0000 7faf16200640 1 --2- 172.21.15.5:0/4089416341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf1015a490 0x7faf100ca8b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.352+0000 7faf16200640 1 -- 172.21.15.5:0/4089416341 >> 172.21.15.5:0/4089416341 conn(0x7faf1006e590 msgr2=0x7faf1006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.352+0000 7faf16200640 1 -- 172.21.15.5:0/4089416341 shutdown_connections 2024-08-17T02:47:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.352+0000 7faf16200640 1 -- 172.21.15.5:0/4089416341 wait complete. 2024-08-17T02:47:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.353+0000 7faf16200640 1 Processor -- start 2024-08-17T02:47:37.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.354+0000 7faf16200640 1 -- start start 2024-08-17T02:47:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.354+0000 7faf16200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf100b1920 0x7faf1016bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.354+0000 7faf16200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf10158c60 0x7faf100a6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.354+0000 7faf16200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf1015a490 0x7faf100a6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.354+0000 7faf16200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf100c49e0 con 0x7faf10158c60 2024-08-17T02:47:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.354+0000 7faf16200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf10157850 con 0x7faf100b1920 2024-08-17T02:47:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.354+0000 7faf16200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf100c9140 con 0x7faf1015a490 2024-08-17T02:47:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.355+0000 7faf0fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf10158c60 0x7faf100a6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.355+0000 7faf0fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf10158c60 0x7faf100a6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40088/0 (socket says 172.21.15.5:40088) 2024-08-17T02:47:37.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.355+0000 7faf0fe00640 1 -- 172.21.15.5:0/1378043723 learned_addr learned my addr 172.21.15.5:0/1378043723 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:37.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.355+0000 7faf14e00640 1 --2- 172.21.15.5:0/1378043723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf100b1920 0x7faf1016bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:37.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.355+0000 7faf15800640 1 --2- 172.21.15.5:0/1378043723 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf1015a490 0x7faf100a6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:37.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.355+0000 7faf0fe00640 1 -- 172.21.15.5:0/1378043723 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf1015a490 msgr2=0x7faf100a6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.355+0000 7faf0fe00640 1 --2- 172.21.15.5:0/1378043723 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf1015a490 0x7faf100a6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.355+0000 7faf0fe00640 1 -- 172.21.15.5:0/1378043723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf100b1920 msgr2=0x7faf1016bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.355+0000 7faf0fe00640 1 --2- 172.21.15.5:0/1378043723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf100b1920 0x7faf1016bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.355+0000 7faf0fe00640 1 -- 172.21.15.5:0/1378043723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc009390 con 0x7faf10158c60 2024-08-17T02:47:37.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.356+0000 7faf0fe00640 1 --2- 172.21.15.5:0/1378043723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf10158c60 0x7faf100a6600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faefc009360 tx=0x7faefc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:37.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.356+0000 7faf03e00640 1 -- 172.21.15.5:0/1378043723 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc000d10 con 0x7faf10158c60 2024-08-17T02:47:37.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.356+0000 7faf03e00640 1 -- 172.21.15.5:0/1378043723 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc031e00 con 0x7faf10158c60 2024-08-17T02:47:37.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.356+0000 7faf16200640 1 -- 172.21.15.5:0/1378043723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf100c9420 con 0x7faf10158c60 2024-08-17T02:47:37.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.356+0000 7faf03e00640 1 -- 172.21.15.5:0/1378043723 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc03d670 con 0x7faf10158c60 2024-08-17T02:47:37.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.356+0000 7faf16200640 1 -- 172.21.15.5:0/1378043723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf100c4670 con 0x7faf10158c60 2024-08-17T02:47:37.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.357+0000 7faf16200640 1 -- 172.21.15.5:0/1378043723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf10070720 con 0x7faf10158c60 2024-08-17T02:47:37.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.359+0000 7faf03e00640 1 -- 172.21.15.5:0/1378043723 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faefc039040 con 0x7faf10158c60 2024-08-17T02:47:37.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.360+0000 7faf03e00640 1 --2- 172.21.15.5:0/1378043723 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faef0065150 0x7faef0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:37.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.360+0000 7faf03e00640 1 -- 172.21.15.5:0/1378043723 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faefc0a2710 con 0x7faf10158c60 2024-08-17T02:47:37.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.360+0000 7faf14e00640 1 --2- 172.21.15.5:0/1378043723 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faef0065150 0x7faef0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:37.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.361+0000 7faf14e00640 1 --2- 172.21.15.5:0/1378043723 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faef0065150 0x7faef0067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faf10064170 tx=0x7faf04009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:37.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.364+0000 7faf03e00640 1 -- 172.21.15.5:0/1378043723 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faefc0707e0 con 0x7faf10158c60 2024-08-17T02:47:37.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.588+0000 7faf16200640 1 -- 172.21.15.5:0/1378043723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf100c4b20 con 0x7faf10158c60 2024-08-17T02:47:37.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.589+0000 7faf03e00640 1 -- 172.21.15.5:0/1378043723 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4591 (secure 0 0 0) 0x7faefc073e00 con 0x7faf10158c60 2024-08-17T02:47:37.590 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:37.590 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/3624354828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3624354828},{"type":"v1","addr":"172.21.15.5:6836","nonce":3624354828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2614098803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2614098803},{"type":"v1","addr":"172.21.15.107:6835","nonce":2614098803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1090239725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1090239725},{"type":"v1","addr":"172.21.15.5:6837","nonce":1090239725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:57.590268+0000","modified":"2024-08-17T02:47:01.184380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6834/2631760450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2631760450},{"type":"v1","addr":"172.21.15.107:6834","nonce":2631760450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:47:37.591 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-08-17T02:47:37.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.591+0000 7faf16200640 1 -- 172.21.15.5:0/1378043723 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faef0065150 msgr2=0x7faef0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.591+0000 7faf16200640 1 --2- 172.21.15.5:0/1378043723 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faef0065150 0x7faef0067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faf10064170 tx=0x7faf04009040 comp rx=0 tx=0).stop 2024-08-17T02:47:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.591+0000 7faf16200640 1 -- 172.21.15.5:0/1378043723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf10158c60 msgr2=0x7faf100a6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.591+0000 7faf16200640 1 --2- 172.21.15.5:0/1378043723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf10158c60 0x7faf100a6600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faefc009360 tx=0x7faefc032000 comp rx=0 tx=0).stop 2024-08-17T02:47:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.591+0000 7faf16200640 1 -- 172.21.15.5:0/1378043723 shutdown_connections 2024-08-17T02:47:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.591+0000 7faf16200640 1 --2- 172.21.15.5:0/1378043723 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faef0065150 0x7faef0067600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.591+0000 7faf16200640 1 --2- 172.21.15.5:0/1378043723 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf1015a490 0x7faf100a6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.591+0000 7faf16200640 1 --2- 172.21.15.5:0/1378043723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf10158c60 0x7faf100a6600 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.591+0000 7faf16200640 1 --2- 172.21.15.5:0/1378043723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf100b1920 0x7faf1016bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.591+0000 7faf16200640 1 -- 172.21.15.5:0/1378043723 >> 172.21.15.5:0/1378043723 conn(0x7faf1006e590 msgr2=0x7faf100cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.591+0000 7faf16200640 1 -- 172.21.15.5:0/1378043723 shutdown_connections 2024-08-17T02:47:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.591+0000 7faf16200640 1 -- 172.21.15.5:0/1378043723 wait complete. 2024-08-17T02:47:37.608 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.762+0000 7fa8b6a00640 1 Processor -- start 2024-08-17T02:47:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.762+0000 7fa8b6a00640 1 -- start start 2024-08-17T02:47:37.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.763+0000 7fa8b6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa8b00afca0 0x7fa8b00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:37.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.763+0000 7fa8b6a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa8b00acf10 0x7fa8b0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:37.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.763+0000 7fa8b6a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b015a4e0 con 0x7fa8b01589a0 2024-08-17T02:47:37.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.763+0000 7fa8b6a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b00b0980 con 0x7fa8b00afca0 2024-08-17T02:47:37.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.763+0000 7fa8b6a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b00c92b0 con 0x7fa8b00acf10 2024-08-17T02:47:37.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.764+0000 7fa8afe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa8b00afca0 0x7fa8b00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:37.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.764+0000 7fa8b4a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa8b01589a0 0x7fa8b0158de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56152/0 (socket says 172.21.15.5:56152) 2024-08-17T02:47:37.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.764+0000 7fa8b4a00640 1 -- 172.21.15.5:0/159751931 learned_addr learned my addr 172.21.15.5:0/159751931 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:37.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.764+0000 7fa8af400640 1 --2- 172.21.15.5:0/159751931 >> v2:172.21.15.107:3300/0 conn(0x7fa8b00acf10 0x7fa8b0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:37.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.764+0000 7fa8afe00640 1 -- 172.21.15.5:0/159751931 >> v2:172.21.15.107:3300/0 conn(0x7fa8b00acf10 msgr2=0x7fa8b0159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:37.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.764+0000 7fa8afe00640 1 --2- 172.21.15.5:0/159751931 >> v2:172.21.15.107:3300/0 conn(0x7fa8b00acf10 0x7fa8b0159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.764+0000 7fa8afe00640 1 -- 172.21.15.5:0/159751931 >> v1:172.21.15.5:6789/0 conn(0x7fa8b01589a0 legacy=0x7fa8b0158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.764+0000 7fa8afe00640 1 -- 172.21.15.5:0/159751931 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b00ad480 con 0x7fa8b00afca0 2024-08-17T02:47:37.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.764+0000 7fa8aea00640 1 -- 172.21.15.5:0/159751931 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409713250 0 0) 0x7fa8a8001490 con 0x7fa8b01589a0 2024-08-17T02:47:37.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.765+0000 7fa8afe00640 1 --2- 172.21.15.5:0/159751931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b00afca0 0x7fa8b00b0070 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00c83b0 tx=0x7fa8a00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b254514eb38713 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:37.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.766+0000 7fa8aea00640 1 -- 172.21.15.5:0/159751931 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a002adb0 con 0x7fa8b00afca0 2024-08-17T02:47:37.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.766+0000 7fa8aea00640 1 -- 172.21.15.5:0/159751931 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a0032440 con 0x7fa8b00afca0 2024-08-17T02:47:37.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.766+0000 7fa8aea00640 1 -- 172.21.15.5:0/159751931 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00327e0 con 0x7fa8b00afca0 2024-08-17T02:47:37.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.766+0000 7fa8b6a00640 1 -- 172.21.15.5:0/159751931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b00afca0 msgr2=0x7fa8b00b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.766+0000 7fa8b6a00640 1 --2- 172.21.15.5:0/159751931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b00afca0 0x7fa8b00b0070 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00c83b0 tx=0x7fa8a00090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.767+0000 7fa8b6a00640 1 -- 172.21.15.5:0/159751931 shutdown_connections 2024-08-17T02:47:37.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.767+0000 7fa8b6a00640 1 --2- 172.21.15.5:0/159751931 >> v2:172.21.15.107:3300/0 conn(0x7fa8b00acf10 0x7fa8b0159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.767+0000 7fa8b6a00640 1 --2- 172.21.15.5:0/159751931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b00afca0 0x7fa8b00b0070 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.767+0000 7fa8b6a00640 1 -- 172.21.15.5:0/159751931 >> 172.21.15.5:0/159751931 conn(0x7fa8b0066e60 msgr2=0x7fa8b0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:37.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.767+0000 7fa8b6a00640 1 -- 172.21.15.5:0/159751931 shutdown_connections 2024-08-17T02:47:37.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.767+0000 7fa8b6a00640 1 -- 172.21.15.5:0/159751931 wait complete. 2024-08-17T02:47:37.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.768+0000 7fa8b6a00640 1 Processor -- start 2024-08-17T02:47:37.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.768+0000 7fa8b6a00640 1 -- start start 2024-08-17T02:47:37.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.769+0000 7fa8b6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8b00acf10 0x7fa8b01579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:37.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.769+0000 7fa8b6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b00afca0 0x7fa8b0156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:37.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.769+0000 7fa8b6a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8b01589a0 0x7fa8b0154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:37.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.769+0000 7fa8b6a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b0157640 con 0x7fa8b00afca0 2024-08-17T02:47:37.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.769+0000 7fa8b6a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b0157410 con 0x7fa8b00acf10 2024-08-17T02:47:37.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.769+0000 7fa8b6a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00c12b0 con 0x7fa8b01589a0 2024-08-17T02:47:37.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.769+0000 7fa8af400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b00afca0 0x7fa8b0156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:37.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.769+0000 7fa8af400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b00afca0 0x7fa8b0156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40110/0 (socket says 172.21.15.5:40110) 2024-08-17T02:47:37.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.769+0000 7fa8af400640 1 -- 172.21.15.5:0/1682173490 learned_addr learned my addr 172.21.15.5:0/1682173490 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:37.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.770+0000 7fa8b4a00640 1 --2- 172.21.15.5:0/1682173490 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8b01589a0 0x7fa8b0154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:37.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.770+0000 7fa8afe00640 1 --2- 172.21.15.5:0/1682173490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8b00acf10 0x7fa8b01579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:37.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.770+0000 7fa8af400640 1 -- 172.21.15.5:0/1682173490 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8b01589a0 msgr2=0x7fa8b0154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.770+0000 7fa8af400640 1 --2- 172.21.15.5:0/1682173490 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8b01589a0 0x7fa8b0154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.770+0000 7fa8af400640 1 -- 172.21.15.5:0/1682173490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8b00acf10 msgr2=0x7fa8b01579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.770+0000 7fa8af400640 1 --2- 172.21.15.5:0/1682173490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8b00acf10 0x7fa8b01579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.770+0000 7fa8af400640 1 -- 172.21.15.5:0/1682173490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a0009390 con 0x7fa8b00afca0 2024-08-17T02:47:37.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.770+0000 7fa8af400640 1 --2- 172.21.15.5:0/1682173490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b00afca0 0x7fa8b0156ed0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00e900 tx=0x7fa89c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:37.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.771+0000 7fa8a7400640 1 -- 172.21.15.5:0/1682173490 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00c8e0 con 0x7fa8b00afca0 2024-08-17T02:47:37.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.771+0000 7fa8a7400640 1 -- 172.21.15.5:0/1682173490 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c00ca40 con 0x7fa8b00afca0 2024-08-17T02:47:37.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.771+0000 7fa8a7400640 1 -- 172.21.15.5:0/1682173490 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00cde0 con 0x7fa8b00afca0 2024-08-17T02:47:37.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.771+0000 7fa8b6a00640 1 -- 172.21.15.5:0/1682173490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b00c0980 con 0x7fa8b00afca0 2024-08-17T02:47:37.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.771+0000 7fa8b6a00640 1 -- 172.21.15.5:0/1682173490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b00c0f40 con 0x7fa8b00afca0 2024-08-17T02:47:37.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.772+0000 7fa8b6a00640 1 -- 172.21.15.5:0/1682173490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b0063fb0 con 0x7fa8b00afca0 2024-08-17T02:47:37.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.773+0000 7fa8a7400640 1 -- 172.21.15.5:0/1682173490 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa89c013680 con 0x7fa8b00afca0 2024-08-17T02:47:37.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.774+0000 7fa8a7400640 1 --2- 172.21.15.5:0/1682173490 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa890065150 0x7fa890067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:37.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.774+0000 7fa8a7400640 1 -- 172.21.15.5:0/1682173490 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa89c082600 con 0x7fa8b00afca0 2024-08-17T02:47:37.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.774+0000 7fa8afe00640 1 --2- 172.21.15.5:0/1682173490 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa890065150 0x7fa890067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:37.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.774+0000 7fa8afe00640 1 --2- 172.21.15.5:0/1682173490 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa890065150 0x7fa890067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0034000 tx=0x7fa8a0032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.780+0000 7fa8a7400640 1 -- 172.21.15.5:0/1682173490 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa89c050780 con 0x7fa8b00afca0 2024-08-17T02:47:37.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.965+0000 7fa8b6a00640 1 -- 172.21.15.5:0/1682173490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8b00c13f0 con 0x7fa8b00afca0 2024-08-17T02:47:37.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.966+0000 7fa8a7400640 1 -- 172.21.15.5:0/1682173490 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fa89c053da0 con 0x7fa8b00afca0 2024-08-17T02:47:37.967 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:37.967 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:59.170637+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:55.543347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:56.571235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:37.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.968+0000 7fa8b6a00640 1 -- 172.21.15.5:0/1682173490 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa890065150 msgr2=0x7fa890067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.968+0000 7fa8b6a00640 1 --2- 172.21.15.5:0/1682173490 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa890065150 0x7fa890067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0034000 tx=0x7fa8a0032000 comp rx=0 tx=0).stop 2024-08-17T02:47:37.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.968+0000 7fa8b6a00640 1 -- 172.21.15.5:0/1682173490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b00afca0 msgr2=0x7fa8b0156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:37.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.968+0000 7fa8b6a00640 1 --2- 172.21.15.5:0/1682173490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b00afca0 0x7fa8b0156ed0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00e900 tx=0x7fa89c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.968+0000 7fa8b6a00640 1 -- 172.21.15.5:0/1682173490 shutdown_connections 2024-08-17T02:47:37.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.968+0000 7fa8b6a00640 1 --2- 172.21.15.5:0/1682173490 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa890065150 0x7fa890067600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.968+0000 7fa8b6a00640 1 --2- 172.21.15.5:0/1682173490 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8b01589a0 0x7fa8b0154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.968+0000 7fa8b6a00640 1 --2- 172.21.15.5:0/1682173490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8b00afca0 0x7fa8b0156ed0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.968+0000 7fa8b6a00640 1 --2- 172.21.15.5:0/1682173490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8b00acf10 0x7fa8b01579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:37.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.968+0000 7fa8b6a00640 1 -- 172.21.15.5:0/1682173490 >> 172.21.15.5:0/1682173490 conn(0x7fa8b0066e60 msgr2=0x7fa8b01513c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:37.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.968+0000 7fa8b6a00640 1 -- 172.21.15.5:0/1682173490 shutdown_connections 2024-08-17T02:47:37.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:37.968+0000 7fa8b6a00640 1 -- 172.21.15.5:0/1682173490 wait complete. 2024-08-17T02:47:37.985 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:47:37.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.138+0000 7ff297400640 1 Processor -- start 2024-08-17T02:47:38.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.138+0000 7ff297400640 1 -- start start 2024-08-17T02:47:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.139+0000 7ff297400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff290155040 0x7ff290158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.139+0000 7ff297400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff2901591c0 0x7ff29006e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.139+0000 7ff297400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff29006e5a0 0x7ff2900ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.139+0000 7ff297400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff290159610 con 0x7ff2901591c0 2024-08-17T02:47:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.139+0000 7ff297400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2900aeeb0 con 0x7ff29006e5a0 2024-08-17T02:47:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.139+0000 7ff297400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29006e9e0 con 0x7ff290155040 2024-08-17T02:47:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.139+0000 7ff28fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff2901591c0 0x7ff29006e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.140+0000 7ff28fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff2901591c0 0x7ff29006e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40122/0 (socket says 172.21.15.5:40122) 2024-08-17T02:47:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.140+0000 7ff28fe00640 1 -- 172.21.15.5:0/2492416980 learned_addr learned my addr 172.21.15.5:0/2492416980 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:38.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.140+0000 7ff294a00640 1 --2- 172.21.15.5:0/2492416980 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff290155040 0x7ff290158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.140+0000 7ff295400640 1 --2- 172.21.15.5:0/2492416980 >> v2:172.21.15.107:3300/0 conn(0x7ff29006e5a0 0x7ff2900ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.140+0000 7ff28fe00640 1 -- 172.21.15.5:0/2492416980 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff290155040 msgr2=0x7ff290158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.140+0000 7ff28fe00640 1 --2- 172.21.15.5:0/2492416980 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff290155040 0x7ff290158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.140+0000 7ff28fe00640 1 -- 172.21.15.5:0/2492416980 >> v2:172.21.15.107:3300/0 conn(0x7ff29006e5a0 msgr2=0x7ff2900ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.140+0000 7ff28fe00640 1 --2- 172.21.15.5:0/2492416980 >> v2:172.21.15.107:3300/0 conn(0x7ff29006e5a0 0x7ff2900ab3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.140+0000 7ff28fe00640 1 -- 172.21.15.5:0/2492416980 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2900aadd0 con 0x7ff2901591c0 2024-08-17T02:47:38.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.142+0000 7ff28fe00640 1 --2- 172.21.15.5:0/2492416980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2901591c0 0x7ff29006e060 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff290067bb0 tx=0x7ff27c00b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c195658569ded2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:38.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.142+0000 7ff28f400640 1 -- 172.21.15.5:0/2492416980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c032590 con 0x7ff2901591c0 2024-08-17T02:47:38.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.142+0000 7ff28f400640 1 -- 172.21.15.5:0/2492416980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c0326f0 con 0x7ff2901591c0 2024-08-17T02:47:38.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.142+0000 7ff28f400640 1 -- 172.21.15.5:0/2492416980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c032ad0 con 0x7ff2901591c0 2024-08-17T02:47:38.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.143+0000 7ff297400640 1 -- 172.21.15.5:0/2492416980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2901591c0 msgr2=0x7ff29006e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.143+0000 7ff297400640 1 --2- 172.21.15.5:0/2492416980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2901591c0 0x7ff29006e060 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff290067bb0 tx=0x7ff27c00b460 comp rx=0 tx=0).stop 2024-08-17T02:47:38.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.143+0000 7ff297400640 1 -- 172.21.15.5:0/2492416980 shutdown_connections 2024-08-17T02:47:38.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.143+0000 7ff297400640 1 --2- 172.21.15.5:0/2492416980 >> v2:172.21.15.107:3300/0 conn(0x7ff29006e5a0 0x7ff2900ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.143+0000 7ff297400640 1 --2- 172.21.15.5:0/2492416980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2901591c0 0x7ff29006e060 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.143+0000 7ff297400640 1 --2- 172.21.15.5:0/2492416980 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff290155040 0x7ff290158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.143+0000 7ff297400640 1 -- 172.21.15.5:0/2492416980 >> 172.21.15.5:0/2492416980 conn(0x7ff290066e60 msgr2=0x7ff290067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:38.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.143+0000 7ff297400640 1 -- 172.21.15.5:0/2492416980 shutdown_connections 2024-08-17T02:47:38.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.143+0000 7ff297400640 1 -- 172.21.15.5:0/2492416980 wait complete. 2024-08-17T02:47:38.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.144+0000 7ff297400640 1 Processor -- start 2024-08-17T02:47:38.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.144+0000 7ff297400640 1 -- start start 2024-08-17T02:47:38.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.145+0000 7ff297400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff29006e5a0 0x7ff290151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.145+0000 7ff297400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff290155040 0x7ff2901697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.145+0000 7ff297400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2901591c0 0x7ff2900a9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.145+0000 7ff297400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2901510f0 con 0x7ff29006e5a0 2024-08-17T02:47:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.145+0000 7ff297400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff290152ce0 con 0x7ff290155040 2024-08-17T02:47:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.145+0000 7ff297400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff290150ae0 con 0x7ff2901591c0 2024-08-17T02:47:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.146+0000 7ff294a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff29006e5a0 0x7ff290151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.146+0000 7ff294a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff29006e5a0 0x7ff290151580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40130/0 (socket says 172.21.15.5:40130) 2024-08-17T02:47:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.146+0000 7ff294a00640 1 -- 172.21.15.5:0/3567439504 learned_addr learned my addr 172.21.15.5:0/3567439504 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.146+0000 7ff295400640 1 --2- 172.21.15.5:0/3567439504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2901591c0 0x7ff2900a9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.146+0000 7ff28fe00640 1 --2- 172.21.15.5:0/3567439504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff290155040 0x7ff2901697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.146+0000 7ff294a00640 1 -- 172.21.15.5:0/3567439504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2901591c0 msgr2=0x7ff2900a9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.146+0000 7ff294a00640 1 --2- 172.21.15.5:0/3567439504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2901591c0 0x7ff2900a9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.146+0000 7ff294a00640 1 -- 172.21.15.5:0/3567439504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff290155040 msgr2=0x7ff2901697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.146+0000 7ff294a00640 1 --2- 172.21.15.5:0/3567439504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff290155040 0x7ff2901697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.146+0000 7ff294a00640 1 -- 172.21.15.5:0/3567439504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c00b700 con 0x7ff29006e5a0 2024-08-17T02:47:38.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.147+0000 7ff294a00640 1 --2- 172.21.15.5:0/3567439504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff29006e5a0 0x7ff290151580 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff28400ea20 tx=0x7ff2840090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:38.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.147+0000 7ff283e00640 1 -- 172.21.15.5:0/3567439504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28400ca10 con 0x7ff29006e5a0 2024-08-17T02:47:38.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.147+0000 7ff283e00640 1 -- 172.21.15.5:0/3567439504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28400cb70 con 0x7ff29006e5a0 2024-08-17T02:47:38.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.147+0000 7ff283e00640 1 -- 172.21.15.5:0/3567439504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284013470 con 0x7ff29006e5a0 2024-08-17T02:47:38.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.147+0000 7ff297400640 1 -- 172.21.15.5:0/3567439504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff290152a00 con 0x7ff29006e5a0 2024-08-17T02:47:38.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.147+0000 7ff297400640 1 -- 172.21.15.5:0/3567439504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2901538a0 con 0x7ff29006e5a0 2024-08-17T02:47:38.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.148+0000 7ff297400640 1 -- 172.21.15.5:0/3567439504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff290063fb0 con 0x7ff29006e5a0 2024-08-17T02:47:38.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.149+0000 7ff283e00640 1 -- 172.21.15.5:0/3567439504 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff284013860 con 0x7ff29006e5a0 2024-08-17T02:47:38.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.150+0000 7ff283e00640 1 --2- 172.21.15.5:0/3567439504 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff270065150 0x7ff270067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.150+0000 7ff283e00640 1 -- 172.21.15.5:0/3567439504 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff284082b40 con 0x7ff29006e5a0 2024-08-17T02:47:38.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.150+0000 7ff28fe00640 1 --2- 172.21.15.5:0/3567439504 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff270065150 0x7ff270067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.151+0000 7ff28fe00640 1 --2- 172.21.15.5:0/3567439504 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff270065150 0x7ff270067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff27c037000 tx=0x7ff27c03a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.154+0000 7ff283e00640 1 -- 172.21.15.5:0/3567439504 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff284050c10 con 0x7ff29006e5a0 2024-08-17T02:47:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.382+0000 7ff297400640 1 -- 172.21.15.5:0/3567439504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2900af2e0 con 0x7ff29006e5a0 2024-08-17T02:47:38.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.383+0000 7ff283e00640 1 -- 172.21.15.5:0/3567439504 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4591 (secure 0 0 0) 0x7ff284021090 con 0x7ff29006e5a0 2024-08-17T02:47:38.385 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:38.385 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/3624354828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3624354828},{"type":"v1","addr":"172.21.15.5:6836","nonce":3624354828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2614098803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2614098803},{"type":"v1","addr":"172.21.15.107:6835","nonce":2614098803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1090239725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1090239725},{"type":"v1","addr":"172.21.15.5:6837","nonce":1090239725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:57.590268+0000","modified":"2024-08-17T02:47:01.184380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6834/2631760450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2631760450},{"type":"v1","addr":"172.21.15.107:6834","nonce":2631760450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:47:38.385 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-08-17T02:47:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.385+0000 7ff297400640 1 -- 172.21.15.5:0/3567439504 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff270065150 msgr2=0x7ff270067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.385+0000 7ff297400640 1 --2- 172.21.15.5:0/3567439504 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff270065150 0x7ff270067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff27c037000 tx=0x7ff27c03a000 comp rx=0 tx=0).stop 2024-08-17T02:47:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.385+0000 7ff297400640 1 -- 172.21.15.5:0/3567439504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff29006e5a0 msgr2=0x7ff290151580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.385+0000 7ff297400640 1 --2- 172.21.15.5:0/3567439504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff29006e5a0 0x7ff290151580 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff28400ea20 tx=0x7ff2840090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.385+0000 7ff297400640 1 -- 172.21.15.5:0/3567439504 shutdown_connections 2024-08-17T02:47:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.385+0000 7ff297400640 1 --2- 172.21.15.5:0/3567439504 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff270065150 0x7ff270067600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.385+0000 7ff297400640 1 --2- 172.21.15.5:0/3567439504 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2901591c0 0x7ff2900a9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.385+0000 7ff297400640 1 --2- 172.21.15.5:0/3567439504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff290155040 0x7ff2901697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.385+0000 7ff297400640 1 --2- 172.21.15.5:0/3567439504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff29006e5a0 0x7ff290151580 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.385+0000 7ff297400640 1 -- 172.21.15.5:0/3567439504 >> 172.21.15.5:0/3567439504 conn(0x7ff290066e60 msgr2=0x7ff29006d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.385+0000 7ff297400640 1 -- 172.21.15.5:0/3567439504 shutdown_connections 2024-08-17T02:47:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.385+0000 7ff297400640 1 -- 172.21.15.5:0/3567439504 wait complete. 2024-08-17T02:47:38.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:38.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.552+0000 7f47d8800640 1 Processor -- start 2024-08-17T02:47:38.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.552+0000 7f47d8800640 1 -- start start 2024-08-17T02:47:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.553+0000 7f47d8800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47d00ad960 0x7f47d015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.553+0000 7f47d8800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47d00ca050 0x7f47d0156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.553+0000 7f47d8800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d015b5e0 con 0x7f47d00add30 2024-08-17T02:47:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.553+0000 7f47d8800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d00cb160 con 0x7f47d00ad960 2024-08-17T02:47:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.553+0000 7f47d8800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d00b0d10 con 0x7f47d00ca050 2024-08-17T02:47:38.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.553+0000 7f47d5e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47d00ad960 0x7f47d015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.554+0000 7f47d6800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f47d00add30 0x7f47d0156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56168/0 (socket says 172.21.15.5:56168) 2024-08-17T02:47:38.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.554+0000 7f47d6800640 1 -- 172.21.15.5:0/3415403034 learned_addr learned my addr 172.21.15.5:0/3415403034 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:38.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.554+0000 7f47d5400640 1 --2- 172.21.15.5:0/3415403034 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47d00ca050 0x7f47d0156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.554+0000 7f47d5e00640 1 -- 172.21.15.5:0/3415403034 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47d00ca050 msgr2=0x7f47d0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:38.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.554+0000 7f47d5e00640 1 --2- 172.21.15.5:0/3415403034 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47d00ca050 0x7f47d0156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.554+0000 7f47d5e00640 1 -- 172.21.15.5:0/3415403034 >> v1:172.21.15.5:6789/0 conn(0x7f47d00add30 legacy=0x7f47d0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.554+0000 7f47d4a00640 1 -- 172.21.15.5:0/3415403034 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776575883 0 0) 0x7f47cc001490 con 0x7f47d00add30 2024-08-17T02:47:38.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.554+0000 7f47d5e00640 1 -- 172.21.15.5:0/3415403034 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d00ca550 con 0x7f47d00ad960 2024-08-17T02:47:38.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.555+0000 7f47d5e00640 1 --2- 172.21.15.5:0/3415403034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47d00ad960 0x7f47d015b0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009850 tx=0x7f47c40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357b0667e9d7cc38 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:38.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.555+0000 7f47d4a00640 1 -- 172.21.15.5:0/3415403034 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c402ae10 con 0x7f47d00ad960 2024-08-17T02:47:38.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.556+0000 7f47d4a00640 1 -- 172.21.15.5:0/3415403034 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c4032440 con 0x7f47d00ad960 2024-08-17T02:47:38.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.556+0000 7f47d4a00640 1 -- 172.21.15.5:0/3415403034 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c40327e0 con 0x7f47d00ad960 2024-08-17T02:47:38.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.556+0000 7f47d8800640 1 -- 172.21.15.5:0/3415403034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47d00ad960 msgr2=0x7f47d015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.556+0000 7f47d8800640 1 --2- 172.21.15.5:0/3415403034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47d00ad960 0x7f47d015b0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009850 tx=0x7f47c40090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.556+0000 7f47d8800640 1 -- 172.21.15.5:0/3415403034 shutdown_connections 2024-08-17T02:47:38.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.556+0000 7f47d8800640 1 --2- 172.21.15.5:0/3415403034 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47d00ca050 0x7f47d0156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.556+0000 7f47d8800640 1 --2- 172.21.15.5:0/3415403034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47d00ad960 0x7f47d015b0a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.556+0000 7f47d8800640 1 -- 172.21.15.5:0/3415403034 >> 172.21.15.5:0/3415403034 conn(0x7f47d0066e60 msgr2=0x7f47d0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:38.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.556+0000 7f47d8800640 1 -- 172.21.15.5:0/3415403034 shutdown_connections 2024-08-17T02:47:38.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.556+0000 7f47d8800640 1 -- 172.21.15.5:0/3415403034 wait complete. 2024-08-17T02:47:38.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.558+0000 7f47d8800640 1 Processor -- start 2024-08-17T02:47:38.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.558+0000 7f47d8800640 1 -- start start 2024-08-17T02:47:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.559+0000 7f47d8800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47d00ad960 0x7f47d014d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.559+0000 7f47d8800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47d00add30 0x7f47d01520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.559+0000 7f47d8800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47d00ca050 0x7f47d0152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.559+0000 7f47d8800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d006b930 con 0x7f47d00add30 2024-08-17T02:47:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.559+0000 7f47d8800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d0159ef0 con 0x7f47d00ad960 2024-08-17T02:47:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.559+0000 7f47d8800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d014e300 con 0x7f47d00ca050 2024-08-17T02:47:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.559+0000 7f47d5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47d00add30 0x7f47d01520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.559+0000 7f47d5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47d00add30 0x7f47d01520c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40160/0 (socket says 172.21.15.5:40160) 2024-08-17T02:47:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.559+0000 7f47d5400640 1 -- 172.21.15.5:0/3478505794 learned_addr learned my addr 172.21.15.5:0/3478505794 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.559+0000 7f47d5e00640 1 --2- 172.21.15.5:0/3478505794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47d00ad960 0x7f47d014d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.559+0000 7f47d6800640 1 --2- 172.21.15.5:0/3478505794 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47d00ca050 0x7f47d0152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.559+0000 7f47d5400640 1 -- 172.21.15.5:0/3478505794 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47d00ca050 msgr2=0x7f47d0152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.559+0000 7f47d5400640 1 --2- 172.21.15.5:0/3478505794 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47d00ca050 0x7f47d0152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.559+0000 7f47d5400640 1 -- 172.21.15.5:0/3478505794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47d00ad960 msgr2=0x7f47d014d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.559+0000 7f47d5400640 1 --2- 172.21.15.5:0/3478505794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47d00ad960 0x7f47d014d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.559+0000 7f47d5400640 1 -- 172.21.15.5:0/3478505794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c4009390 con 0x7f47d00add30 2024-08-17T02:47:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.560+0000 7f47d5400640 1 --2- 172.21.15.5:0/3478505794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47d00add30 0x7f47d01520c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009fd0 tx=0x7f47c00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.560+0000 7f47c9600640 1 -- 172.21.15.5:0/3478505794 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c000c940 con 0x7f47d00add30 2024-08-17T02:47:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.560+0000 7f47c9600640 1 -- 172.21.15.5:0/3478505794 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c000caa0 con 0x7f47d00add30 2024-08-17T02:47:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.560+0000 7f47c9600640 1 -- 172.21.15.5:0/3478505794 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c000ce20 con 0x7f47d00add30 2024-08-17T02:47:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.560+0000 7f47d8800640 1 -- 172.21.15.5:0/3478505794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d014e5e0 con 0x7f47d00add30 2024-08-17T02:47:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.560+0000 7f47d8800640 1 -- 172.21.15.5:0/3478505794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d014eba0 con 0x7f47d00add30 2024-08-17T02:47:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.561+0000 7f47d8800640 1 -- 172.21.15.5:0/3478505794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d0063fb0 con 0x7f47d00add30 2024-08-17T02:47:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.562+0000 7f47c9600640 1 -- 172.21.15.5:0/3478505794 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f47c0013680 con 0x7f47d00add30 2024-08-17T02:47:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.563+0000 7f47c9600640 1 --2- 172.21.15.5:0/3478505794 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f47b4065150 0x7f47b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.563+0000 7f47c9600640 1 -- 172.21.15.5:0/3478505794 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47c00826f0 con 0x7f47d00add30 2024-08-17T02:47:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.563+0000 7f47d5e00640 1 --2- 172.21.15.5:0/3478505794 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f47b4065150 0x7f47b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.564+0000 7f47d5e00640 1 --2- 172.21.15.5:0/3478505794 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f47b4065150 0x7f47b4067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f47c4034000 tx=0x7f47c4032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:38.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.567+0000 7f47c9600640 1 -- 172.21.15.5:0/3478505794 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f47c00507c0 con 0x7f47d00add30 2024-08-17T02:47:38.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.787+0000 7f47d8800640 1 -- 172.21.15.5:0/3478505794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47d006d100 con 0x7f47d00add30 2024-08-17T02:47:38.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.788+0000 7f47c9600640 1 -- 172.21.15.5:0/3478505794 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f47c0053de0 con 0x7f47d00add30 2024-08-17T02:47:38.789 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:38.789 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/3624354828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3624354828},{"type":"v1","addr":"172.21.15.5:6836","nonce":3624354828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2614098803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2614098803},{"type":"v1","addr":"172.21.15.107:6835","nonce":2614098803}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1090239725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1090239725},{"type":"v1","addr":"172.21.15.5:6837","nonce":1090239725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:57.590268+0000","modified":"2024-08-17T02:47:01.184380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6834/2631760450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2631760450},{"type":"v1","addr":"172.21.15.107:6834","nonce":2631760450}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:47:38.790 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-08-17T02:47:38.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.790+0000 7f47d8800640 1 -- 172.21.15.5:0/3478505794 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f47b4065150 msgr2=0x7f47b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.790+0000 7f47d8800640 1 --2- 172.21.15.5:0/3478505794 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f47b4065150 0x7f47b4067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f47c4034000 tx=0x7f47c4032000 comp rx=0 tx=0).stop 2024-08-17T02:47:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.790+0000 7f47d8800640 1 -- 172.21.15.5:0/3478505794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47d00add30 msgr2=0x7f47d01520c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.790+0000 7f47d8800640 1 --2- 172.21.15.5:0/3478505794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47d00add30 0x7f47d01520c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009fd0 tx=0x7f47c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.790+0000 7f47d8800640 1 -- 172.21.15.5:0/3478505794 shutdown_connections 2024-08-17T02:47:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.790+0000 7f47d8800640 1 --2- 172.21.15.5:0/3478505794 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f47b4065150 0x7f47b4067600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.790+0000 7f47d8800640 1 --2- 172.21.15.5:0/3478505794 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47d00ca050 0x7f47d0152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.790+0000 7f47d8800640 1 --2- 172.21.15.5:0/3478505794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47d00add30 0x7f47d01520c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.790+0000 7f47d8800640 1 --2- 172.21.15.5:0/3478505794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47d00ad960 0x7f47d014d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.790+0000 7f47d8800640 1 -- 172.21.15.5:0/3478505794 >> 172.21.15.5:0/3478505794 conn(0x7f47d0066e60 msgr2=0x7f47d0153130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.790+0000 7f47d8800640 1 -- 172.21.15.5:0/3478505794 shutdown_connections 2024-08-17T02:47:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.790+0000 7f47d8800640 1 -- 172.21.15.5:0/3478505794 wait complete. 2024-08-17T02:47:38.807 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:38.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.956+0000 7ffb69600640 1 Processor -- start 2024-08-17T02:47:38.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.956+0000 7ffb69600640 1 -- start start 2024-08-17T02:47:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.957+0000 7ffb69600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffb641590b0 0x7ffb640b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.957+0000 7ffb69600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb640c92b0 con 0x7ffb640acf10 2024-08-17T02:47:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.957+0000 7ffb69600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb640ad480 con 0x7ffb640afca0 2024-08-17T02:47:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.957+0000 7ffb69600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb640b0980 con 0x7ffb641590b0 2024-08-17T02:47:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.958+0000 7ffb63400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffb640acf10 0x7ffb640c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56182/0 (socket says 172.21.15.5:56182) 2024-08-17T02:47:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.958+0000 7ffb63400640 1 -- 172.21.15.5:0/3830632061 learned_addr learned my addr 172.21.15.5:0/3830632061 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.958+0000 7ffb62000640 1 --2- 172.21.15.5:0/3830632061 >> v2:172.21.15.107:3300/0 conn(0x7ffb641590b0 0x7ffb640b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.958+0000 7ffb61600640 1 -- 172.21.15.5:0/3830632061 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617103587 0 0) 0x7ffb640c92b0 con 0x7ffb640acf10 2024-08-17T02:47:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.958+0000 7ffb61600640 1 -- 172.21.15.5:0/3830632061 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb480034e0 con 0x7ffb640acf10 2024-08-17T02:47:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.958+0000 7ffb61600640 1 -- 172.21.15.5:0/3830632061 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 794162611 0 0) 0x7ffb480034e0 con 0x7ffb640acf10 2024-08-17T02:47:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.958+0000 7ffb61600640 1 -- 172.21.15.5:0/3830632061 >> v2:172.21.15.107:3300/0 conn(0x7ffb641590b0 msgr2=0x7ffb640b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.958+0000 7ffb61600640 1 --2- 172.21.15.5:0/3830632061 >> v2:172.21.15.107:3300/0 conn(0x7ffb641590b0 0x7ffb640b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb61600640 1 -- 172.21.15.5:0/3830632061 >> v1:172.21.15.107:6789/0 conn(0x7ffb640afca0 legacy=0x7ffb641589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb61600640 1 -- 172.21.15.5:0/3830632061 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb640ad760 con 0x7ffb640acf10 2024-08-17T02:47:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb61600640 1 -- 172.21.15.5:0/3830632061 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7ffb5c0017f0 con 0x7ffb640acf10 2024-08-17T02:47:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb62000640 1 --2- 172.21.15.5:0/3830632061 >> v2:172.21.15.107:3300/0 conn(0x7ffb641590b0 0x7ffb640b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb61600640 1 -- 172.21.15.5:0/3830632061 >> v1:172.21.15.5:6789/0 conn(0x7ffb640acf10 legacy=0x7ffb640c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb61600640 1 --2- 172.21.15.5:0/3830632061 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb480039d0 0x7ffb48003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb61600640 1 --2- 172.21.15.5:0/3830632061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb48004780 0x7ffb48004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb61600640 1 --2- 172.21.15.5:0/3830632061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb48005130 0x7ffb4800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb61600640 1 -- 172.21.15.5:0/3830632061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4800bfc0 con 0x7ffb48004780 2024-08-17T02:47:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb61600640 1 -- 172.21.15.5:0/3830632061 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4800c100 con 0x7ffb48005130 2024-08-17T02:47:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb61600640 1 -- 172.21.15.5:0/3830632061 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4800e4d0 con 0x7ffb480039d0 2024-08-17T02:47:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb62000640 1 --2- 172.21.15.5:0/3830632061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb48004780 0x7ffb48004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb63400640 1 --2- 172.21.15.5:0/3830632061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb48005130 0x7ffb4800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb62a00640 1 --2- 172.21.15.5:0/3830632061 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb480039d0 0x7ffb48003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb62000640 1 -- 172.21.15.5:0/3830632061 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb480039d0 msgr2=0x7ffb48003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb62000640 1 --2- 172.21.15.5:0/3830632061 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb480039d0 0x7ffb48003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb62000640 1 -- 172.21.15.5:0/3830632061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb48005130 msgr2=0x7ffb4800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb62000640 1 --2- 172.21.15.5:0/3830632061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb48005130 0x7ffb4800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb62000640 1 -- 172.21.15.5:0/3830632061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb480034e0 con 0x7ffb48004780 2024-08-17T02:47:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb63400640 1 --2- 172.21.15.5:0/3830632061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb48005130 0x7ffb4800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.959+0000 7ffb63400640 1 -- 172.21.15.5:0/3830632061 reap_dead start 2024-08-17T02:47:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.960+0000 7ffb62000640 1 --2- 172.21.15.5:0/3830632061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb48004780 0x7ffb48004bf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffb641594f0 tx=0x7ffb500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc50cef3c955e67 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.961+0000 7ffb61600640 1 -- 172.21.15.5:0/3830632061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb50031400 con 0x7ffb48004780 2024-08-17T02:47:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.961+0000 7ffb61600640 1 -- 172.21.15.5:0/3830632061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5002d050 con 0x7ffb48004780 2024-08-17T02:47:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.961+0000 7ffb61600640 1 -- 172.21.15.5:0/3830632061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb50031770 con 0x7ffb48004780 2024-08-17T02:47:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.961+0000 7ffb69600640 1 -- 172.21.15.5:0/3830632061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb48004780 msgr2=0x7ffb48004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.961+0000 7ffb69600640 1 --2- 172.21.15.5:0/3830632061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb48004780 0x7ffb48004bf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffb641594f0 tx=0x7ffb500090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.961+0000 7ffb69600640 1 -- 172.21.15.5:0/3830632061 shutdown_connections 2024-08-17T02:47:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.961+0000 7ffb69600640 1 --2- 172.21.15.5:0/3830632061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb48004780 0x7ffb48004bf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.961+0000 7ffb69600640 1 -- 172.21.15.5:0/3830632061 >> 172.21.15.5:0/3830632061 conn(0x7ffb64066e60 msgr2=0x7ffb64067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.961+0000 7ffb69600640 1 -- 172.21.15.5:0/3830632061 shutdown_connections 2024-08-17T02:47:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.961+0000 7ffb69600640 1 -- 172.21.15.5:0/3830632061 wait complete. 2024-08-17T02:47:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.963+0000 7ffb69600640 1 Processor -- start 2024-08-17T02:47:38.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.963+0000 7ffb69600640 1 -- start start 2024-08-17T02:47:38.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.963+0000 7ffb69600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb48004780 0x7ffb64168b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.963+0000 7ffb69600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb640c75f0 0x7ffb640aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.963+0000 7ffb69600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb640af080 0x7ffb64157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.963+0000 7ffb69600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6414e210 con 0x7ffb640c75f0 2024-08-17T02:47:38.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.964+0000 7ffb69600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb640af4d0 con 0x7ffb640af080 2024-08-17T02:47:38.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.964+0000 7ffb69600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6414ff00 con 0x7ffb48004780 2024-08-17T02:47:38.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.964+0000 7ffb62000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb640c75f0 0x7ffb640aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.964+0000 7ffb62000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb640c75f0 0x7ffb640aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40170/0 (socket says 172.21.15.5:40170) 2024-08-17T02:47:38.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.964+0000 7ffb62000640 1 -- 172.21.15.5:0/2997271303 learned_addr learned my addr 172.21.15.5:0/2997271303 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:38.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.964+0000 7ffb62a00640 1 --2- 172.21.15.5:0/2997271303 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb48004780 0x7ffb64168b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.964+0000 7ffb63400640 1 --2- 172.21.15.5:0/2997271303 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb640af080 0x7ffb64157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.964+0000 7ffb62000640 1 -- 172.21.15.5:0/2997271303 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb48004780 msgr2=0x7ffb64168b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.964+0000 7ffb62000640 1 --2- 172.21.15.5:0/2997271303 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb48004780 0x7ffb64168b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.964+0000 7ffb62000640 1 -- 172.21.15.5:0/2997271303 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb640af080 msgr2=0x7ffb64157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:38.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.964+0000 7ffb62000640 1 --2- 172.21.15.5:0/2997271303 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb640af080 0x7ffb64157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:38.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.964+0000 7ffb62000640 1 -- 172.21.15.5:0/2997271303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6414d600 con 0x7ffb640c75f0 2024-08-17T02:47:38.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.965+0000 7ffb62000640 1 --2- 172.21.15.5:0/2997271303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb640c75f0 0x7ffb640aeb40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ffb5002ad00 tx=0x7ffb50035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:38.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.965+0000 7ffb5a000640 1 -- 172.21.15.5:0/2997271303 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb50030700 con 0x7ffb640c75f0 2024-08-17T02:47:38.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.965+0000 7ffb5a000640 1 -- 172.21.15.5:0/2997271303 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb50030860 con 0x7ffb640c75f0 2024-08-17T02:47:38.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.965+0000 7ffb5a000640 1 -- 172.21.15.5:0/2997271303 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb50030be0 con 0x7ffb640c75f0 2024-08-17T02:47:38.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.965+0000 7ffb69600640 1 -- 172.21.15.5:0/2997271303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6414d8e0 con 0x7ffb640c75f0 2024-08-17T02:47:38.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.965+0000 7ffb69600640 1 -- 172.21.15.5:0/2997271303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6414dea0 con 0x7ffb640c75f0 2024-08-17T02:47:38.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.966+0000 7ffb69600640 1 -- 172.21.15.5:0/2997271303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb640ca960 con 0x7ffb640c75f0 2024-08-17T02:47:38.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.967+0000 7ffb5a000640 1 -- 172.21.15.5:0/2997271303 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffb5003b410 con 0x7ffb640c75f0 2024-08-17T02:47:38.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.968+0000 7ffb5a000640 1 --2- 172.21.15.5:0/2997271303 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ffb44065150 0x7ffb44067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:38.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.968+0000 7ffb5a000640 1 -- 172.21.15.5:0/2997271303 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffb500a34d0 con 0x7ffb640c75f0 2024-08-17T02:47:38.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.968+0000 7ffb62a00640 1 --2- 172.21.15.5:0/2997271303 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ffb44065150 0x7ffb44067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:38.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.969+0000 7ffb62a00640 1 --2- 172.21.15.5:0/2997271303 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ffb44065150 0x7ffb44067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffb640659e0 tx=0x7ffb54009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:38.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:38.972+0000 7ffb5a000640 1 -- 172.21.15.5:0/2997271303 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffb640ca960 con 0x7ffb640c75f0 2024-08-17T02:47:39.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.158+0000 7ffb69600640 1 -- 172.21.15.5:0/2997271303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb640ca960 con 0x7ffb640c75f0 2024-08-17T02:47:39.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.159+0000 7ffb5a000640 1 -- 172.21.15.5:0/2997271303 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7ffb640ca960 con 0x7ffb640c75f0 2024-08-17T02:47:39.160 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:39.161 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:46:59.170637+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:55.543347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:56.571235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.161+0000 7ffb69600640 1 -- 172.21.15.5:0/2997271303 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ffb44065150 msgr2=0x7ffb44067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.161+0000 7ffb69600640 1 --2- 172.21.15.5:0/2997271303 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ffb44065150 0x7ffb44067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffb640659e0 tx=0x7ffb54009040 comp rx=0 tx=0).stop 2024-08-17T02:47:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.161+0000 7ffb69600640 1 -- 172.21.15.5:0/2997271303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb640c75f0 msgr2=0x7ffb640aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.161+0000 7ffb69600640 1 --2- 172.21.15.5:0/2997271303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb640c75f0 0x7ffb640aeb40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ffb5002ad00 tx=0x7ffb50035000 comp rx=0 tx=0).stop 2024-08-17T02:47:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.161+0000 7ffb69600640 1 -- 172.21.15.5:0/2997271303 shutdown_connections 2024-08-17T02:47:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.161+0000 7ffb69600640 1 --2- 172.21.15.5:0/2997271303 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ffb44065150 0x7ffb44067600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.161+0000 7ffb69600640 1 --2- 172.21.15.5:0/2997271303 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb640af080 0x7ffb64157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.161+0000 7ffb69600640 1 --2- 172.21.15.5:0/2997271303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb640c75f0 0x7ffb640aeb40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.161+0000 7ffb69600640 1 --2- 172.21.15.5:0/2997271303 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffb48004780 0x7ffb64168b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.161+0000 7ffb69600640 1 -- 172.21.15.5:0/2997271303 >> 172.21.15.5:0/2997271303 conn(0x7ffb64066e60 msgr2=0x7ffb6406a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.161+0000 7ffb69600640 1 -- 172.21.15.5:0/2997271303 shutdown_connections 2024-08-17T02:47:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.161+0000 7ffb69600640 1 -- 172.21.15.5:0/2997271303 wait complete. 2024-08-17T02:47:39.178 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:47:39.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.334+0000 7f685ea00640 1 Processor -- start 2024-08-17T02:47:39.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.334+0000 7f685ea00640 1 -- start start 2024-08-17T02:47:39.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.335+0000 7f685ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68580ca050 0x7f6858156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.335+0000 7f685ea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f68580add30 0x7f685815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.335+0000 7f685ea00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685815b5e0 con 0x7f68580ad960 2024-08-17T02:47:39.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.335+0000 7f685ea00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68580cb160 con 0x7f68580add30 2024-08-17T02:47:39.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.335+0000 7f685ea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68580b0d10 con 0x7f68580ca050 2024-08-17T02:47:39.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.336+0000 7f6857400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68580ca050 0x7f6858156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.336+0000 7f685ca00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f68580add30 0x7f685815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.336+0000 7f6857e00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f68580ad960 0x7f6858156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:59406/0 (socket says 172.21.15.5:59406) 2024-08-17T02:47:39.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.336+0000 7f6857e00640 1 -- 172.21.15.5:0/4206406732 learned_addr learned my addr 172.21.15.5:0/4206406732 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:39.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.336+0000 7f685ca00640 1 -- 172.21.15.5:0/4206406732 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68580ca050 msgr2=0x7f6858156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:39.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.336+0000 7f685ca00640 1 --2- 172.21.15.5:0/4206406732 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68580ca050 0x7f6858156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.336+0000 7f685ca00640 1 -- 172.21.15.5:0/4206406732 >> v1:172.21.15.107:6789/0 conn(0x7f68580ad960 legacy=0x7f6858156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.336+0000 7f685ca00640 1 -- 172.21.15.5:0/4206406732 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68580ca550 con 0x7f68580add30 2024-08-17T02:47:39.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.336+0000 7f6857400640 1 --2- 172.21.15.5:0/4206406732 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68580ca050 0x7f6858156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:39.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.337+0000 7f685ca00640 1 --2- 172.21.15.5:0/4206406732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68580add30 0x7f685815b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6850009e60 tx=0x7f6850009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1225ddbd1f6a23e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:39.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.337+0000 7f6856a00640 1 -- 172.21.15.5:0/4206406732 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850007550 con 0x7f68580add30 2024-08-17T02:47:39.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.337+0000 7f6856a00640 1 -- 172.21.15.5:0/4206406732 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685002d050 con 0x7f68580add30 2024-08-17T02:47:39.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.337+0000 7f6856a00640 1 -- 172.21.15.5:0/4206406732 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850007900 con 0x7f68580add30 2024-08-17T02:47:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.338+0000 7f685ea00640 1 -- 172.21.15.5:0/4206406732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68580add30 msgr2=0x7f685815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.338+0000 7f685ea00640 1 --2- 172.21.15.5:0/4206406732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68580add30 0x7f685815b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6850009e60 tx=0x7f6850009780 comp rx=0 tx=0).stop 2024-08-17T02:47:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.338+0000 7f685ea00640 1 -- 172.21.15.5:0/4206406732 shutdown_connections 2024-08-17T02:47:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.338+0000 7f685ea00640 1 --2- 172.21.15.5:0/4206406732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68580add30 0x7f685815b0a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.338+0000 7f685ea00640 1 --2- 172.21.15.5:0/4206406732 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68580ca050 0x7f6858156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.338+0000 7f685ea00640 1 -- 172.21.15.5:0/4206406732 >> 172.21.15.5:0/4206406732 conn(0x7f6858066e60 msgr2=0x7f6858067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.338+0000 7f685ea00640 1 -- 172.21.15.5:0/4206406732 shutdown_connections 2024-08-17T02:47:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.338+0000 7f685ea00640 1 -- 172.21.15.5:0/4206406732 wait complete. 2024-08-17T02:47:39.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.340+0000 7f685ea00640 1 Processor -- start 2024-08-17T02:47:39.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.340+0000 7f685ea00640 1 -- start start 2024-08-17T02:47:39.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.341+0000 7f685ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68580ad960 0x7f685814b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.341+0000 7f685ea00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68580add30 0x7f6858159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.341+0000 7f685ea00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68580ca050 0x7f68580a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.341+0000 7f685ea00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6858169ed0 con 0x7f68580ad960 2024-08-17T02:47:39.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.341+0000 7f685ea00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6858158ba0 con 0x7f68580add30 2024-08-17T02:47:39.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.341+0000 7f685ea00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68581582f0 con 0x7f68580ca050 2024-08-17T02:47:39.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.341+0000 7f6857e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68580ad960 0x7f685814b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.341+0000 7f6857e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68580ad960 0x7f685814b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40182/0 (socket says 172.21.15.5:40182) 2024-08-17T02:47:39.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.341+0000 7f6857e00640 1 -- 172.21.15.5:0/1561176652 learned_addr learned my addr 172.21.15.5:0/1561176652 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:39.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.341+0000 7f6857400640 1 --2- 172.21.15.5:0/1561176652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68580add30 0x7f6858159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.341+0000 7f685ca00640 1 --2- 172.21.15.5:0/1561176652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68580ca050 0x7f68580a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.341+0000 7f6857e00640 1 -- 172.21.15.5:0/1561176652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68580ca050 msgr2=0x7f68580a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.341+0000 7f6857e00640 1 --2- 172.21.15.5:0/1561176652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68580ca050 0x7f68580a98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.341+0000 7f6857e00640 1 -- 172.21.15.5:0/1561176652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68580add30 msgr2=0x7f6858159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.341+0000 7f6857e00640 1 --2- 172.21.15.5:0/1561176652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68580add30 0x7f6858159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.341+0000 7f6857e00640 1 -- 172.21.15.5:0/1561176652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6844009390 con 0x7f68580ad960 2024-08-17T02:47:39.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.342+0000 7f6857e00640 1 --2- 172.21.15.5:0/1561176652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68580ad960 0x7f685814b040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f684800c560 tx=0x7f6848007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:39.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.342+0000 7f684f400640 1 -- 172.21.15.5:0/1561176652 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848005aa0 con 0x7f68580ad960 2024-08-17T02:47:39.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.342+0000 7f684f400640 1 -- 172.21.15.5:0/1561176652 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6848005c20 con 0x7f68580ad960 2024-08-17T02:47:39.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.342+0000 7f684f400640 1 -- 172.21.15.5:0/1561176652 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848007320 con 0x7f68580ad960 2024-08-17T02:47:39.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.342+0000 7f685ea00640 1 -- 172.21.15.5:0/1561176652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6850009a20 con 0x7f68580ad960 2024-08-17T02:47:39.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.342+0000 7f685ea00640 1 -- 172.21.15.5:0/1561176652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6858158550 con 0x7f68580ad960 2024-08-17T02:47:39.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.343+0000 7f685ea00640 1 -- 172.21.15.5:0/1561176652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6858063fb0 con 0x7f68580ad960 2024-08-17T02:47:39.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.344+0000 7f684f400640 1 -- 172.21.15.5:0/1561176652 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6848012400 con 0x7f68580ad960 2024-08-17T02:47:39.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.345+0000 7f684f400640 1 --2- 172.21.15.5:0/1561176652 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6838065150 0x7f6838067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.345+0000 7f684f400640 1 -- 172.21.15.5:0/1561176652 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5821+0+0 (secure 0 0 0) 0x7f6848081740 con 0x7f68580ad960 2024-08-17T02:47:39.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.345+0000 7f6857400640 1 --2- 172.21.15.5:0/1561176652 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6838065150 0x7f6838067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.346+0000 7f6857400640 1 --2- 172.21.15.5:0/1561176652 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6838065150 0x7f6838067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6844009360 tx=0x7f6844008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:39.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.349+0000 7f684f400640 1 -- 172.21.15.5:0/1561176652 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f684804be40 con 0x7f68580ad960 2024-08-17T02:47:39.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.572+0000 7f685ea00640 1 -- 172.21.15.5:0/1561176652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f685815b5e0 con 0x7f68580ad960 2024-08-17T02:47:39.574 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-17T02:47:39.572+0000 7f4dd2600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:47:39.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.577+0000 7f684f400640 1 -- 172.21.15.5:0/1561176652 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f685815b5e0 con 0x7f68580ad960 2024-08-17T02:47:39.579 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:47:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.580+0000 7f685ea00640 1 -- 172.21.15.5:0/1561176652 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6838065150 msgr2=0x7f6838067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.580+0000 7f685ea00640 1 --2- 172.21.15.5:0/1561176652 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6838065150 0x7f6838067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6844009360 tx=0x7f6844008040 comp rx=0 tx=0).stop 2024-08-17T02:47:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.580+0000 7f685ea00640 1 -- 172.21.15.5:0/1561176652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68580ad960 msgr2=0x7f685814b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.580+0000 7f685ea00640 1 --2- 172.21.15.5:0/1561176652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68580ad960 0x7f685814b040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f684800c560 tx=0x7f6848007f40 comp rx=0 tx=0).stop 2024-08-17T02:47:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.580+0000 7f685ea00640 1 -- 172.21.15.5:0/1561176652 shutdown_connections 2024-08-17T02:47:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.580+0000 7f685ea00640 1 --2- 172.21.15.5:0/1561176652 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6838065150 0x7f6838067600 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6844009360 tx=0x7f6844008040 comp rx=0 tx=0).stop 2024-08-17T02:47:39.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.580+0000 7f685ea00640 1 --2- 172.21.15.5:0/1561176652 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f68580ca050 0x7f68580a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.580+0000 7f685ea00640 1 --2- 172.21.15.5:0/1561176652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68580add30 0x7f6858159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.580+0000 7f685ea00640 1 --2- 172.21.15.5:0/1561176652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68580ad960 0x7f685814b040 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.580+0000 7f685ea00640 1 -- 172.21.15.5:0/1561176652 >> 172.21.15.5:0/1561176652 conn(0x7f6858066e60 msgr2=0x7f6858154690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:39.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.581+0000 7f685ea00640 1 -- 172.21.15.5:0/1561176652 shutdown_connections 2024-08-17T02:47:39.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.581+0000 7f685ea00640 1 -- 172.21.15.5:0/1561176652 wait complete. 2024-08-17T02:47:39.585 INFO:tasks.ceph.mds.b.smithi107.stderr: -2020> 2024-08-17T02:47:04.014+0000 7f22f9e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:47:39.598 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:47:39.626 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-08-17T02:47:39.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.750+0000 7fd6ab200640 1 Processor -- start 2024-08-17T02:47:39.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.750+0000 7fd6ab200640 1 -- start start 2024-08-17T02:47:39.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.751+0000 7fd6ab200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6ac0b1850 0x7fd6ac0b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.751+0000 7fd6ab200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6ac0d0650 0x7fd6ac0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.751+0000 7fd6ab200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd6ac1585a0 0x7fd6ac158a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.751+0000 7fd6ab200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ac0ce9b0 con 0x7fd6ac0b1850 2024-08-17T02:47:39.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.751+0000 7fd6ab200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ac0cec90 con 0x7fd6ac1585a0 2024-08-17T02:47:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.751+0000 7fd6ab200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac0cef70 con 0x7fd6ac0d0650 2024-08-17T02:47:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.751+0000 7fd6a9e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6ac0b1850 0x7fd6ac0b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.751+0000 7fd6a9e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6ac0b1850 0x7fd6ac0b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40198/0 (socket says 172.21.15.5:40198) 2024-08-17T02:47:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.751+0000 7fd6a9e00640 1 -- 172.21.15.5:0/3820874030 learned_addr learned my addr 172.21.15.5:0/3820874030 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.751+0000 7fd6a1400640 1 --2- 172.21.15.5:0/3820874030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6ac0d0650 0x7fd6ac0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.751+0000 7fd6aa800640 1 --2- 172.21.15.5:0/3820874030 >> v2:172.21.15.107:3300/0 conn(0x7fd6ac1585a0 0x7fd6ac158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.752+0000 7fd6a9e00640 1 -- 172.21.15.5:0/3820874030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6ac0d0650 msgr2=0x7fd6ac0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.752+0000 7fd6a9e00640 1 --2- 172.21.15.5:0/3820874030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6ac0d0650 0x7fd6ac0ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.752+0000 7fd6a9e00640 1 -- 172.21.15.5:0/3820874030 >> v2:172.21.15.107:3300/0 conn(0x7fd6ac1585a0 msgr2=0x7fd6ac158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.752+0000 7fd6a9e00640 1 --2- 172.21.15.5:0/3820874030 >> v2:172.21.15.107:3300/0 conn(0x7fd6ac1585a0 0x7fd6ac158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.752+0000 7fd6a9e00640 1 -- 172.21.15.5:0/3820874030 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac0cf250 con 0x7fd6ac0b1850 2024-08-17T02:47:39.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.753+0000 7fd6a9e00640 1 --2- 172.21.15.5:0/3820874030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6ac0b1850 0x7fd6ac0b1c20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0cf530 tx=0x7fd69c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d5d1d31c316b37 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:39.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.753+0000 7fd6a9400640 1 -- 172.21.15.5:0/3820874030 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c02add0 con 0x7fd6ac0b1850 2024-08-17T02:47:39.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.753+0000 7fd6a9400640 1 -- 172.21.15.5:0/3820874030 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c032440 con 0x7fd6ac0b1850 2024-08-17T02:47:39.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.753+0000 7fd6a9400640 1 -- 172.21.15.5:0/3820874030 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c032820 con 0x7fd6ac0b1850 2024-08-17T02:47:39.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.753+0000 7fd6ab200640 1 -- 172.21.15.5:0/3820874030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6ac0b1850 msgr2=0x7fd6ac0b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.753+0000 7fd6ab200640 1 --2- 172.21.15.5:0/3820874030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6ac0b1850 0x7fd6ac0b1c20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0cf530 tx=0x7fd69c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.754+0000 7fd6ab200640 1 -- 172.21.15.5:0/3820874030 shutdown_connections 2024-08-17T02:47:39.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.754+0000 7fd6ab200640 1 --2- 172.21.15.5:0/3820874030 >> v2:172.21.15.107:3300/0 conn(0x7fd6ac1585a0 0x7fd6ac158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.754+0000 7fd6ab200640 1 --2- 172.21.15.5:0/3820874030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6ac0d0650 0x7fd6ac0ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.754+0000 7fd6ab200640 1 --2- 172.21.15.5:0/3820874030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6ac0b1850 0x7fd6ac0b1c20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.754+0000 7fd6ab200640 1 -- 172.21.15.5:0/3820874030 >> 172.21.15.5:0/3820874030 conn(0x7fd6ac06e590 msgr2=0x7fd6ac06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:39.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.754+0000 7fd6ab200640 1 -- 172.21.15.5:0/3820874030 shutdown_connections 2024-08-17T02:47:39.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.754+0000 7fd6ab200640 1 -- 172.21.15.5:0/3820874030 wait complete. 2024-08-17T02:47:39.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.755+0000 7fd6ab200640 1 Processor -- start 2024-08-17T02:47:39.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.755+0000 7fd6ab200640 1 -- start start 2024-08-17T02:47:39.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.756+0000 7fd6ab200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6ac0b1850 0x7fd6ac0a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.756+0000 7fd6ab200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6ac0d0650 0x7fd6ac0a7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.756+0000 7fd6ab200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6ac1585a0 0x7fd6ac152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.756+0000 7fd6ab200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac0abc60 con 0x7fd6ac0d0650 2024-08-17T02:47:39.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.756+0000 7fd6ab200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac0aa730 con 0x7fd6ac0b1850 2024-08-17T02:47:39.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.756+0000 7fd6ab200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac0ac4e0 con 0x7fd6ac1585a0 2024-08-17T02:47:39.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.756+0000 7fd6a1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6ac0d0650 0x7fd6ac0a7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.756+0000 7fd6a1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6ac0d0650 0x7fd6ac0a7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40210/0 (socket says 172.21.15.5:40210) 2024-08-17T02:47:39.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.756+0000 7fd6a1400640 1 -- 172.21.15.5:0/511034735 learned_addr learned my addr 172.21.15.5:0/511034735 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:39.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.757+0000 7fd6a9e00640 1 --2- 172.21.15.5:0/511034735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6ac0b1850 0x7fd6ac0a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.757+0000 7fd6aa800640 1 --2- 172.21.15.5:0/511034735 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6ac1585a0 0x7fd6ac152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.757+0000 7fd6a1400640 1 -- 172.21.15.5:0/511034735 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6ac1585a0 msgr2=0x7fd6ac152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.757+0000 7fd6a1400640 1 --2- 172.21.15.5:0/511034735 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6ac1585a0 0x7fd6ac152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.757+0000 7fd6a1400640 1 -- 172.21.15.5:0/511034735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6ac0b1850 msgr2=0x7fd6ac0a9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:39.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.757+0000 7fd6a1400640 1 --2- 172.21.15.5:0/511034735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6ac0b1850 0x7fd6ac0a9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:39.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.757+0000 7fd6a1400640 1 -- 172.21.15.5:0/511034735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c009450 con 0x7fd6ac0d0650 2024-08-17T02:47:39.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.757+0000 7fd6a1400640 1 --2- 172.21.15.5:0/511034735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6ac0d0650 0x7fd6ac0a7ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd69400d8c0 tx=0x7fd694008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:39.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.757+0000 7fd6a2000640 1 -- 172.21.15.5:0/511034735 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69400de50 con 0x7fd6ac0d0650 2024-08-17T02:47:39.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.758+0000 7fd6a2000640 1 -- 172.21.15.5:0/511034735 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69400b8d0 con 0x7fd6ac0d0650 2024-08-17T02:47:39.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.758+0000 7fd6ab200640 1 -- 172.21.15.5:0/511034735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ac0aa450 con 0x7fd6ac0d0650 2024-08-17T02:47:39.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.758+0000 7fd6a2000640 1 -- 172.21.15.5:0/511034735 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69400bc70 con 0x7fd6ac0d0650 2024-08-17T02:47:39.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.758+0000 7fd6ab200640 1 -- 172.21.15.5:0/511034735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ac0ac170 con 0x7fd6ac0d0650 2024-08-17T02:47:39.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.759+0000 7fd6ab200640 1 -- 172.21.15.5:0/511034735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ac070720 con 0x7fd6ac0d0650 2024-08-17T02:47:39.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.759+0000 7fd6a2000640 1 -- 172.21.15.5:0/511034735 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd694014640 con 0x7fd6ac0d0650 2024-08-17T02:47:39.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.761+0000 7fd6a2000640 1 --2- 172.21.15.5:0/511034735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd688065150 0x7fd688067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:39.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.761+0000 7fd6a2000640 1 -- 172.21.15.5:0/511034735 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5907+0+0 (secure 0 0 0) 0x7fd694082a80 con 0x7fd6ac0d0650 2024-08-17T02:47:39.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.761+0000 7fd6a9e00640 1 --2- 172.21.15.5:0/511034735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd688065150 0x7fd688067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:39.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.762+0000 7fd6a9e00640 1 --2- 172.21.15.5:0/511034735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd688065150 0x7fd688067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd69c034000 tx=0x7fd69c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:39.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.765+0000 7fd6a2000640 1 -- 172.21.15.5:0/511034735 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd694050b40 con 0x7fd6ac0d0650 2024-08-17T02:47:39.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:39.985+0000 7fd6ab200640 1 -- 172.21.15.5:0/511034735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd6ac0ac620 con 0x7fd6ac0d0650 2024-08-17T02:47:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.578+0000 7fd6a2000640 1 -- 172.21.15.5:0/511034735 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd694054160 con 0x7fd6ac0d0650 2024-08-17T02:47:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.580+0000 7fd6ab200640 1 -- 172.21.15.5:0/511034735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd688065150 msgr2=0x7fd688067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.580+0000 7fd6ab200640 1 --2- 172.21.15.5:0/511034735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd688065150 0x7fd688067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd69c034000 tx=0x7fd69c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.580+0000 7fd6ab200640 1 -- 172.21.15.5:0/511034735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6ac0d0650 msgr2=0x7fd6ac0a7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.580+0000 7fd6ab200640 1 --2- 172.21.15.5:0/511034735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6ac0d0650 0x7fd6ac0a7ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd69400d8c0 tx=0x7fd694008040 comp rx=0 tx=0).stop 2024-08-17T02:47:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.581+0000 7fd6ab200640 1 -- 172.21.15.5:0/511034735 shutdown_connections 2024-08-17T02:47:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.581+0000 7fd6ab200640 1 --2- 172.21.15.5:0/511034735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd688065150 0x7fd688067600 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.581+0000 7fd6ab200640 1 --2- 172.21.15.5:0/511034735 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6ac1585a0 0x7fd6ac152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.581+0000 7fd6ab200640 1 --2- 172.21.15.5:0/511034735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6ac0d0650 0x7fd6ac0a7ab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.581+0000 7fd6ab200640 1 --2- 172.21.15.5:0/511034735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6ac0b1850 0x7fd6ac0a9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.581+0000 7fd6ab200640 1 -- 172.21.15.5:0/511034735 >> 172.21.15.5:0/511034735 conn(0x7fd6ac06e590 msgr2=0x7fd6ac0afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.581+0000 7fd6ab200640 1 -- 172.21.15.5:0/511034735 shutdown_connections 2024-08-17T02:47:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.581+0000 7fd6ab200640 1 -- 172.21.15.5:0/511034735 wait complete. 2024-08-17T02:47:40.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:47:40.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.757+0000 7f57e5e00640 1 Processor -- start 2024-08-17T02:47:40.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.758+0000 7f57e5e00640 1 -- start start 2024-08-17T02:47:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.759+0000 7f57e5e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e0158ce0 0x7f57e006c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.759+0000 7f57e5e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57e00cd4f0 0x7f57e006aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.759+0000 7f57e5e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f57e0099e80 0x7f57e009a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.759+0000 7f57e5e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e006c8f0 con 0x7f57e00cd4f0 2024-08-17T02:47:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.759+0000 7f57e5e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e009a800 con 0x7f57e0099e80 2024-08-17T02:47:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.759+0000 7f57e5e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e006b310 con 0x7f57e0158ce0 2024-08-17T02:47:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.759+0000 7f57dfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57e00cd4f0 0x7f57e006aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.759+0000 7f57dfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57e00cd4f0 0x7f57e006aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40220/0 (socket says 172.21.15.5:40220) 2024-08-17T02:47:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.759+0000 7f57dfe00640 1 -- 172.21.15.5:0/1655766174 learned_addr learned my addr 172.21.15.5:0/1655766174 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.759+0000 7f57e4a00640 1 --2- 172.21.15.5:0/1655766174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e0158ce0 0x7f57e006c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.759+0000 7f57e5400640 1 --2- 172.21.15.5:0/1655766174 >> v2:172.21.15.107:3300/0 conn(0x7f57e0099e80 0x7f57e009a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.760+0000 7f57dfe00640 1 -- 172.21.15.5:0/1655766174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e0158ce0 msgr2=0x7f57e006c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.760+0000 7f57dfe00640 1 --2- 172.21.15.5:0/1655766174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e0158ce0 0x7f57e006c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.760+0000 7f57dfe00640 1 -- 172.21.15.5:0/1655766174 >> v2:172.21.15.107:3300/0 conn(0x7f57e0099e80 msgr2=0x7f57e009a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.760+0000 7f57dfe00640 1 --2- 172.21.15.5:0/1655766174 >> v2:172.21.15.107:3300/0 conn(0x7f57e0099e80 0x7f57e009a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.760+0000 7f57dfe00640 1 -- 172.21.15.5:0/1655766174 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e006b5f0 con 0x7f57e00cd4f0 2024-08-17T02:47:40.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.761+0000 7f57dfe00640 1 --2- 172.21.15.5:0/1655766174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e00cd4f0 0x7f57e006aa30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f57e006e960 tx=0x7f57cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb54f07e7dab3ef server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:40.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.761+0000 7f57df400640 1 -- 172.21.15.5:0/1655766174 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc02ad40 con 0x7f57e00cd4f0 2024-08-17T02:47:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.761+0000 7f57df400640 1 -- 172.21.15.5:0/1655766174 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc032440 con 0x7f57e00cd4f0 2024-08-17T02:47:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.761+0000 7f57df400640 1 -- 172.21.15.5:0/1655766174 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc02aea0 con 0x7f57e00cd4f0 2024-08-17T02:47:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.761+0000 7f57e5e00640 1 -- 172.21.15.5:0/1655766174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e00cd4f0 msgr2=0x7f57e006aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.762+0000 7f57e5e00640 1 --2- 172.21.15.5:0/1655766174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e00cd4f0 0x7f57e006aa30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f57e006e960 tx=0x7f57cc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.762+0000 7f57e5e00640 1 -- 172.21.15.5:0/1655766174 shutdown_connections 2024-08-17T02:47:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.762+0000 7f57e5e00640 1 --2- 172.21.15.5:0/1655766174 >> v2:172.21.15.107:3300/0 conn(0x7f57e0099e80 0x7f57e009a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.762+0000 7f57e5e00640 1 --2- 172.21.15.5:0/1655766174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e00cd4f0 0x7f57e006aa30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.762+0000 7f57e5e00640 1 --2- 172.21.15.5:0/1655766174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e0158ce0 0x7f57e006c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.762+0000 7f57e5e00640 1 -- 172.21.15.5:0/1655766174 >> 172.21.15.5:0/1655766174 conn(0x7f57e00689f0 msgr2=0x7f57e00cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.762+0000 7f57e5e00640 1 -- 172.21.15.5:0/1655766174 shutdown_connections 2024-08-17T02:47:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.762+0000 7f57e5e00640 1 -- 172.21.15.5:0/1655766174 wait complete. 2024-08-17T02:47:40.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.763+0000 7f57e5e00640 1 Processor -- start 2024-08-17T02:47:40.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.763+0000 7f57e5e00640 1 -- start start 2024-08-17T02:47:40.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.764+0000 7f57e5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e0099e80 0x7f57e00b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:40.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.764+0000 7f57e5e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e00cd4f0 0x7f57e01532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:40.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.764+0000 7f57e5e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57e0158ce0 0x7f57e00ac660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:40.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.764+0000 7f57e5e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e01571d0 con 0x7f57e0099e80 2024-08-17T02:47:40.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.764+0000 7f57e5e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e00b1140 con 0x7f57e0158ce0 2024-08-17T02:47:40.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.764+0000 7f57e5e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e00b0bd0 con 0x7f57e00cd4f0 2024-08-17T02:47:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.764+0000 7f57e4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e0099e80 0x7f57e00b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.764+0000 7f57e4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e0099e80 0x7f57e00b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40224/0 (socket says 172.21.15.5:40224) 2024-08-17T02:47:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.764+0000 7f57e4a00640 1 -- 172.21.15.5:0/4283853471 learned_addr learned my addr 172.21.15.5:0/4283853471 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:40.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.764+0000 7f57e5400640 1 --2- 172.21.15.5:0/4283853471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57e0158ce0 0x7f57e00ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.765+0000 7f57dfe00640 1 --2- 172.21.15.5:0/4283853471 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e00cd4f0 0x7f57e01532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.765+0000 7f57e4a00640 1 -- 172.21.15.5:0/4283853471 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e00cd4f0 msgr2=0x7f57e01532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.765+0000 7f57e4a00640 1 --2- 172.21.15.5:0/4283853471 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e00cd4f0 0x7f57e01532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.765+0000 7f57e4a00640 1 -- 172.21.15.5:0/4283853471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57e0158ce0 msgr2=0x7f57e00ac660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.765+0000 7f57e4a00640 1 --2- 172.21.15.5:0/4283853471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57e0158ce0 0x7f57e00ac660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.765+0000 7f57e4a00640 1 -- 172.21.15.5:0/4283853471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc009450 con 0x7f57e0099e80 2024-08-17T02:47:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.765+0000 7f57e4a00640 1 --2- 172.21.15.5:0/4283853471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e0099e80 0x7f57e00b0690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f57d400e900 tx=0x7f57d40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.765+0000 7f57d3e00640 1 -- 172.21.15.5:0/4283853471 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d400c8e0 con 0x7f57e0099e80 2024-08-17T02:47:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.765+0000 7f57d3e00640 1 -- 172.21.15.5:0/4283853471 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d400ca40 con 0x7f57e0099e80 2024-08-17T02:47:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.765+0000 7f57e5e00640 1 -- 172.21.15.5:0/4283853471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e01573e0 con 0x7f57e0099e80 2024-08-17T02:47:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.765+0000 7f57d3e00640 1 -- 172.21.15.5:0/4283853471 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d400cde0 con 0x7f57e0099e80 2024-08-17T02:47:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.766+0000 7f57e5e00640 1 -- 172.21.15.5:0/4283853471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e0157960 con 0x7f57e0099e80 2024-08-17T02:47:40.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.767+0000 7f57e5e00640 1 -- 172.21.15.5:0/4283853471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e0063f10 con 0x7f57e0099e80 2024-08-17T02:47:40.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.768+0000 7f57d3e00640 1 -- 172.21.15.5:0/4283853471 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f57d4013680 con 0x7f57e0099e80 2024-08-17T02:47:40.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.768+0000 7f57d3e00640 1 --2- 172.21.15.5:0/4283853471 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f57c0065150 0x7f57c0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:40.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.768+0000 7f57d3e00640 1 -- 172.21.15.5:0/4283853471 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5907+0+0 (secure 0 0 0) 0x7f57d4082610 con 0x7f57e0099e80 2024-08-17T02:47:40.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.769+0000 7f57dfe00640 1 --2- 172.21.15.5:0/4283853471 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f57c0065150 0x7f57c0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.769+0000 7f57dfe00640 1 --2- 172.21.15.5:0/4283853471 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f57c0065150 0x7f57c0067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f57cc034000 tx=0x7f57cc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:40.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.773+0000 7f57d3e00640 1 -- 172.21.15.5:0/4283853471 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f57d4050770 con 0x7f57e0099e80 2024-08-17T02:47:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:40.955+0000 7f57e5e00640 1 -- 172.21.15.5:0/4283853471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f57e00b0e90 con 0x7f57e0099e80 2024-08-17T02:47:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.582+0000 7f57d3e00640 1 -- 172.21.15.5:0/4283853471 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f57d4053d90 con 0x7f57e0099e80 2024-08-17T02:47:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:47:41.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.585+0000 7f57e5e00640 1 -- 172.21.15.5:0/4283853471 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f57c0065150 msgr2=0x7f57c0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:41.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.585+0000 7f57e5e00640 1 --2- 172.21.15.5:0/4283853471 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f57c0065150 0x7f57c0067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f57cc034000 tx=0x7f57cc032000 comp rx=0 tx=0).stop 2024-08-17T02:47:41.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.585+0000 7f57e5e00640 1 -- 172.21.15.5:0/4283853471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e0099e80 msgr2=0x7f57e00b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:41.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.585+0000 7f57e5e00640 1 --2- 172.21.15.5:0/4283853471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e0099e80 0x7f57e00b0690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f57d400e900 tx=0x7f57d40090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.586+0000 7f57e5e00640 1 -- 172.21.15.5:0/4283853471 shutdown_connections 2024-08-17T02:47:41.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.586+0000 7f57e5e00640 1 --2- 172.21.15.5:0/4283853471 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f57c0065150 0x7f57c0067600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.586+0000 7f57e5e00640 1 --2- 172.21.15.5:0/4283853471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57e0158ce0 0x7f57e00ac660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.586+0000 7f57e5e00640 1 --2- 172.21.15.5:0/4283853471 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e00cd4f0 0x7f57e01532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.586+0000 7f57e5e00640 1 --2- 172.21.15.5:0/4283853471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e0099e80 0x7f57e00b0690 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.586+0000 7f57e5e00640 1 -- 172.21.15.5:0/4283853471 >> 172.21.15.5:0/4283853471 conn(0x7f57e00689f0 msgr2=0x7f57e015e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:41.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.586+0000 7f57e5e00640 1 -- 172.21.15.5:0/4283853471 shutdown_connections 2024-08-17T02:47:41.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.586+0000 7f57e5e00640 1 -- 172.21.15.5:0/4283853471 wait complete. 2024-08-17T02:47:41.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:47:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.761+0000 7fd4c9600640 1 Processor -- start 2024-08-17T02:47:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.761+0000 7fd4c9600640 1 -- start start 2024-08-17T02:47:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.762+0000 7fd4c9600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd4c41589a0 0x7fd4c40acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.762+0000 7fd4c9600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd4c40aef70 0x7fd4c4158d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.762+0000 7fd4c9600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c40cd450 con 0x7fd4c4159b40 2024-08-17T02:47:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.762+0000 7fd4c9600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c40af3c0 con 0x7fd4c40aef70 2024-08-17T02:47:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.762+0000 7fd4c9600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c40ad380 con 0x7fd4c41589a0 2024-08-17T02:47:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.763+0000 7fd4c2a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd4c41589a0 0x7fd4c40acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.763+0000 7fd4c2a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd4c41589a0 0x7fd4c40acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:34344/0 (socket says 172.21.15.5:34344) 2024-08-17T02:47:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.763+0000 7fd4c2a00640 1 -- 172.21.15.5:0/912791022 learned_addr learned my addr 172.21.15.5:0/912791022 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.763+0000 7fd4c2000640 1 --2- 172.21.15.5:0/912791022 >> v2:172.21.15.107:3300/0 conn(0x7fd4c40aef70 0x7fd4c4158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.763+0000 7fd4c2a00640 1 -- 172.21.15.5:0/912791022 >> v2:172.21.15.107:3300/0 conn(0x7fd4c40aef70 msgr2=0x7fd4c4158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.763+0000 7fd4c2a00640 1 --2- 172.21.15.5:0/912791022 >> v2:172.21.15.107:3300/0 conn(0x7fd4c40aef70 0x7fd4c4158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.763+0000 7fd4c2a00640 1 -- 172.21.15.5:0/912791022 >> v1:172.21.15.107:6789/0 conn(0x7fd4c4159b40 legacy=0x7fd4c406e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.763+0000 7fd4c2a00640 1 -- 172.21.15.5:0/912791022 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c40ad660 con 0x7fd4c41589a0 2024-08-17T02:47:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.764+0000 7fd4c2a00640 1 --2- 172.21.15.5:0/912791022 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd4c41589a0 0x7fd4c40acda0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4009910 tx=0x7fd4b40091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=136564d9fdeb0a90 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.765+0000 7fd4c1600640 1 -- 172.21.15.5:0/912791022 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b402ae40 con 0x7fd4c41589a0 2024-08-17T02:47:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.765+0000 7fd4c1600640 1 -- 172.21.15.5:0/912791022 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b4032440 con 0x7fd4c41589a0 2024-08-17T02:47:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.765+0000 7fd4c1600640 1 -- 172.21.15.5:0/912791022 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4032820 con 0x7fd4c41589a0 2024-08-17T02:47:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.765+0000 7fd4c9600640 1 -- 172.21.15.5:0/912791022 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd4c41589a0 msgr2=0x7fd4c40acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.765+0000 7fd4c9600640 1 --2- 172.21.15.5:0/912791022 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd4c41589a0 0x7fd4c40acda0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4009910 tx=0x7fd4b40091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.765+0000 7fd4c9600640 1 -- 172.21.15.5:0/912791022 shutdown_connections 2024-08-17T02:47:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.765+0000 7fd4c9600640 1 --2- 172.21.15.5:0/912791022 >> v2:172.21.15.107:3300/0 conn(0x7fd4c40aef70 0x7fd4c4158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.765+0000 7fd4c9600640 1 --2- 172.21.15.5:0/912791022 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd4c41589a0 0x7fd4c40acda0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.765+0000 7fd4c9600640 1 -- 172.21.15.5:0/912791022 >> 172.21.15.5:0/912791022 conn(0x7fd4c406c760 msgr2=0x7fd4c406cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.765+0000 7fd4c9600640 1 -- 172.21.15.5:0/912791022 shutdown_connections 2024-08-17T02:47:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.765+0000 7fd4c9600640 1 -- 172.21.15.5:0/912791022 wait complete. 2024-08-17T02:47:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.767+0000 7fd4c9600640 1 Processor -- start 2024-08-17T02:47:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.767+0000 7fd4c9600640 1 -- start start 2024-08-17T02:47:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.768+0000 7fd4c9600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4c40aef70 0x7fd4c4168e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.768+0000 7fd4c9600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd4c41589a0 0x7fd4c4169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.768+0000 7fd4c9600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4c4159b40 0x7fd4c4156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.768+0000 7fd4c9600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c416a660 con 0x7fd4c4159b40 2024-08-17T02:47:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.768+0000 7fd4c9600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4169360 con 0x7fd4c40aef70 2024-08-17T02:47:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.768+0000 7fd4c9600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c40ca750 con 0x7fd4c41589a0 2024-08-17T02:47:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.768+0000 7fd4c3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4c4159b40 0x7fd4c4156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.768+0000 7fd4c3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4c4159b40 0x7fd4c4156ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40238/0 (socket says 172.21.15.5:40238) 2024-08-17T02:47:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.768+0000 7fd4c3400640 1 -- 172.21.15.5:0/3262968999 learned_addr learned my addr 172.21.15.5:0/3262968999 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.768+0000 7fd4c2a00640 1 --2- 172.21.15.5:0/3262968999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4c40aef70 0x7fd4c4168e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.768+0000 7fd4c2000640 1 --2- 172.21.15.5:0/3262968999 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd4c41589a0 0x7fd4c4169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.769+0000 7fd4c3400640 1 -- 172.21.15.5:0/3262968999 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd4c41589a0 msgr2=0x7fd4c4169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.769+0000 7fd4c3400640 1 --2- 172.21.15.5:0/3262968999 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd4c41589a0 0x7fd4c4169ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.769+0000 7fd4c3400640 1 -- 172.21.15.5:0/3262968999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4c40aef70 msgr2=0x7fd4c4168e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.769+0000 7fd4c3400640 1 --2- 172.21.15.5:0/3262968999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4c40aef70 0x7fd4c4168e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.769+0000 7fd4c3400640 1 -- 172.21.15.5:0/3262968999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b4009450 con 0x7fd4c4159b40 2024-08-17T02:47:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.769+0000 7fd4c3400640 1 --2- 172.21.15.5:0/3262968999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4c4159b40 0x7fd4c4156ea0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00c820 tx=0x7fd4bc0015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.769+0000 7fd4ba000640 1 -- 172.21.15.5:0/3262968999 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc00ce10 con 0x7fd4c4159b40 2024-08-17T02:47:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.769+0000 7fd4ba000640 1 -- 172.21.15.5:0/3262968999 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc00a850 con 0x7fd4c4159b40 2024-08-17T02:47:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.769+0000 7fd4ba000640 1 -- 172.21.15.5:0/3262968999 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc00ac10 con 0x7fd4c4159b40 2024-08-17T02:47:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.769+0000 7fd4c9600640 1 -- 172.21.15.5:0/3262968999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c416a410 con 0x7fd4c4159b40 2024-08-17T02:47:41.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.770+0000 7fd4c9600640 1 -- 172.21.15.5:0/3262968999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c416d260 con 0x7fd4c4159b40 2024-08-17T02:47:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.770+0000 7fd4c9600640 1 -- 172.21.15.5:0/3262968999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c416a810 con 0x7fd4c4159b40 2024-08-17T02:47:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.771+0000 7fd4ba000640 1 -- 172.21.15.5:0/3262968999 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd4bc003030 con 0x7fd4c4159b40 2024-08-17T02:47:41.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.772+0000 7fd4ba000640 1 --2- 172.21.15.5:0/3262968999 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd4a4065150 0x7fd4a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.772+0000 7fd4ba000640 1 -- 172.21.15.5:0/3262968999 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5469+0+0 (secure 0 0 0) 0x7fd4bc0821c0 con 0x7fd4c4159b40 2024-08-17T02:47:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.772+0000 7fd4c2a00640 1 --2- 172.21.15.5:0/3262968999 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd4a4065150 0x7fd4a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.773+0000 7fd4c2a00640 1 --2- 172.21.15.5:0/3262968999 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd4a4065150 0x7fd4a4067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4034000 tx=0x7fd4b4032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.776+0000 7fd4ba000640 1 -- 172.21.15.5:0/3262968999 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd4c416a810 con 0x7fd4c4159b40 2024-08-17T02:47:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:41.958+0000 7fd4c9600640 1 -- 172.21.15.5:0/3262968999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd4c416a810 con 0x7fd4c4159b40 2024-08-17T02:47:42.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.585+0000 7fd4ba000640 1 -- 172.21.15.5:0/3262968999 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd4c416a810 con 0x7fd4c4159b40 2024-08-17T02:47:42.586 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-17T02:47:42.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.589+0000 7fd4c9600640 1 -- 172.21.15.5:0/3262968999 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd4a4065150 msgr2=0x7fd4a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.590+0000 7fd4c9600640 1 --2- 172.21.15.5:0/3262968999 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd4a4065150 0x7fd4a4067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4034000 tx=0x7fd4b4032000 comp rx=0 tx=0).stop 2024-08-17T02:47:42.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.590+0000 7fd4c9600640 1 -- 172.21.15.5:0/3262968999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4c4159b40 msgr2=0x7fd4c4156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.590+0000 7fd4c9600640 1 --2- 172.21.15.5:0/3262968999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4c4159b40 0x7fd4c4156ea0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00c820 tx=0x7fd4bc0015f0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.590+0000 7fd4c9600640 1 -- 172.21.15.5:0/3262968999 shutdown_connections 2024-08-17T02:47:42.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.590+0000 7fd4c9600640 1 --2- 172.21.15.5:0/3262968999 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd4a4065150 0x7fd4a4067600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.590+0000 7fd4c9600640 1 --2- 172.21.15.5:0/3262968999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4c4159b40 0x7fd4c4156ea0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.590+0000 7fd4c9600640 1 --2- 172.21.15.5:0/3262968999 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd4c41589a0 0x7fd4c4169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.590+0000 7fd4c9600640 1 --2- 172.21.15.5:0/3262968999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4c40aef70 0x7fd4c4168e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.590+0000 7fd4c9600640 1 -- 172.21.15.5:0/3262968999 >> 172.21.15.5:0/3262968999 conn(0x7fd4c406c760 msgr2=0x7fd4c4066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:42.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.591+0000 7fd4c9600640 1 -- 172.21.15.5:0/3262968999 shutdown_connections 2024-08-17T02:47:42.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.591+0000 7fd4c9600640 1 -- 172.21.15.5:0/3262968999 wait complete. 2024-08-17T02:47:42.613 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:47:42.613 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:47:42.613 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:47:42.613 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:47:42.613 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:47:42.613 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:47:42.614 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:47:42.614 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:47:42.614 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:47:42.614 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:47:42.614 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:47:42.614 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:47:42.615 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:47:42.615 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:47:42.615 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:47:42.615 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:47:42.627 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:47:42.628 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:47:42.629 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:47:42.629 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:47:42.630 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:47:42.631 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:47:42.631 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:47:42.632 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:47:42.673 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:47:42.673 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:42.676 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:47:42.676 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:42.676 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:47:42.677 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:42.678 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:47:42.678 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:42.679 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:47:42.800 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-08-17T02:47:42.800 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-08-17T02:47:42.801 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-17T02:47:42.801 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-17T02:47:42.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.834+0000 7f65d4200640 1 Processor -- start 2024-08-17T02:47:42.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.834+0000 7f65d4200640 1 -- start start 2024-08-17T02:47:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.835+0000 7f65d4200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f65cc0ad960 0x7f65cc15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.835+0000 7f65d4200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f65cc0ca050 0x7f65cc156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.835+0000 7f65d4200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65cc15b5e0 con 0x7f65cc0add30 2024-08-17T02:47:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.836+0000 7f65d4200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65cc0cb160 con 0x7f65cc0ca050 2024-08-17T02:47:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.836+0000 7f65d4200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65cc0b0d10 con 0x7f65cc0ad960 2024-08-17T02:47:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.836+0000 7f65d0e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f65cc0ca050 0x7f65cc156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.836+0000 7f65d0e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f65cc0ca050 0x7f65cc156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40294/0 (socket says 172.21.15.5:40294) 2024-08-17T02:47:42.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.836+0000 7f65d0e00640 1 -- 172.21.15.5:0/441368299 learned_addr learned my addr 172.21.15.5:0/441368299 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:42.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.836+0000 7f65d1800640 1 --2- 172.21.15.5:0/441368299 >> v2:172.21.15.107:3300/0 conn(0x7f65cc0ad960 0x7f65cc15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.836+0000 7f65d0e00640 1 -- 172.21.15.5:0/441368299 >> v2:172.21.15.107:3300/0 conn(0x7f65cc0ad960 msgr2=0x7f65cc15b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:42.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.836+0000 7f65d0e00640 1 --2- 172.21.15.5:0/441368299 >> v2:172.21.15.107:3300/0 conn(0x7f65cc0ad960 0x7f65cc15b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.836+0000 7f65d0e00640 1 -- 172.21.15.5:0/441368299 >> v1:172.21.15.107:6789/0 conn(0x7f65cc0add30 legacy=0x7f65cc156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.836+0000 7f65d0e00640 1 -- 172.21.15.5:0/441368299 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc0ca550 con 0x7f65cc0ca050 2024-08-17T02:47:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.837+0000 7f65d0e00640 1 --2- 172.21.15.5:0/441368299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65cc0ca050 0x7f65cc156420 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0cc910 tx=0x7f65b80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2eeadb1bbe2be20 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.837+0000 7f65cbe00640 1 -- 172.21.15.5:0/441368299 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b8032440 con 0x7f65cc0ca050 2024-08-17T02:47:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.838+0000 7f65cbe00640 1 -- 172.21.15.5:0/441368299 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b80325a0 con 0x7f65cc0ca050 2024-08-17T02:47:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.838+0000 7f65cbe00640 1 -- 172.21.15.5:0/441368299 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b8032980 con 0x7f65cc0ca050 2024-08-17T02:47:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.838+0000 7f65d4200640 1 -- 172.21.15.5:0/441368299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65cc0ca050 msgr2=0x7f65cc156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.838+0000 7f65d4200640 1 --2- 172.21.15.5:0/441368299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65cc0ca050 0x7f65cc156420 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0cc910 tx=0x7f65b80091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.838+0000 7f65d4200640 1 -- 172.21.15.5:0/441368299 shutdown_connections 2024-08-17T02:47:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.838+0000 7f65d4200640 1 --2- 172.21.15.5:0/441368299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65cc0ca050 0x7f65cc156420 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.838+0000 7f65d4200640 1 --2- 172.21.15.5:0/441368299 >> v2:172.21.15.107:3300/0 conn(0x7f65cc0ad960 0x7f65cc15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.838+0000 7f65d4200640 1 -- 172.21.15.5:0/441368299 >> 172.21.15.5:0/441368299 conn(0x7f65cc066e60 msgr2=0x7f65cc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.838+0000 7f65d4200640 1 -- 172.21.15.5:0/441368299 shutdown_connections 2024-08-17T02:47:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.838+0000 7f65d4200640 1 -- 172.21.15.5:0/441368299 wait complete. 2024-08-17T02:47:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.840+0000 7f65d4200640 1 Processor -- start 2024-08-17T02:47:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.840+0000 7f65d4200640 1 -- start start 2024-08-17T02:47:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.840+0000 7f65d4200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65cc0ad960 0x7f65cc145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.840+0000 7f65d4200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65cc0add30 0x7f65cc158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.841+0000 7f65d4200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65cc0ca050 0x7f65cc0a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.841+0000 7f65d4200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc0a4e00 con 0x7f65cc0ad960 2024-08-17T02:47:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.841+0000 7f65d4200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc1589e0 con 0x7f65cc0ca050 2024-08-17T02:47:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.841+0000 7f65d4200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc0a44d0 con 0x7f65cc0add30 2024-08-17T02:47:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.841+0000 7f65d1800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65cc0ad960 0x7f65cc145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.841+0000 7f65d1800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65cc0ad960 0x7f65cc145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40296/0 (socket says 172.21.15.5:40296) 2024-08-17T02:47:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.841+0000 7f65d1800640 1 -- 172.21.15.5:0/2660596581 learned_addr learned my addr 172.21.15.5:0/2660596581 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.841+0000 7f65d2200640 1 --2- 172.21.15.5:0/2660596581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65cc0ca050 0x7f65cc0a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.841+0000 7f65d0e00640 1 --2- 172.21.15.5:0/2660596581 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65cc0add30 0x7f65cc158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.841+0000 7f65d1800640 1 -- 172.21.15.5:0/2660596581 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65cc0add30 msgr2=0x7f65cc158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.841+0000 7f65d1800640 1 --2- 172.21.15.5:0/2660596581 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65cc0add30 0x7f65cc158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.841+0000 7f65d1800640 1 -- 172.21.15.5:0/2660596581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65cc0ca050 msgr2=0x7f65cc0a6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.841+0000 7f65d1800640 1 --2- 172.21.15.5:0/2660596581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65cc0ca050 0x7f65cc0a6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.841+0000 7f65d1800640 1 -- 172.21.15.5:0/2660596581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b8009450 con 0x7f65cc0ad960 2024-08-17T02:47:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.841+0000 7f65d2200640 1 --2- 172.21.15.5:0/2660596581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65cc0ca050 0x7f65cc0a6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.841+0000 7f65d1800640 1 --2- 172.21.15.5:0/2660596581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65cc0ad960 0x7f65cc145330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f65c000e900 tx=0x7f65c00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.842+0000 7f65c8c00640 1 -- 172.21.15.5:0/2660596581 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c000c8e0 con 0x7f65cc0ad960 2024-08-17T02:47:42.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.842+0000 7f65c8c00640 1 -- 172.21.15.5:0/2660596581 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c000ca40 con 0x7f65cc0ad960 2024-08-17T02:47:42.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.842+0000 7f65c8c00640 1 -- 172.21.15.5:0/2660596581 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c000cde0 con 0x7f65cc0ad960 2024-08-17T02:47:42.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.842+0000 7f65d4200640 1 -- 172.21.15.5:0/2660596581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65cc0a47b0 con 0x7f65cc0ad960 2024-08-17T02:47:42.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.842+0000 7f65d4200640 1 -- 172.21.15.5:0/2660596581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65cc145870 con 0x7f65cc0ad960 2024-08-17T02:47:42.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.843+0000 7f65d4200640 1 -- 172.21.15.5:0/2660596581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65cc063fb0 con 0x7f65cc0ad960 2024-08-17T02:47:42.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.844+0000 7f65c8c00640 1 -- 172.21.15.5:0/2660596581 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f65c0013680 con 0x7f65cc0ad960 2024-08-17T02:47:42.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.844+0000 7f65c8c00640 1 --2- 172.21.15.5:0/2660596581 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f65ac065150 0x7f65ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:42.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.845+0000 7f65c8c00640 1 -- 172.21.15.5:0/2660596581 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f65c00823a0 con 0x7f65cc0ad960 2024-08-17T02:47:42.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.845+0000 7f65d0e00640 1 --2- 172.21.15.5:0/2660596581 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f65ac065150 0x7f65ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:42.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.845+0000 7f65d0e00640 1 --2- 172.21.15.5:0/2660596581 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f65ac065150 0x7f65ac067600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f65b8034000 tx=0x7f65b8032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:42.849+0000 7f65c8c00640 1 -- 172.21.15.5:0/2660596581 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f65c0050780 con 0x7f65cc0ad960 2024-08-17T02:47:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.050+0000 7f65d4200640 1 -- 172.21.15.5:0/2660596581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f65cc1522c0 con 0x7f65cc0ad960 2024-08-17T02:47:43.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.595+0000 7f65c8c00640 1 -- 172.21.15.5:0/2660596581 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f65c0053da0 con 0x7f65cc0ad960 2024-08-17T02:47:43.596 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-08-17T02:47:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.597+0000 7f65d4200640 1 -- 172.21.15.5:0/2660596581 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f65ac065150 msgr2=0x7f65ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.597+0000 7f65d4200640 1 --2- 172.21.15.5:0/2660596581 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f65ac065150 0x7f65ac067600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f65b8034000 tx=0x7f65b8032000 comp rx=0 tx=0).stop 2024-08-17T02:47:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.597+0000 7f65d4200640 1 -- 172.21.15.5:0/2660596581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65cc0ad960 msgr2=0x7f65cc145330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.597+0000 7f65d4200640 1 --2- 172.21.15.5:0/2660596581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65cc0ad960 0x7f65cc145330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f65c000e900 tx=0x7f65c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.597+0000 7f65d4200640 1 -- 172.21.15.5:0/2660596581 shutdown_connections 2024-08-17T02:47:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.597+0000 7f65d4200640 1 --2- 172.21.15.5:0/2660596581 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f65ac065150 0x7f65ac067600 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.597+0000 7f65d4200640 1 --2- 172.21.15.5:0/2660596581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65cc0ca050 0x7f65cc0a6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.597+0000 7f65d4200640 1 --2- 172.21.15.5:0/2660596581 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65cc0add30 0x7f65cc158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.597+0000 7f65d4200640 1 --2- 172.21.15.5:0/2660596581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65cc0ad960 0x7f65cc145330 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.597+0000 7f65d4200640 1 -- 172.21.15.5:0/2660596581 >> 172.21.15.5:0/2660596581 conn(0x7f65cc066e60 msgr2=0x7f65cc1511a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:43.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.597+0000 7f65d4200640 1 -- 172.21.15.5:0/2660596581 shutdown_connections 2024-08-17T02:47:43.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.598+0000 7f65d4200640 1 -- 172.21.15.5:0/2660596581 wait complete. 2024-08-17T02:47:43.616 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:47:43.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.769+0000 7fec1b800640 1 Processor -- start 2024-08-17T02:47:43.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.769+0000 7fec1b800640 1 -- start start 2024-08-17T02:47:43.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.770+0000 7fec1b800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fec140afca0 0x7fec140b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.770+0000 7fec1b800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec141590b0 0x7fec14159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.770+0000 7fec1b800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1415a4e0 con 0x7fec140acf10 2024-08-17T02:47:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.770+0000 7fec1b800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec140b0980 con 0x7fec141590b0 2024-08-17T02:47:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.770+0000 7fec1b800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec140c92b0 con 0x7fec140afca0 2024-08-17T02:47:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.770+0000 7fec19800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec141590b0 0x7fec14159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.770+0000 7fec19800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec141590b0 0x7fec14159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40306/0 (socket says 172.21.15.5:40306) 2024-08-17T02:47:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.770+0000 7fec19800640 1 -- 172.21.15.5:0/3592525064 learned_addr learned my addr 172.21.15.5:0/3592525064 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:43.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.771+0000 7fec18e00640 1 --2- 172.21.15.5:0/3592525064 >> v2:172.21.15.107:3300/0 conn(0x7fec140afca0 0x7fec140b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.771+0000 7fec19800640 1 -- 172.21.15.5:0/3592525064 >> v2:172.21.15.107:3300/0 conn(0x7fec140afca0 msgr2=0x7fec140b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.771+0000 7fec19800640 1 --2- 172.21.15.5:0/3592525064 >> v2:172.21.15.107:3300/0 conn(0x7fec140afca0 0x7fec140b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.771+0000 7fec19800640 1 -- 172.21.15.5:0/3592525064 >> v1:172.21.15.107:6789/0 conn(0x7fec140acf10 legacy=0x7fec141589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.771+0000 7fec19800640 1 -- 172.21.15.5:0/3592525064 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec140ad480 con 0x7fec141590b0 2024-08-17T02:47:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.772+0000 7fec19800640 1 --2- 172.21.15.5:0/3592525064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec141590b0 0x7fec14159fa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fec14067e40 tx=0x7fec0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417483818afce09 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.772+0000 7fec13400640 1 -- 172.21.15.5:0/3592525064 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c007400 con 0x7fec141590b0 2024-08-17T02:47:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.772+0000 7fec13400640 1 -- 172.21.15.5:0/3592525064 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c007560 con 0x7fec141590b0 2024-08-17T02:47:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.772+0000 7fec13400640 1 -- 172.21.15.5:0/3592525064 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c007940 con 0x7fec141590b0 2024-08-17T02:47:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.773+0000 7fec1b800640 1 -- 172.21.15.5:0/3592525064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec141590b0 msgr2=0x7fec14159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.773+0000 7fec1b800640 1 --2- 172.21.15.5:0/3592525064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec141590b0 0x7fec14159fa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fec14067e40 tx=0x7fec0c009840 comp rx=0 tx=0).stop 2024-08-17T02:47:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.773+0000 7fec1b800640 1 -- 172.21.15.5:0/3592525064 shutdown_connections 2024-08-17T02:47:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.773+0000 7fec1b800640 1 --2- 172.21.15.5:0/3592525064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec141590b0 0x7fec14159fa0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.773+0000 7fec1b800640 1 --2- 172.21.15.5:0/3592525064 >> v2:172.21.15.107:3300/0 conn(0x7fec140afca0 0x7fec140b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.773+0000 7fec1b800640 1 -- 172.21.15.5:0/3592525064 >> 172.21.15.5:0/3592525064 conn(0x7fec14066e60 msgr2=0x7fec14067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.773+0000 7fec1b800640 1 -- 172.21.15.5:0/3592525064 shutdown_connections 2024-08-17T02:47:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.773+0000 7fec1b800640 1 -- 172.21.15.5:0/3592525064 wait complete. 2024-08-17T02:47:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.774+0000 7fec1b800640 1 Processor -- start 2024-08-17T02:47:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.774+0000 7fec1b800640 1 -- start start 2024-08-17T02:47:43.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.775+0000 7fec1b800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec140acf10 0x7fec14157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.775+0000 7fec1b800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec140afca0 0x7fec14157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.775+0000 7fec1b800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec141590b0 0x7fec14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.775+0000 7fec1b800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1415b650 con 0x7fec140afca0 2024-08-17T02:47:43.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.775+0000 7fec1b800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec14157670 con 0x7fec140acf10 2024-08-17T02:47:43.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.775+0000 7fec1b800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec141525d0 con 0x7fec141590b0 2024-08-17T02:47:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.775+0000 7fec13e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec140afca0 0x7fec14157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.776+0000 7fec18e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec140acf10 0x7fec14157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.776+0000 7fec19800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec141590b0 0x7fec14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.776+0000 7fec18e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec140acf10 0x7fec14157aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:50400/0 (socket says 172.21.15.5:50400) 2024-08-17T02:47:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.776+0000 7fec18e00640 1 -- 172.21.15.5:0/1762690694 learned_addr learned my addr 172.21.15.5:0/1762690694 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.776+0000 7fec13e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec140afca0 0x7fec14157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40310/0 (socket says 172.21.15.5:40310) 2024-08-17T02:47:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.776+0000 7fec18e00640 1 -- 172.21.15.5:0/1762690694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec141590b0 msgr2=0x7fec14069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.776+0000 7fec18e00640 1 --2- 172.21.15.5:0/1762690694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec141590b0 0x7fec14069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.776+0000 7fec18e00640 1 -- 172.21.15.5:0/1762690694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec140afca0 msgr2=0x7fec14157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.776+0000 7fec18e00640 1 --2- 172.21.15.5:0/1762690694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec140afca0 0x7fec14157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.776+0000 7fec18e00640 1 -- 172.21.15.5:0/1762690694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c009ae0 con 0x7fec140acf10 2024-08-17T02:47:43.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.776+0000 7fec13e00640 1 --2- 172.21.15.5:0/1762690694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec140afca0 0x7fec14157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.776+0000 7fec18e00640 1 --2- 172.21.15.5:0/1762690694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec140acf10 0x7fec14157aa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fec0800d890 tx=0x7fec08008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.777+0000 7fec07e00640 1 -- 172.21.15.5:0/1762690694 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800de20 con 0x7fec140acf10 2024-08-17T02:47:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.777+0000 7fec07e00640 1 -- 172.21.15.5:0/1762690694 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0800b8d0 con 0x7fec140acf10 2024-08-17T02:47:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.777+0000 7fec07e00640 1 -- 172.21.15.5:0/1762690694 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800bc70 con 0x7fec140acf10 2024-08-17T02:47:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.777+0000 7fec1b800640 1 -- 172.21.15.5:0/1762690694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1415b090 con 0x7fec140acf10 2024-08-17T02:47:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.777+0000 7fec1b800640 1 -- 172.21.15.5:0/1762690694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1415d7c0 con 0x7fec140acf10 2024-08-17T02:47:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.778+0000 7fec1b800640 1 -- 172.21.15.5:0/1762690694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1415d620 con 0x7fec140acf10 2024-08-17T02:47:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.779+0000 7fec07e00640 1 -- 172.21.15.5:0/1762690694 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fec08014640 con 0x7fec140acf10 2024-08-17T02:47:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.780+0000 7fec07e00640 1 --2- 172.21.15.5:0/1762690694 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7febf4065150 0x7febf4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.780+0000 7fec07e00640 1 -- 172.21.15.5:0/1762690694 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fec080826b0 con 0x7fec140acf10 2024-08-17T02:47:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.780+0000 7fec13e00640 1 --2- 172.21.15.5:0/1762690694 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7febf4065150 0x7febf4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.780+0000 7fec13e00640 1 --2- 172.21.15.5:0/1762690694 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7febf4065150 0x7febf4067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fec140cadc0 tx=0x7fec00006f50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:43.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:43.785+0000 7fec07e00640 1 -- 172.21.15.5:0/1762690694 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fec1415d620 con 0x7fec140acf10 2024-08-17T02:47:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.035+0000 7fec1b800640 1 -- 172.21.15.5:0/1762690694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fec1415d620 con 0x7fec140acf10 2024-08-17T02:47:44.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.036+0000 7fec07e00640 1 -- 172.21.15.5:0/1762690694 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fec1415d620 con 0x7fec140acf10 2024-08-17T02:47:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:44.037 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:47:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-08-17T02:47:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-08-17T02:47:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDoDsBmfSN+HxAAcg8pNsTrQ9hTmQZ3Kpq0pw==", 2024-08-17T02:47:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-17T02:47:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-17T02:47:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-17T02:47:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:47:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-08-17T02:47:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDoDsBmKHhpMhAAHRUjUfRAR6e2ak6o9GAfjg==", 2024-08-17T02:47:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-17T02:47:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-17T02:47:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-17T02:47:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:47:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-08-17T02:47:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDoDsBmwGX3KBAAWdvrBWyhuQlP/MyVv17aNg==", 2024-08-17T02:47:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-17T02:47:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-17T02:47:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-17T02:47:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:47:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-08-17T02:47:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDpDsBmeGYmABAAGUaPonb//3Bnhm7jocZEYA==", 2024-08-17T02:47:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-17T02:47:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-17T02:47:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-17T02:47:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:47:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-08-17T02:47:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDqDsBmn2YfLhAAzU27MiKK/+Hu2p711I0yKw==", 2024-08-17T02:47:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-17T02:47:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:47:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-08-17T02:47:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDtDsBm84w6MhAAlBqRC1in+hEa7IrUoBRP4g==", 2024-08-17T02:47:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-17T02:47:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:47:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-08-17T02:47:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDwDsBmR1lJNxAAuZdEc43Ev1SzoeBRnQ6BfA==", 2024-08-17T02:47:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-17T02:47:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:47:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-08-17T02:47:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD0DsBmGaYLABAA266OowT94+9ZaQjTzqfBUQ==", 2024-08-17T02:47:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-17T02:47:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:47:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-08-17T02:47:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD5DsBm2iIXMBAANXMuZXG3tLrHJGLQpF9alg==", 2024-08-17T02:47:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-17T02:47:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:47:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-08-17T02:47:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD8DsBmyAXPNBAAAA3qPKom4IiekWc6DeSszQ==", 2024-08-17T02:47:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-17T02:47:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:47:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-08-17T02:47:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD/DsBmzArnNxAAAgjR7AbZm9xZv/Bo2LyE7A==", 2024-08-17T02:47:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-17T02:47:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:47:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-08-17T02:47:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQADD8BmyHV5ARAAFGTag8bk5AVEhYvCYibAuA==", 2024-08-17T02:47:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-17T02:47:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:47:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-08-17T02:47:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDpDsBmfPVUCBAA1etQZ/UgvjIx94Qv6o5pGw==", 2024-08-17T02:47:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-17T02:47:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-17T02:47:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-17T02:47:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-17T02:47:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-08-17T02:47:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDpDsBmluOLFBAAwTMJHOeSsJOcokE+DVzCqQ==", 2024-08-17T02:47:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-17T02:47:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-17T02:47:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-17T02:47:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-17T02:47:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-08-17T02:47:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDpDsBm0mV5DhAASbvgOTbHpLOa6/inSyncrg==", 2024-08-17T02:47:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-17T02:47:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-17T02:47:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-17T02:47:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-17T02:47:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-08-17T02:47:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDpDsBmbXyIGhAAK6PbUQ9L880Q7lrxJW9AKg==", 2024-08-17T02:47:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-17T02:47:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-17T02:47:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-17T02:47:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-17T02:47:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-08-17T02:47:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDnDsBmrATbLBAAxGZ3TXEcxfS/lK0yGUEgTA==", 2024-08-17T02:47:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-17T02:47:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-17T02:47:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-17T02:47:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:47:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:47:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAKD8BmYS5YFRAAjQF24FmtQ8GCyF7IYm7Qwg==", 2024-08-17T02:47:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:47:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:47:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAKD8Bm7zdYFRAAsZRIOgEn56WDJNJj7rDC+w==", 2024-08-17T02:47:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:47:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:47:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAKD8Bm+z9YFRAA9es9rDYbsISh/wOPkDIw0A==", 2024-08-17T02:47:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:47:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:47:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAKD8BmUEhYFRAAxaaqd7ugkYInASArY7REyg==", 2024-08-17T02:47:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:47:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:47:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAKD8BmUVFYFRAAynFvqkGCoXCiTP8kDJTCgA==", 2024-08-17T02:47:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:47:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:47:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAKD8BmsVlYFRAAbcqDwsgci4vbPxlURwXYgw==", 2024-08-17T02:47:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:47:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-08-17T02:47:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDoDsBmTKZKGRAAOP+ZNelLloZgh6poXU6OgA==", 2024-08-17T02:47:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-17T02:47:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-17T02:47:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:47:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:47:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-08-17T02:47:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDoDsBmkpqcEhAAyi/+MJcp2YOdxUGfi6ppVg==", 2024-08-17T02:47:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-17T02:47:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-17T02:47:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-17T02:47:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-17T02:47:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:44.055 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-17T02:47:44.055 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:47:44.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.037+0000 7fec1b800640 1 -- 172.21.15.5:0/1762690694 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7febf4065150 msgr2=0x7febf4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.038+0000 7fec1b800640 1 --2- 172.21.15.5:0/1762690694 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7febf4065150 0x7febf4067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fec140cadc0 tx=0x7fec00006f50 comp rx=0 tx=0).stop 2024-08-17T02:47:44.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.038+0000 7fec1b800640 1 -- 172.21.15.5:0/1762690694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec140acf10 msgr2=0x7fec14157aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.038+0000 7fec1b800640 1 --2- 172.21.15.5:0/1762690694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec140acf10 0x7fec14157aa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fec0800d890 tx=0x7fec08008040 comp rx=0 tx=0).stop 2024-08-17T02:47:44.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.038+0000 7fec1b800640 1 -- 172.21.15.5:0/1762690694 shutdown_connections 2024-08-17T02:47:44.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.038+0000 7fec1b800640 1 --2- 172.21.15.5:0/1762690694 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7febf4065150 0x7febf4067600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.038+0000 7fec1b800640 1 --2- 172.21.15.5:0/1762690694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fec141590b0 0x7fec14069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.038+0000 7fec1b800640 1 --2- 172.21.15.5:0/1762690694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec140afca0 0x7fec14157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.038+0000 7fec1b800640 1 --2- 172.21.15.5:0/1762690694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fec140acf10 0x7fec14157aa0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.038+0000 7fec1b800640 1 -- 172.21.15.5:0/1762690694 >> 172.21.15.5:0/1762690694 conn(0x7fec14066e60 msgr2=0x7fec141594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:44.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.038+0000 7fec1b800640 1 -- 172.21.15.5:0/1762690694 shutdown_connections 2024-08-17T02:47:44.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.038+0000 7fec1b800640 1 -- 172.21.15.5:0/1762690694 wait complete. 2024-08-17T02:47:44.057 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:47:44.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.209+0000 7f7103200640 1 Processor -- start 2024-08-17T02:47:44.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.209+0000 7f7103200640 1 -- start start 2024-08-17T02:47:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.210+0000 7f7103200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f70fc15c300 0x7f70fc068470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.210+0000 7f7103200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc0c76f0 con 0x7f70fc0680a0 2024-08-17T02:47:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.210+0000 7f7103200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc0c79d0 con 0x7f70fc06ea70 2024-08-17T02:47:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.210+0000 7f7103200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc0c8370 con 0x7f70fc15c300 2024-08-17T02:47:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.210+0000 7f7101e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f70fc0680a0 0x7f70fc0c9bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56196/0 (socket says 172.21.15.5:56196) 2024-08-17T02:47:44.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.210+0000 7f7101e00640 1 -- 172.21.15.5:0/1035724041 learned_addr learned my addr 172.21.15.5:0/1035724041 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:44.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.210+0000 7f7102800640 1 --2- 172.21.15.5:0/1035724041 >> v2:172.21.15.107:3300/0 conn(0x7f70fc15c300 0x7f70fc068470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.211+0000 7f7100a00640 1 -- 172.21.15.5:0/1035724041 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388743605 0 0) 0x7f70fc0c76f0 con 0x7f70fc0680a0 2024-08-17T02:47:44.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.211+0000 7f7100a00640 1 -- 172.21.15.5:0/1035724041 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e40034e0 con 0x7f70fc0680a0 2024-08-17T02:47:44.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.211+0000 7f7102800640 1 -- 172.21.15.5:0/1035724041 >> v1:172.21.15.107:6789/0 conn(0x7f70fc06ea70 legacy=0x7f70fc15bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.211+0000 7f7102800640 1 -- 172.21.15.5:0/1035724041 >> v1:172.21.15.5:6789/0 conn(0x7f70fc0680a0 legacy=0x7f70fc0c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.211+0000 7f7102800640 1 -- 172.21.15.5:0/1035724041 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc0c7cb0 con 0x7f70fc15c300 2024-08-17T02:47:44.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.212+0000 7f7102800640 1 --2- 172.21.15.5:0/1035724041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70fc15c300 0x7f70fc068470 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009e60 tx=0x7f70f8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1100b410c6591302 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:44.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.212+0000 7f7100a00640 1 -- 172.21.15.5:0/1035724041 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8007550 con 0x7f70fc15c300 2024-08-17T02:47:44.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.212+0000 7f7100a00640 1 -- 172.21.15.5:0/1035724041 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f802d050 con 0x7f70fc15c300 2024-08-17T02:47:44.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.212+0000 7f7100a00640 1 -- 172.21.15.5:0/1035724041 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8007900 con 0x7f70fc15c300 2024-08-17T02:47:44.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.213+0000 7f7103200640 1 -- 172.21.15.5:0/1035724041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70fc15c300 msgr2=0x7f70fc068470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.213+0000 7f7103200640 1 --2- 172.21.15.5:0/1035724041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70fc15c300 0x7f70fc068470 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009e60 tx=0x7f70f8009780 comp rx=0 tx=0).stop 2024-08-17T02:47:44.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.213+0000 7f7103200640 1 -- 172.21.15.5:0/1035724041 shutdown_connections 2024-08-17T02:47:44.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.213+0000 7f7103200640 1 --2- 172.21.15.5:0/1035724041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70fc15c300 0x7f70fc068470 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.213+0000 7f7103200640 1 -- 172.21.15.5:0/1035724041 >> 172.21.15.5:0/1035724041 conn(0x7f70fc06ded0 msgr2=0x7f70fc06e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:44.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.213+0000 7f7103200640 1 -- 172.21.15.5:0/1035724041 shutdown_connections 2024-08-17T02:47:44.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.213+0000 7f7103200640 1 -- 172.21.15.5:0/1035724041 wait complete. 2024-08-17T02:47:44.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.214+0000 7f7103200640 1 Processor -- start 2024-08-17T02:47:44.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.215+0000 7f7103200640 1 -- start start 2024-08-17T02:47:44.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.215+0000 7f7103200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70fc0680a0 0x7f70fc0affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.216+0000 7f7103200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70fc06ea70 0x7f70fc0b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.216+0000 7f7103200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70fc15c300 0x7f70fc168710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.216+0000 7f7103200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0b12d0 con 0x7f70fc15c300 2024-08-17T02:47:44.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.216+0000 7f7103200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0c3550 con 0x7f70fc0680a0 2024-08-17T02:47:44.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.216+0000 7f7103200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0b0a40 con 0x7f70fc06ea70 2024-08-17T02:47:44.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.216+0000 7f7102800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70fc15c300 0x7f70fc168710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.216+0000 7f7102800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70fc15c300 0x7f70fc168710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40318/0 (socket says 172.21.15.5:40318) 2024-08-17T02:47:44.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.216+0000 7f7102800640 1 -- 172.21.15.5:0/416045241 learned_addr learned my addr 172.21.15.5:0/416045241 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:44.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.216+0000 7f7101e00640 1 --2- 172.21.15.5:0/416045241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70fc0680a0 0x7f70fc0affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.216+0000 7f7101400640 1 --2- 172.21.15.5:0/416045241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70fc06ea70 0x7f70fc0b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.216+0000 7f7102800640 1 -- 172.21.15.5:0/416045241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70fc06ea70 msgr2=0x7f70fc0b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.216+0000 7f7102800640 1 --2- 172.21.15.5:0/416045241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70fc06ea70 0x7f70fc0b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.216+0000 7f7102800640 1 -- 172.21.15.5:0/416045241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70fc0680a0 msgr2=0x7f70fc0affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.216+0000 7f7102800640 1 --2- 172.21.15.5:0/416045241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70fc0680a0 0x7f70fc0affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.216+0000 7f7102800640 1 -- 172.21.15.5:0/416045241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f8009a20 con 0x7f70fc15c300 2024-08-17T02:47:44.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.216+0000 7f7101e00640 1 --2- 172.21.15.5:0/416045241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70fc0680a0 0x7f70fc0affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:44.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.217+0000 7f7102800640 1 --2- 172.21.15.5:0/416045241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70fc15c300 0x7f70fc168710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009e60 tx=0x7f70f8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:44.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.217+0000 7f70f5600640 1 -- 172.21.15.5:0/416045241 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8031b70 con 0x7f70fc15c300 2024-08-17T02:47:44.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.217+0000 7f70f5600640 1 -- 172.21.15.5:0/416045241 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f8031cd0 con 0x7f70fc15c300 2024-08-17T02:47:44.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.217+0000 7f7103200640 1 -- 172.21.15.5:0/416045241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc0b0d10 con 0x7f70fc15c300 2024-08-17T02:47:44.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.217+0000 7f70f5600640 1 -- 172.21.15.5:0/416045241 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f803c670 con 0x7f70fc15c300 2024-08-17T02:47:44.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.217+0000 7f7103200640 1 -- 172.21.15.5:0/416045241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc0c31e0 con 0x7f70fc15c300 2024-08-17T02:47:44.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.218+0000 7f7103200640 1 -- 172.21.15.5:0/416045241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc070720 con 0x7f70fc15c300 2024-08-17T02:47:44.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.219+0000 7f70f5600640 1 -- 172.21.15.5:0/416045241 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f70f8003040 con 0x7f70fc15c300 2024-08-17T02:47:44.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.220+0000 7f70f5600640 1 --2- 172.21.15.5:0/416045241 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f70e0065150 0x7f70e0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.220+0000 7f70f5600640 1 -- 172.21.15.5:0/416045241 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f70f80a35e0 con 0x7f70fc15c300 2024-08-17T02:47:44.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.220+0000 7f7101e00640 1 --2- 172.21.15.5:0/416045241 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f70e0065150 0x7f70e0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.221+0000 7f7101e00640 1 --2- 172.21.15.5:0/416045241 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f70e0065150 0x7f70e0067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0cadb0 tx=0x7f70f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:44.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.224+0000 7f70f5600640 1 -- 172.21.15.5:0/416045241 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f70f8071950 con 0x7f70fc15c300 2024-08-17T02:47:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.472+0000 7f7103200640 1 -- 172.21.15.5:0/416045241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f70fc06e440 con 0x7f70fc15c300 2024-08-17T02:47:44.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.476+0000 7f70f5600640 1 -- 172.21.15.5:0/416045241 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f70f8074f70 con 0x7f70fc15c300 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.478+0000 7f7103200640 1 -- 172.21.15.5:0/416045241 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f70e0065150 msgr2=0x7f70e0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.478+0000 7f7103200640 1 --2- 172.21.15.5:0/416045241 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f70e0065150 0x7f70e0067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0cadb0 tx=0x7f70f0009040 comp rx=0 tx=0).stop 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.478+0000 7f7103200640 1 -- 172.21.15.5:0/416045241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70fc15c300 msgr2=0x7f70fc168710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.478+0000 7f7103200640 1 --2- 172.21.15.5:0/416045241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70fc15c300 0x7f70fc168710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009e60 tx=0x7f70f8037000 comp rx=0 tx=0).stop 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.478+0000 7f7103200640 1 -- 172.21.15.5:0/416045241 shutdown_connections 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.478+0000 7f7103200640 1 --2- 172.21.15.5:0/416045241 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f70e0065150 0x7f70e0067600 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.478+0000 7f7103200640 1 --2- 172.21.15.5:0/416045241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70fc15c300 0x7f70fc168710 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.478+0000 7f7103200640 1 --2- 172.21.15.5:0/416045241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70fc06ea70 0x7f70fc0b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.478+0000 7f7103200640 1 --2- 172.21.15.5:0/416045241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70fc0680a0 0x7f70fc0affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.478+0000 7f7103200640 1 -- 172.21.15.5:0/416045241 >> 172.21.15.5:0/416045241 conn(0x7f70fc06ded0 msgr2=0x7f70fc0c9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:44.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.478+0000 7f7103200640 1 -- 172.21.15.5:0/416045241 shutdown_connections 2024-08-17T02:47:44.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.478+0000 7f7103200640 1 -- 172.21.15.5:0/416045241 wait complete. 2024-08-17T02:47:44.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:47:44.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.649+0000 7ff9c3200640 1 Processor -- start 2024-08-17T02:47:44.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.649+0000 7ff9c3200640 1 -- start start 2024-08-17T02:47:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.650+0000 7ff9c3200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9bc0ae910 0x7ff9bc0aed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.650+0000 7ff9c3200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9bc160720 0x7ff9bc162b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.650+0000 7ff9c3200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9bc0aab10 con 0x7ff9bc0ae540 2024-08-17T02:47:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.650+0000 7ff9c3200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9bc0abfb0 con 0x7ff9bc160720 2024-08-17T02:47:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.650+0000 7ff9c3200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0ac250 con 0x7ff9bc0ae910 2024-08-17T02:47:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.650+0000 7ff9c1e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff9bc0ae540 0x7ff9bc068950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56206/0 (socket says 172.21.15.5:56206) 2024-08-17T02:47:44.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.650+0000 7ff9c1e00640 1 -- 172.21.15.5:0/1241865605 learned_addr learned my addr 172.21.15.5:0/1241865605 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.650+0000 7ff9c2800640 1 --2- 172.21.15.5:0/1241865605 >> v2:172.21.15.5:3300/0 conn(0x7ff9bc160720 0x7ff9bc162b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.651+0000 7ff9c1400640 1 --2- 172.21.15.5:0/1241865605 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9bc0ae910 0x7ff9bc0aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.651+0000 7ff9c0a00640 1 -- 172.21.15.5:0/1241865605 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506806101 0 0) 0x7ff9bc0aab10 con 0x7ff9bc0ae540 2024-08-17T02:47:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.651+0000 7ff9c2800640 1 -- 172.21.15.5:0/1241865605 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9bc0ae910 msgr2=0x7ff9bc0aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.651+0000 7ff9c2800640 1 --2- 172.21.15.5:0/1241865605 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9bc0ae910 0x7ff9bc0aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.651+0000 7ff9c2800640 1 -- 172.21.15.5:0/1241865605 >> v1:172.21.15.5:6789/0 conn(0x7ff9bc0ae540 legacy=0x7ff9bc068950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.651+0000 7ff9c2800640 1 -- 172.21.15.5:0/1241865605 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc0693e0 con 0x7ff9bc160720 2024-08-17T02:47:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.652+0000 7ff9c2800640 1 --2- 172.21.15.5:0/1241865605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9bc160720 0x7ff9bc162b00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009e60 tx=0x7ff9b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2375be3e8063a13d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.652+0000 7ff9c0a00640 1 -- 172.21.15.5:0/1241865605 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8007550 con 0x7ff9bc160720 2024-08-17T02:47:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.652+0000 7ff9c0a00640 1 -- 172.21.15.5:0/1241865605 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b802d050 con 0x7ff9bc160720 2024-08-17T02:47:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.652+0000 7ff9c0a00640 1 -- 172.21.15.5:0/1241865605 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b80078e0 con 0x7ff9bc160720 2024-08-17T02:47:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.653+0000 7ff9c3200640 1 -- 172.21.15.5:0/1241865605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9bc160720 msgr2=0x7ff9bc162b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.653+0000 7ff9c3200640 1 --2- 172.21.15.5:0/1241865605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9bc160720 0x7ff9bc162b00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009e60 tx=0x7ff9b8009780 comp rx=0 tx=0).stop 2024-08-17T02:47:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.653+0000 7ff9c3200640 1 -- 172.21.15.5:0/1241865605 shutdown_connections 2024-08-17T02:47:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.653+0000 7ff9c3200640 1 --2- 172.21.15.5:0/1241865605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9bc160720 0x7ff9bc162b00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.653+0000 7ff9c3200640 1 --2- 172.21.15.5:0/1241865605 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9bc0ae910 0x7ff9bc0aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.653+0000 7ff9c3200640 1 -- 172.21.15.5:0/1241865605 >> 172.21.15.5:0/1241865605 conn(0x7ff9bc0ce400 msgr2=0x7ff9bc095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.653+0000 7ff9c3200640 1 -- 172.21.15.5:0/1241865605 shutdown_connections 2024-08-17T02:47:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.653+0000 7ff9c3200640 1 -- 172.21.15.5:0/1241865605 wait complete. 2024-08-17T02:47:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.654+0000 7ff9c3200640 1 Processor -- start 2024-08-17T02:47:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.654+0000 7ff9c3200640 1 -- start start 2024-08-17T02:47:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.655+0000 7ff9c3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9bc0ae540 0x7ff9bc145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.655+0000 7ff9c3200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9bc0ae910 0x7ff9bc145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.655+0000 7ff9c3200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9bc160720 0x7ff9bc15dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.655+0000 7ff9c3200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc15cc90 con 0x7ff9bc0ae540 2024-08-17T02:47:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.655+0000 7ff9c3200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc15c080 con 0x7ff9bc0ae910 2024-08-17T02:47:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.655+0000 7ff9c3200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc15c360 con 0x7ff9bc160720 2024-08-17T02:47:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.656+0000 7ff9c1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9bc0ae540 0x7ff9bc145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.656+0000 7ff9c1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9bc0ae540 0x7ff9bc145280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40328/0 (socket says 172.21.15.5:40328) 2024-08-17T02:47:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.656+0000 7ff9c1e00640 1 -- 172.21.15.5:0/3937088173 learned_addr learned my addr 172.21.15.5:0/3937088173 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.656+0000 7ff9c2800640 1 --2- 172.21.15.5:0/3937088173 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9bc160720 0x7ff9bc15dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.656+0000 7ff9c1e00640 1 -- 172.21.15.5:0/3937088173 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9bc160720 msgr2=0x7ff9bc15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.656+0000 7ff9c1400640 1 --2- 172.21.15.5:0/3937088173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9bc0ae910 0x7ff9bc145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.656+0000 7ff9c1e00640 1 --2- 172.21.15.5:0/3937088173 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9bc160720 0x7ff9bc15dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.656+0000 7ff9c1e00640 1 -- 172.21.15.5:0/3937088173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9bc0ae910 msgr2=0x7ff9bc145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.656+0000 7ff9c1e00640 1 --2- 172.21.15.5:0/3937088173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9bc0ae910 0x7ff9bc145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.656+0000 7ff9c1e00640 1 -- 172.21.15.5:0/3937088173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b8009a20 con 0x7ff9bc0ae540 2024-08-17T02:47:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.656+0000 7ff9c2800640 1 --2- 172.21.15.5:0/3937088173 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9bc160720 0x7ff9bc15dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.656+0000 7ff9c1400640 1 --2- 172.21.15.5:0/3937088173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9bc0ae910 0x7ff9bc145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.656+0000 7ff9c1e00640 1 --2- 172.21.15.5:0/3937088173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9bc0ae540 0x7ff9bc145280 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000c510 tx=0x7ff9b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.657+0000 7ff9b5600640 1 -- 172.21.15.5:0/3937088173 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0005aa0 con 0x7ff9bc0ae540 2024-08-17T02:47:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.657+0000 7ff9b5600640 1 -- 172.21.15.5:0/3937088173 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b0005c00 con 0x7ff9bc0ae540 2024-08-17T02:47:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.657+0000 7ff9c3200640 1 -- 172.21.15.5:0/3937088173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc15c640 con 0x7ff9bc0ae540 2024-08-17T02:47:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.657+0000 7ff9b5600640 1 -- 172.21.15.5:0/3937088173 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00070d0 con 0x7ff9bc0ae540 2024-08-17T02:47:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.657+0000 7ff9c3200640 1 -- 172.21.15.5:0/3937088173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc1457c0 con 0x7ff9bc0ae540 2024-08-17T02:47:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.658+0000 7ff9c3200640 1 -- 172.21.15.5:0/3937088173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9bc1459e0 con 0x7ff9bc0ae540 2024-08-17T02:47:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.659+0000 7ff9b5600640 1 -- 172.21.15.5:0/3937088173 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff9b0007500 con 0x7ff9bc0ae540 2024-08-17T02:47:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.660+0000 7ff9b5600640 1 --2- 172.21.15.5:0/3937088173 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff9a0065150 0x7ff9a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.660+0000 7ff9b5600640 1 -- 172.21.15.5:0/3937088173 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff9b0081740 con 0x7ff9bc0ae540 2024-08-17T02:47:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.660+0000 7ff9c1400640 1 --2- 172.21.15.5:0/3937088173 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff9a0065150 0x7ff9a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.660+0000 7ff9c1400640 1 --2- 172.21.15.5:0/3937088173 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff9a0065150 0x7ff9a0067600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac006e70 tx=0x7ff9ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.663+0000 7ff9b5600640 1 -- 172.21.15.5:0/3937088173 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff9b004fab0 con 0x7ff9bc0ae540 2024-08-17T02:47:44.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.914+0000 7ff9c3200640 1 -- 172.21.15.5:0/3937088173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7ff9bc15cac0 con 0x7ff9bc0ae540 2024-08-17T02:47:44.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.918+0000 7ff9b5600640 1 -- 172.21.15.5:0/3937088173 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff9b00530d0 con 0x7ff9bc0ae540 2024-08-17T02:47:44.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.921+0000 7ff9c3200640 1 -- 172.21.15.5:0/3937088173 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff9a0065150 msgr2=0x7ff9a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.921+0000 7ff9c3200640 1 --2- 172.21.15.5:0/3937088173 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff9a0065150 0x7ff9a0067600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac006e70 tx=0x7ff9ac008040 comp rx=0 tx=0).stop 2024-08-17T02:47:44.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.921+0000 7ff9c3200640 1 -- 172.21.15.5:0/3937088173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9bc0ae540 msgr2=0x7ff9bc145280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:44.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.921+0000 7ff9c3200640 1 --2- 172.21.15.5:0/3937088173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9bc0ae540 0x7ff9bc145280 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000c510 tx=0x7ff9b000c910 comp rx=0 tx=0).stop 2024-08-17T02:47:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.921+0000 7ff9c3200640 1 -- 172.21.15.5:0/3937088173 shutdown_connections 2024-08-17T02:47:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.921+0000 7ff9c3200640 1 --2- 172.21.15.5:0/3937088173 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff9a0065150 0x7ff9a0067600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.921+0000 7ff9c3200640 1 --2- 172.21.15.5:0/3937088173 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9bc160720 0x7ff9bc15dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.921+0000 7ff9c3200640 1 --2- 172.21.15.5:0/3937088173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9bc0ae910 0x7ff9bc145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.921+0000 7ff9c3200640 1 --2- 172.21.15.5:0/3937088173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9bc0ae540 0x7ff9bc145280 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.921+0000 7ff9c3200640 1 -- 172.21.15.5:0/3937088173 >> 172.21.15.5:0/3937088173 conn(0x7ff9bc0ce400 msgr2=0x7ff9bc15f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.921+0000 7ff9c3200640 1 -- 172.21.15.5:0/3937088173 shutdown_connections 2024-08-17T02:47:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:44.921+0000 7ff9c3200640 1 -- 172.21.15.5:0/3937088173 wait complete. 2024-08-17T02:47:44.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:47:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.089+0000 7fd35f800640 1 Processor -- start 2024-08-17T02:47:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.089+0000 7fd35f800640 1 -- start start 2024-08-17T02:47:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.090+0000 7fd35f800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd3580ad960 0x7fd35815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.090+0000 7fd35f800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3580add30 0x7fd358156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.090+0000 7fd35f800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35815b5e0 con 0x7fd3580ca050 2024-08-17T02:47:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.090+0000 7fd35f800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3580cb160 con 0x7fd3580ad960 2024-08-17T02:47:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.090+0000 7fd35f800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580b0d10 con 0x7fd3580add30 2024-08-17T02:47:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.091+0000 7fd35ce00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd3580ad960 0x7fd35815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.091+0000 7fd35ce00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd3580ad960 0x7fd35815b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40340/0 (socket says 172.21.15.5:40340) 2024-08-17T02:47:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.091+0000 7fd35ce00640 1 -- 172.21.15.5:0/2508246941 learned_addr learned my addr 172.21.15.5:0/2508246941 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.091+0000 7fd35d800640 1 --2- 172.21.15.5:0/2508246941 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3580add30 0x7fd358156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.091+0000 7fd35ce00640 1 -- 172.21.15.5:0/2508246941 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3580add30 msgr2=0x7fd358156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.091+0000 7fd35ce00640 1 --2- 172.21.15.5:0/2508246941 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3580add30 0x7fd358156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.091+0000 7fd35ce00640 1 -- 172.21.15.5:0/2508246941 >> v1:172.21.15.107:6789/0 conn(0x7fd3580ca050 legacy=0x7fd358156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.091+0000 7fd35ce00640 1 -- 172.21.15.5:0/2508246941 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3580ca550 con 0x7fd3580ad960 2024-08-17T02:47:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.092+0000 7fd35ce00640 1 --2- 172.21.15.5:0/2508246941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580ad960 0x7fd35815b0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009910 tx=0x7fd34c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da5f24b7cf71993 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.092+0000 7fd357400640 1 -- 172.21.15.5:0/2508246941 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c032440 con 0x7fd3580ad960 2024-08-17T02:47:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.092+0000 7fd357400640 1 -- 172.21.15.5:0/2508246941 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c0325a0 con 0x7fd3580ad960 2024-08-17T02:47:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.092+0000 7fd357400640 1 -- 172.21.15.5:0/2508246941 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c032980 con 0x7fd3580ad960 2024-08-17T02:47:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.093+0000 7fd35f800640 1 -- 172.21.15.5:0/2508246941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580ad960 msgr2=0x7fd35815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.093+0000 7fd35f800640 1 --2- 172.21.15.5:0/2508246941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580ad960 0x7fd35815b0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009910 tx=0x7fd34c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.093+0000 7fd35f800640 1 -- 172.21.15.5:0/2508246941 shutdown_connections 2024-08-17T02:47:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.093+0000 7fd35f800640 1 --2- 172.21.15.5:0/2508246941 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3580add30 0x7fd358156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.093+0000 7fd35f800640 1 --2- 172.21.15.5:0/2508246941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580ad960 0x7fd35815b0a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.093+0000 7fd35f800640 1 -- 172.21.15.5:0/2508246941 >> 172.21.15.5:0/2508246941 conn(0x7fd358066e60 msgr2=0x7fd358067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.093+0000 7fd35f800640 1 -- 172.21.15.5:0/2508246941 shutdown_connections 2024-08-17T02:47:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.093+0000 7fd35f800640 1 -- 172.21.15.5:0/2508246941 wait complete. 2024-08-17T02:47:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.094+0000 7fd35f800640 1 Processor -- start 2024-08-17T02:47:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.095+0000 7fd35f800640 1 -- start start 2024-08-17T02:47:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.095+0000 7fd35f800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3580ad960 0x7fd35814b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.095+0000 7fd35f800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3580add30 0x7fd35814f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.095+0000 7fd35f800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580ca050 0x7fd358159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.095+0000 7fd35f800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd358158bc0 con 0x7fd3580ca050 2024-08-17T02:47:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.095+0000 7fd35f800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35814bc70 con 0x7fd3580add30 2024-08-17T02:47:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.095+0000 7fd35f800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd358157fb0 con 0x7fd3580ad960 2024-08-17T02:47:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.096+0000 7fd35d800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580ca050 0x7fd358159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.096+0000 7fd35d800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580ca050 0x7fd358159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40354/0 (socket says 172.21.15.5:40354) 2024-08-17T02:47:45.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.096+0000 7fd35d800640 1 -- 172.21.15.5:0/3575413530 learned_addr learned my addr 172.21.15.5:0/3575413530 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:45.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.096+0000 7fd35ce00640 1 --2- 172.21.15.5:0/3575413530 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3580ad960 0x7fd35814b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.096+0000 7fd357e00640 1 --2- 172.21.15.5:0/3575413530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3580add30 0x7fd35814f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.096+0000 7fd35d800640 1 -- 172.21.15.5:0/3575413530 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3580ad960 msgr2=0x7fd35814b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.096+0000 7fd35d800640 1 --2- 172.21.15.5:0/3575413530 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3580ad960 0x7fd35814b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.096+0000 7fd35d800640 1 -- 172.21.15.5:0/3575413530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3580add30 msgr2=0x7fd35814f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.096+0000 7fd35d800640 1 --2- 172.21.15.5:0/3575413530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3580add30 0x7fd35814f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.096+0000 7fd35d800640 1 -- 172.21.15.5:0/3575413530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c009450 con 0x7fd3580ca050 2024-08-17T02:47:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.097+0000 7fd35d800640 1 --2- 172.21.15.5:0/3575413530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580ca050 0x7fd358159570 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd350009fa0 tx=0x7fd350009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.097+0000 7fd34be00640 1 -- 172.21.15.5:0/3575413530 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35000ee60 con 0x7fd3580ca050 2024-08-17T02:47:45.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.097+0000 7fd34be00640 1 -- 172.21.15.5:0/3575413530 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd350014420 con 0x7fd3580ca050 2024-08-17T02:47:45.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.097+0000 7fd34be00640 1 -- 172.21.15.5:0/3575413530 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3500147e0 con 0x7fd3580ca050 2024-08-17T02:47:45.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.097+0000 7fd35f800640 1 -- 172.21.15.5:0/3575413530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd358158290 con 0x7fd3580ca050 2024-08-17T02:47:45.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.097+0000 7fd35f800640 1 -- 172.21.15.5:0/3575413530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd358158850 con 0x7fd3580ca050 2024-08-17T02:47:45.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.098+0000 7fd35f800640 1 -- 172.21.15.5:0/3575413530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd358158d70 con 0x7fd3580ca050 2024-08-17T02:47:45.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.099+0000 7fd34be00640 1 -- 172.21.15.5:0/3575413530 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd350014b50 con 0x7fd3580ca050 2024-08-17T02:47:45.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.100+0000 7fd34be00640 1 --2- 172.21.15.5:0/3575413530 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd338065180 0x7fd338067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.100+0000 7fd34be00640 1 -- 172.21.15.5:0/3575413530 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd350082840 con 0x7fd3580ca050 2024-08-17T02:47:45.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.100+0000 7fd35ce00640 1 --2- 172.21.15.5:0/3575413530 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd338065180 0x7fd338067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.101+0000 7fd35ce00640 1 --2- 172.21.15.5:0/3575413530 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd338065180 0x7fd338067630 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd34c034000 tx=0x7fd34c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:45.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.104+0000 7fd34be00640 1 -- 172.21.15.5:0/3575413530 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd358158d70 con 0x7fd3580ca050 2024-08-17T02:47:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.351+0000 7fd35f800640 1 -- 172.21.15.5:0/3575413530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd358063fb0 con 0x7fd3580ca050 2024-08-17T02:47:45.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.355+0000 7fd34be00640 1 -- 172.21.15.5:0/3575413530 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd350050c60 con 0x7fd3580ca050 2024-08-17T02:47:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.357+0000 7fd35f800640 1 -- 172.21.15.5:0/3575413530 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd338065180 msgr2=0x7fd338067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.357+0000 7fd35f800640 1 --2- 172.21.15.5:0/3575413530 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd338065180 0x7fd338067630 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd34c034000 tx=0x7fd34c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.357+0000 7fd35f800640 1 -- 172.21.15.5:0/3575413530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580ca050 msgr2=0x7fd358159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.357+0000 7fd35f800640 1 --2- 172.21.15.5:0/3575413530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580ca050 0x7fd358159570 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd350009fa0 tx=0x7fd350009900 comp rx=0 tx=0).stop 2024-08-17T02:47:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.357+0000 7fd35f800640 1 -- 172.21.15.5:0/3575413530 shutdown_connections 2024-08-17T02:47:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.357+0000 7fd35f800640 1 --2- 172.21.15.5:0/3575413530 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd338065180 0x7fd338067630 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.357+0000 7fd35f800640 1 --2- 172.21.15.5:0/3575413530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3580ca050 0x7fd358159570 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.357+0000 7fd35f800640 1 --2- 172.21.15.5:0/3575413530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3580add30 0x7fd35814f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.357+0000 7fd35f800640 1 --2- 172.21.15.5:0/3575413530 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3580ad960 0x7fd35814b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.357+0000 7fd35f800640 1 -- 172.21.15.5:0/3575413530 >> 172.21.15.5:0/3575413530 conn(0x7fd358066e60 msgr2=0x7fd3580aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.358+0000 7fd35f800640 1 -- 172.21.15.5:0/3575413530 shutdown_connections 2024-08-17T02:47:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.358+0000 7fd35f800640 1 -- 172.21.15.5:0/3575413530 wait complete. 2024-08-17T02:47:45.374 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:47:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.525+0000 7f5b17e00640 1 Processor -- start 2024-08-17T02:47:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.526+0000 7f5b17e00640 1 -- start start 2024-08-17T02:47:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.527+0000 7f5b17e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b180ae910 0x7f5b180aed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.527+0000 7f5b17e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b18160720 0x7f5b18162b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.527+0000 7f5b17e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b180aab10 con 0x7f5b180ae540 2024-08-17T02:47:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.527+0000 7f5b17e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b180abfb0 con 0x7f5b18160720 2024-08-17T02:47:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.527+0000 7f5b17e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180ac250 con 0x7f5b180ae910 2024-08-17T02:47:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.527+0000 7f5b17400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b18160720 0x7f5b18162b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.527+0000 7f5b17400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b18160720 0x7f5b18162b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40360/0 (socket says 172.21.15.5:40360) 2024-08-17T02:47:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.527+0000 7f5b17400640 1 -- 172.21.15.5:0/1206440901 learned_addr learned my addr 172.21.15.5:0/1206440901 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.527+0000 7f5b0fe00640 1 --2- 172.21.15.5:0/1206440901 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b180ae910 0x7f5b180aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.528+0000 7f5b17400640 1 -- 172.21.15.5:0/1206440901 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b180ae910 msgr2=0x7f5b180aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.528+0000 7f5b17400640 1 --2- 172.21.15.5:0/1206440901 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b180ae910 0x7f5b180aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.528+0000 7f5b17400640 1 -- 172.21.15.5:0/1206440901 >> v1:172.21.15.107:6789/0 conn(0x7f5b180ae540 legacy=0x7f5b18068950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.528+0000 7f5b17400640 1 -- 172.21.15.5:0/1206440901 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b180693e0 con 0x7f5b18160720 2024-08-17T02:47:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.529+0000 7f5b17400640 1 --2- 172.21.15.5:0/1206440901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b18160720 0x7f5b18162b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009f20 tx=0x7f5b10009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845c56e8832c6c05 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.529+0000 7f5b16000640 1 -- 172.21.15.5:0/1206440901 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10031400 con 0x7f5b18160720 2024-08-17T02:47:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.529+0000 7f5b16000640 1 -- 172.21.15.5:0/1206440901 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1002d050 con 0x7f5b18160720 2024-08-17T02:47:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.529+0000 7f5b16000640 1 -- 172.21.15.5:0/1206440901 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b100317d0 con 0x7f5b18160720 2024-08-17T02:47:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.529+0000 7f5b17e00640 1 -- 172.21.15.5:0/1206440901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b18160720 msgr2=0x7f5b18162b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.529+0000 7f5b17e00640 1 --2- 172.21.15.5:0/1206440901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b18160720 0x7f5b18162b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009f20 tx=0x7f5b10009840 comp rx=0 tx=0).stop 2024-08-17T02:47:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.530+0000 7f5b17e00640 1 -- 172.21.15.5:0/1206440901 shutdown_connections 2024-08-17T02:47:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.530+0000 7f5b17e00640 1 --2- 172.21.15.5:0/1206440901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b18160720 0x7f5b18162b00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.530+0000 7f5b17e00640 1 --2- 172.21.15.5:0/1206440901 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b180ae910 0x7f5b180aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.530+0000 7f5b17e00640 1 -- 172.21.15.5:0/1206440901 >> 172.21.15.5:0/1206440901 conn(0x7f5b180ce400 msgr2=0x7f5b18095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.530+0000 7f5b17e00640 1 -- 172.21.15.5:0/1206440901 shutdown_connections 2024-08-17T02:47:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.530+0000 7f5b17e00640 1 -- 172.21.15.5:0/1206440901 wait complete. 2024-08-17T02:47:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.531+0000 7f5b17e00640 1 Processor -- start 2024-08-17T02:47:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.531+0000 7f5b17e00640 1 -- start start 2024-08-17T02:47:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.532+0000 7f5b17e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b180ae540 0x7f5b18145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.532+0000 7f5b17e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b180ae910 0x7f5b18067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.532+0000 7f5b17e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b18160720 0x7f5b180684b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.532+0000 7f5b17e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1816c9e0 con 0x7f5b18160720 2024-08-17T02:47:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.532+0000 7f5b17e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1815b380 con 0x7f5b180ae540 2024-08-17T02:47:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.532+0000 7f5b17e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1816c0b0 con 0x7f5b180ae910 2024-08-17T02:47:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.532+0000 7f5b17400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b18160720 0x7f5b180684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.532+0000 7f5b17400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b18160720 0x7f5b180684b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40374/0 (socket says 172.21.15.5:40374) 2024-08-17T02:47:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.532+0000 7f5b17400640 1 -- 172.21.15.5:0/2428582120 learned_addr learned my addr 172.21.15.5:0/2428582120 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.532+0000 7f5b0fe00640 1 --2- 172.21.15.5:0/2428582120 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b180ae910 0x7f5b18067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.532+0000 7f5b16a00640 1 --2- 172.21.15.5:0/2428582120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b180ae540 0x7f5b18145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.533+0000 7f5b17400640 1 -- 172.21.15.5:0/2428582120 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b180ae910 msgr2=0x7f5b18067f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.533+0000 7f5b17400640 1 --2- 172.21.15.5:0/2428582120 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b180ae910 0x7f5b18067f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.533+0000 7f5b17400640 1 -- 172.21.15.5:0/2428582120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b180ae540 msgr2=0x7f5b18145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.533+0000 7f5b17400640 1 --2- 172.21.15.5:0/2428582120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b180ae540 0x7f5b18145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.533+0000 7f5b17400640 1 -- 172.21.15.5:0/2428582120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b10009ae0 con 0x7f5b18160720 2024-08-17T02:47:45.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.533+0000 7f5b17400640 1 --2- 172.21.15.5:0/2428582120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b18160720 0x7f5b180684b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009f80 tx=0x7f5b10036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:45.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.533+0000 7f5b0e000640 1 -- 172.21.15.5:0/2428582120 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10008e50 con 0x7f5b18160720 2024-08-17T02:47:45.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.533+0000 7f5b0e000640 1 -- 172.21.15.5:0/2428582120 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1003b410 con 0x7f5b18160720 2024-08-17T02:47:45.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.533+0000 7f5b0e000640 1 -- 172.21.15.5:0/2428582120 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1003b7d0 con 0x7f5b18160720 2024-08-17T02:47:45.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.533+0000 7f5b17e00640 1 -- 172.21.15.5:0/2428582120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1816c390 con 0x7f5b18160720 2024-08-17T02:47:45.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.533+0000 7f5b17e00640 1 -- 172.21.15.5:0/2428582120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1815a470 con 0x7f5b18160720 2024-08-17T02:47:45.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.534+0000 7f5b17e00640 1 -- 172.21.15.5:0/2428582120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b18070720 con 0x7f5b18160720 2024-08-17T02:47:45.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.535+0000 7f5b0e000640 1 -- 172.21.15.5:0/2428582120 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5b10038050 con 0x7f5b18160720 2024-08-17T02:47:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.536+0000 7f5b0e000640 1 --2- 172.21.15.5:0/2428582120 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5af4065150 0x7f5af4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.536+0000 7f5b0e000640 1 -- 172.21.15.5:0/2428582120 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5b100a2d90 con 0x7f5b18160720 2024-08-17T02:47:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.536+0000 7f5b16a00640 1 --2- 172.21.15.5:0/2428582120 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5af4065150 0x7f5af4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.537+0000 7f5b16a00640 1 --2- 172.21.15.5:0/2428582120 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5af4065150 0x7f5af4067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b08007fd0 tx=0x7f5b08007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.540+0000 7f5b0e000640 1 -- 172.21.15.5:0/2428582120 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5b100711b0 con 0x7f5b18160720 2024-08-17T02:47:45.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.787+0000 7f5b17e00640 1 -- 172.21.15.5:0/2428582120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f5b1806c620 con 0x7f5b18160720 2024-08-17T02:47:45.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.791+0000 7f5b0e000640 1 -- 172.21.15.5:0/2428582120 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5b100747d0 con 0x7f5b18160720 2024-08-17T02:47:45.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.794+0000 7f5b17e00640 1 -- 172.21.15.5:0/2428582120 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5af4065150 msgr2=0x7f5af4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.794+0000 7f5b17e00640 1 --2- 172.21.15.5:0/2428582120 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5af4065150 0x7f5af4067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b08007fd0 tx=0x7f5b08007e30 comp rx=0 tx=0).stop 2024-08-17T02:47:45.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.794+0000 7f5b17e00640 1 -- 172.21.15.5:0/2428582120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b18160720 msgr2=0x7f5b180684b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.794+0000 7f5b17e00640 1 --2- 172.21.15.5:0/2428582120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b18160720 0x7f5b180684b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009f80 tx=0x7f5b10036000 comp rx=0 tx=0).stop 2024-08-17T02:47:45.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.794+0000 7f5b17e00640 1 -- 172.21.15.5:0/2428582120 shutdown_connections 2024-08-17T02:47:45.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.794+0000 7f5b17e00640 1 --2- 172.21.15.5:0/2428582120 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5af4065150 0x7f5af4067600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.794+0000 7f5b17e00640 1 --2- 172.21.15.5:0/2428582120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b18160720 0x7f5b180684b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.794+0000 7f5b17e00640 1 --2- 172.21.15.5:0/2428582120 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5b180ae910 0x7f5b18067f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.794+0000 7f5b17e00640 1 --2- 172.21.15.5:0/2428582120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b180ae540 0x7f5b18145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.794+0000 7f5b17e00640 1 -- 172.21.15.5:0/2428582120 >> 172.21.15.5:0/2428582120 conn(0x7f5b180ce400 msgr2=0x7f5b1806cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:45.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.794+0000 7f5b17e00640 1 -- 172.21.15.5:0/2428582120 shutdown_connections 2024-08-17T02:47:45.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.794+0000 7f5b17e00640 1 -- 172.21.15.5:0/2428582120 wait complete. 2024-08-17T02:47:45.810 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:47:45.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.961+0000 7f2d45000640 1 Processor -- start 2024-08-17T02:47:45.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.961+0000 7f2d45000640 1 -- start start 2024-08-17T02:47:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.962+0000 7f2d45000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2d400abdf0 0x7f2d40159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.962+0000 7f2d45000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d400ad370 0x7f2d400c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.962+0000 7f2d45000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d400c92b0 con 0x7f2d401599b0 2024-08-17T02:47:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.962+0000 7f2d45000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d400c8ca0 con 0x7f2d400abdf0 2024-08-17T02:47:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.962+0000 7f2d45000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d40159ec0 con 0x7f2d400ad370 2024-08-17T02:47:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.962+0000 7f2d37e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2d401599b0 0x7f2d400acc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58832/0 (socket says 172.21.15.5:58832) 2024-08-17T02:47:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.962+0000 7f2d37e00640 1 -- 172.21.15.5:0/1139027134 learned_addr learned my addr 172.21.15.5:0/1139027134 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3f400640 1 --2- 172.21.15.5:0/1139027134 >> v2:172.21.15.107:3300/0 conn(0x7f2d400abdf0 0x7f2d40159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3fe00640 1 --2- 172.21.15.5:0/1139027134 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d400ad370 0x7f2d400c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3ea00640 1 -- 172.21.15.5:0/1139027134 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643542564 0 0) 0x7f2d400c92b0 con 0x7f2d401599b0 2024-08-17T02:47:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3ea00640 1 -- 172.21.15.5:0/1139027134 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d240034e0 con 0x7f2d401599b0 2024-08-17T02:47:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3ea00640 1 -- 172.21.15.5:0/1139027134 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2113725792 0 0) 0x7f2d240034e0 con 0x7f2d401599b0 2024-08-17T02:47:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3ea00640 1 -- 172.21.15.5:0/1139027134 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d400ad370 msgr2=0x7f2d400c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3ea00640 1 --2- 172.21.15.5:0/1139027134 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d400ad370 0x7f2d400c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3ea00640 1 -- 172.21.15.5:0/1139027134 >> v2:172.21.15.107:3300/0 conn(0x7f2d400abdf0 msgr2=0x7f2d40159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3ea00640 1 --2- 172.21.15.5:0/1139027134 >> v2:172.21.15.107:3300/0 conn(0x7f2d400abdf0 0x7f2d40159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3ea00640 1 -- 172.21.15.5:0/1139027134 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4015a1a0 con 0x7f2d401599b0 2024-08-17T02:47:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3ea00640 1 -- 172.21.15.5:0/1139027134 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7f2d28001470 con 0x7f2d401599b0 2024-08-17T02:47:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3ea00640 1 -- 172.21.15.5:0/1139027134 >> v1:172.21.15.5:6789/0 conn(0x7f2d401599b0 legacy=0x7f2d400acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3ea00640 1 --2- 172.21.15.5:0/1139027134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d24003a50 0x7f2d24003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3ea00640 1 --2- 172.21.15.5:0/1139027134 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d400ad370 0x7f2d24004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3ea00640 1 --2- 172.21.15.5:0/1139027134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d24004cc0 0x7f2d24005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3ea00640 1 -- 172.21.15.5:0/1139027134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d400c8ca0 con 0x7f2d24003a50 2024-08-17T02:47:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3ea00640 1 -- 172.21.15.5:0/1139027134 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d40159ec0 con 0x7f2d24004cc0 2024-08-17T02:47:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3ea00640 1 -- 172.21.15.5:0/1139027134 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2400dc90 con 0x7f2d400ad370 2024-08-17T02:47:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.963+0000 7f2d3f400640 1 --2- 172.21.15.5:0/1139027134 >> v2:172.21.15.107:3300/0 conn(0x7f2d400abdf0 0x7f2d40159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.964+0000 7f2d37e00640 1 --2- 172.21.15.5:0/1139027134 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d400ad370 0x7f2d24004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.964+0000 7f2d3fe00640 1 --2- 172.21.15.5:0/1139027134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d24004cc0 0x7f2d24005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.964+0000 7f2d3f400640 1 --2- 172.21.15.5:0/1139027134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d24003a50 0x7f2d24003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.964+0000 7f2d3fe00640 1 -- 172.21.15.5:0/1139027134 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d400ad370 msgr2=0x7f2d24004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.964+0000 7f2d3fe00640 1 --2- 172.21.15.5:0/1139027134 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d400ad370 0x7f2d24004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.964+0000 7f2d3fe00640 1 -- 172.21.15.5:0/1139027134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d24003a50 msgr2=0x7f2d24003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.964+0000 7f2d3fe00640 1 --2- 172.21.15.5:0/1139027134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d24003a50 0x7f2d24003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.964+0000 7f2d3fe00640 1 -- 172.21.15.5:0/1139027134 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d240034e0 con 0x7f2d24004cc0 2024-08-17T02:47:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.964+0000 7f2d3f400640 1 --2- 172.21.15.5:0/1139027134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d24003a50 0x7f2d24003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.965+0000 7f2d3fe00640 1 --2- 172.21.15.5:0/1139027134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d24004cc0 0x7f2d24005130 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2d400ad770 tx=0x7f2d3800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce7a869b624fdfbc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.965+0000 7f2d3ea00640 1 -- 172.21.15.5:0/1139027134 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38031420 con 0x7f2d24004cc0 2024-08-17T02:47:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.965+0000 7f2d3ea00640 1 -- 172.21.15.5:0/1139027134 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3800f040 con 0x7f2d24004cc0 2024-08-17T02:47:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.965+0000 7f2d3ea00640 1 -- 172.21.15.5:0/1139027134 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d380317b0 con 0x7f2d24004cc0 2024-08-17T02:47:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.966+0000 7f2d45000640 1 -- 172.21.15.5:0/1139027134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d24004cc0 msgr2=0x7f2d24005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.966+0000 7f2d45000640 1 --2- 172.21.15.5:0/1139027134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d24004cc0 0x7f2d24005130 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2d400ad770 tx=0x7f2d3800b040 comp rx=0 tx=0).stop 2024-08-17T02:47:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.966+0000 7f2d3fe00640 1 -- 172.21.15.5:0/1139027134 reap_dead start 2024-08-17T02:47:45.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.966+0000 7f2d45000640 1 -- 172.21.15.5:0/1139027134 shutdown_connections 2024-08-17T02:47:45.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.966+0000 7f2d45000640 1 -- 172.21.15.5:0/1139027134 >> 172.21.15.5:0/1139027134 conn(0x7f2d40066e60 msgr2=0x7f2d40067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:45.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.966+0000 7f2d45000640 1 -- 172.21.15.5:0/1139027134 shutdown_connections 2024-08-17T02:47:45.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.966+0000 7f2d45000640 1 -- 172.21.15.5:0/1139027134 wait complete. 2024-08-17T02:47:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.967+0000 7f2d45000640 1 Processor -- start 2024-08-17T02:47:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.968+0000 7f2d45000640 1 -- start start 2024-08-17T02:47:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.968+0000 7f2d45000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d24004cc0 0x7f2d40157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.968+0000 7f2d45000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d40165b80 0x7f2d400c1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.968+0000 7f2d45000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d4014fc50 0x7f2d400aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.968+0000 7f2d45000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d400c1980 con 0x7f2d40165b80 2024-08-17T02:47:45.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.968+0000 7f2d45000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d40165ff0 con 0x7f2d24004cc0 2024-08-17T02:47:45.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.968+0000 7f2d45000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d401650c0 con 0x7f2d4014fc50 2024-08-17T02:47:45.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.969+0000 7f2d37e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d40165b80 0x7f2d400c1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.969+0000 7f2d37e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d40165b80 0x7f2d400c1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47610/0 (socket says 172.21.15.5:47610) 2024-08-17T02:47:45.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.969+0000 7f2d37e00640 1 -- 172.21.15.5:0/2236224882 learned_addr learned my addr 172.21.15.5:0/2236224882 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:45.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.969+0000 7f2d3f400640 1 --2- 172.21.15.5:0/2236224882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d24004cc0 0x7f2d40157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.969+0000 7f2d3fe00640 1 --2- 172.21.15.5:0/2236224882 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d4014fc50 0x7f2d400aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.969+0000 7f2d37e00640 1 -- 172.21.15.5:0/2236224882 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d4014fc50 msgr2=0x7f2d400aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.969+0000 7f2d37e00640 1 --2- 172.21.15.5:0/2236224882 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d4014fc50 0x7f2d400aea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.969+0000 7f2d37e00640 1 -- 172.21.15.5:0/2236224882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d24004cc0 msgr2=0x7f2d40157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:45.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.969+0000 7f2d37e00640 1 --2- 172.21.15.5:0/2236224882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d24004cc0 0x7f2d40157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:45.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.969+0000 7f2d37e00640 1 -- 172.21.15.5:0/2236224882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d400c1b90 con 0x7f2d40165b80 2024-08-17T02:47:45.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.970+0000 7f2d37e00640 1 --2- 172.21.15.5:0/2236224882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d40165b80 0x7f2d400c1440 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2d28004ad0 tx=0x7f2d28001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:45.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.970+0000 7f2d36a00640 1 -- 172.21.15.5:0/2236224882 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2800f9c0 con 0x7f2d40165b80 2024-08-17T02:47:45.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.970+0000 7f2d36a00640 1 -- 172.21.15.5:0/2236224882 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2800fb40 con 0x7f2d40165b80 2024-08-17T02:47:45.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.970+0000 7f2d45000640 1 -- 172.21.15.5:0/2236224882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d400c1e70 con 0x7f2d40165b80 2024-08-17T02:47:45.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.970+0000 7f2d36a00640 1 -- 172.21.15.5:0/2236224882 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280133f0 con 0x7f2d40165b80 2024-08-17T02:47:45.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.970+0000 7f2d45000640 1 -- 172.21.15.5:0/2236224882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d40165660 con 0x7f2d40165b80 2024-08-17T02:47:45.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.971+0000 7f2d45000640 1 -- 172.21.15.5:0/2236224882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d401658b0 con 0x7f2d40165b80 2024-08-17T02:47:45.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.972+0000 7f2d36a00640 1 -- 172.21.15.5:0/2236224882 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2d280137a0 con 0x7f2d40165b80 2024-08-17T02:47:45.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.973+0000 7f2d36a00640 1 --2- 172.21.15.5:0/2236224882 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2d1c065150 0x7f2d1c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:45.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.973+0000 7f2d36a00640 1 -- 172.21.15.5:0/2236224882 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2d280822b0 con 0x7f2d40165b80 2024-08-17T02:47:45.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.973+0000 7f2d3f400640 1 --2- 172.21.15.5:0/2236224882 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2d1c065150 0x7f2d1c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:45.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.974+0000 7f2d3f400640 1 --2- 172.21.15.5:0/2236224882 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2d1c065150 0x7f2d1c067600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2d40168600 tx=0x7f2d300090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:45.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:45.977+0000 7f2d36a00640 1 -- 172.21.15.5:0/2236224882 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2d280506d0 con 0x7f2d40165b80 2024-08-17T02:47:46.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.223+0000 7f2d45000640 1 -- 172.21.15.5:0/2236224882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f2d40070720 con 0x7f2d40165b80 2024-08-17T02:47:46.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.227+0000 7f2d36a00640 1 -- 172.21.15.5:0/2236224882 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2d2800e1c0 con 0x7f2d40165b80 2024-08-17T02:47:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.229+0000 7f2d45000640 1 -- 172.21.15.5:0/2236224882 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2d1c065150 msgr2=0x7f2d1c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.229+0000 7f2d45000640 1 --2- 172.21.15.5:0/2236224882 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2d1c065150 0x7f2d1c067600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2d40168600 tx=0x7f2d300090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.229+0000 7f2d45000640 1 -- 172.21.15.5:0/2236224882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d40165b80 msgr2=0x7f2d400c1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.229+0000 7f2d45000640 1 --2- 172.21.15.5:0/2236224882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d40165b80 0x7f2d400c1440 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2d28004ad0 tx=0x7f2d28001dc0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.229+0000 7f2d45000640 1 -- 172.21.15.5:0/2236224882 shutdown_connections 2024-08-17T02:47:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.229+0000 7f2d45000640 1 --2- 172.21.15.5:0/2236224882 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2d1c065150 0x7f2d1c067600 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.229+0000 7f2d45000640 1 --2- 172.21.15.5:0/2236224882 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d4014fc50 0x7f2d400aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.229+0000 7f2d45000640 1 --2- 172.21.15.5:0/2236224882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d40165b80 0x7f2d400c1440 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.229+0000 7f2d45000640 1 --2- 172.21.15.5:0/2236224882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d24004cc0 0x7f2d40157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.229+0000 7f2d45000640 1 -- 172.21.15.5:0/2236224882 >> 172.21.15.5:0/2236224882 conn(0x7f2d40066e60 msgr2=0x7f2d40151b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:46.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.230+0000 7f2d45000640 1 -- 172.21.15.5:0/2236224882 shutdown_connections 2024-08-17T02:47:46.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.230+0000 7f2d45000640 1 -- 172.21.15.5:0/2236224882 wait complete. 2024-08-17T02:47:46.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:47:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.396+0000 7f3387400640 1 Processor -- start 2024-08-17T02:47:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.396+0000 7f3387400640 1 -- start start 2024-08-17T02:47:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.397+0000 7f3387400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3380159120 0x7f33800ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.397+0000 7f3387400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33800abe30 0x7f33800aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.397+0000 7f3387400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33800a96c0 con 0x7f3380158d50 2024-08-17T02:47:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.397+0000 7f3387400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33800acf00 con 0x7f33800abe30 2024-08-17T02:47:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.397+0000 7f3387400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33800ac230 con 0x7f3380159120 2024-08-17T02:47:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.397+0000 7f3385400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33800abe30 0x7f33800aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.397+0000 7f3384a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3380158d50 0x7f33800ac4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58844/0 (socket says 172.21.15.5:58844) 2024-08-17T02:47:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.397+0000 7f3384a00640 1 -- 172.21.15.5:0/2700735389 learned_addr learned my addr 172.21.15.5:0/2700735389 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.398+0000 7f337fe00640 1 --2- 172.21.15.5:0/2700735389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3380159120 0x7f33800ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.398+0000 7f3385400640 1 -- 172.21.15.5:0/2700735389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3380159120 msgr2=0x7f33800ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.398+0000 7f3385400640 1 --2- 172.21.15.5:0/2700735389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3380159120 0x7f33800ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.398+0000 7f3385400640 1 -- 172.21.15.5:0/2700735389 >> v1:172.21.15.5:6789/0 conn(0x7f3380158d50 legacy=0x7f33800ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.398+0000 7f3385400640 1 -- 172.21.15.5:0/2700735389 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33800af7d0 con 0x7f33800abe30 2024-08-17T02:47:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.398+0000 7f337f400640 1 -- 172.21.15.5:0/2700735389 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168212560 0 0) 0x7f33800a96c0 con 0x7f3380158d50 2024-08-17T02:47:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.398+0000 7f337fe00640 1 --2- 172.21.15.5:0/2700735389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3380159120 0x7f33800ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.399+0000 7f3385400640 1 --2- 172.21.15.5:0/2700735389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33800abe30 0x7f33800aa3d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3378009e60 tx=0x7f3378009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f033a409dc08871 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.399+0000 7f337f400640 1 -- 172.21.15.5:0/2700735389 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378007550 con 0x7f33800abe30 2024-08-17T02:47:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.399+0000 7f337f400640 1 -- 172.21.15.5:0/2700735389 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337802d050 con 0x7f33800abe30 2024-08-17T02:47:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.399+0000 7f337f400640 1 -- 172.21.15.5:0/2700735389 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780078e0 con 0x7f33800abe30 2024-08-17T02:47:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.400+0000 7f3387400640 1 -- 172.21.15.5:0/2700735389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33800abe30 msgr2=0x7f33800aa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.400+0000 7f3387400640 1 --2- 172.21.15.5:0/2700735389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33800abe30 0x7f33800aa3d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3378009e60 tx=0x7f3378009780 comp rx=0 tx=0).stop 2024-08-17T02:47:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.400+0000 7f3387400640 1 -- 172.21.15.5:0/2700735389 shutdown_connections 2024-08-17T02:47:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.400+0000 7f3387400640 1 --2- 172.21.15.5:0/2700735389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33800abe30 0x7f33800aa3d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.400+0000 7f3387400640 1 --2- 172.21.15.5:0/2700735389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3380159120 0x7f33800ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.400+0000 7f3387400640 1 -- 172.21.15.5:0/2700735389 >> 172.21.15.5:0/2700735389 conn(0x7f3380095a70 msgr2=0x7f3380095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.400+0000 7f3387400640 1 -- 172.21.15.5:0/2700735389 shutdown_connections 2024-08-17T02:47:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.400+0000 7f3387400640 1 -- 172.21.15.5:0/2700735389 wait complete. 2024-08-17T02:47:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.401+0000 7f3387400640 1 Processor -- start 2024-08-17T02:47:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.401+0000 7f3387400640 1 -- start start 2024-08-17T02:47:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.402+0000 7f3387400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33800abe30 0x7f338015dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.402+0000 7f3387400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3380158d50 0x7f338015b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.402+0000 7f3387400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3380159120 0x7f338015be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.402+0000 7f3387400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338015d8f0 con 0x7f3380158d50 2024-08-17T02:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.402+0000 7f3387400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338015ca00 con 0x7f3380159120 2024-08-17T02:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.402+0000 7f3387400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338015cce0 con 0x7f33800abe30 2024-08-17T02:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.403+0000 7f337fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3380158d50 0x7f338015b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.403+0000 7f337fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3380158d50 0x7f338015b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47634/0 (socket says 172.21.15.5:47634) 2024-08-17T02:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.403+0000 7f337fe00640 1 -- 172.21.15.5:0/3394116120 learned_addr learned my addr 172.21.15.5:0/3394116120 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.403+0000 7f3384a00640 1 --2- 172.21.15.5:0/3394116120 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33800abe30 0x7f338015dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.403+0000 7f3385400640 1 --2- 172.21.15.5:0/3394116120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3380159120 0x7f338015be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.403+0000 7f337fe00640 1 -- 172.21.15.5:0/3394116120 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33800abe30 msgr2=0x7f338015dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.403+0000 7f337fe00640 1 --2- 172.21.15.5:0/3394116120 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33800abe30 0x7f338015dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.403+0000 7f337fe00640 1 -- 172.21.15.5:0/3394116120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3380159120 msgr2=0x7f338015be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.403+0000 7f337fe00640 1 --2- 172.21.15.5:0/3394116120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3380159120 0x7f338015be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.403+0000 7f337fe00640 1 -- 172.21.15.5:0/3394116120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3378009a20 con 0x7f3380158d50 2024-08-17T02:47:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.403+0000 7f337fe00640 1 --2- 172.21.15.5:0/3394116120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3380158d50 0x7f338015b8f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f336c00d890 tx=0x7f336c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.404+0000 7f3373e00640 1 -- 172.21.15.5:0/3394116120 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c00de80 con 0x7f3380158d50 2024-08-17T02:47:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.404+0000 7f3373e00640 1 -- 172.21.15.5:0/3394116120 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c00b8d0 con 0x7f3380158d50 2024-08-17T02:47:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.404+0000 7f3373e00640 1 -- 172.21.15.5:0/3394116120 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c00bc90 con 0x7f3380158d50 2024-08-17T02:47:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.404+0000 7f3387400640 1 -- 172.21.15.5:0/3394116120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338015cfc0 con 0x7f3380158d50 2024-08-17T02:47:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.404+0000 7f3387400640 1 -- 172.21.15.5:0/3394116120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338015d580 con 0x7f3380158d50 2024-08-17T02:47:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.405+0000 7f3387400640 1 -- 172.21.15.5:0/3394116120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3380063fb0 con 0x7f3380158d50 2024-08-17T02:47:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.406+0000 7f3373e00640 1 -- 172.21.15.5:0/3394116120 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f336c01e460 con 0x7f3380158d50 2024-08-17T02:47:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.406+0000 7f3373e00640 1 --2- 172.21.15.5:0/3394116120 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3360065150 0x7f3360067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.406+0000 7f3373e00640 1 -- 172.21.15.5:0/3394116120 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f336c082670 con 0x7f3380158d50 2024-08-17T02:47:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.407+0000 7f3384a00640 1 --2- 172.21.15.5:0/3394116120 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3360065150 0x7f3360067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.407+0000 7f3384a00640 1 --2- 172.21.15.5:0/3394116120 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3360065150 0x7f3360067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3374007160 tx=0x7f3374007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:46.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.411+0000 7f3373e00640 1 -- 172.21.15.5:0/3394116120 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f336c0545c0 con 0x7f3380158d50 2024-08-17T02:47:46.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.659+0000 7f3387400640 1 -- 172.21.15.5:0/3394116120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f338006bd70 con 0x7f3380158d50 2024-08-17T02:47:46.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.663+0000 7f3373e00640 1 -- 172.21.15.5:0/3394116120 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f336c054150 con 0x7f3380158d50 2024-08-17T02:47:46.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.665+0000 7f3387400640 1 -- 172.21.15.5:0/3394116120 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3360065150 msgr2=0x7f3360067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:46.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.665+0000 7f3387400640 1 --2- 172.21.15.5:0/3394116120 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3360065150 0x7f3360067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3374007160 tx=0x7f3374007ec0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.665+0000 7f3387400640 1 -- 172.21.15.5:0/3394116120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3380158d50 msgr2=0x7f338015b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:46.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.665+0000 7f3387400640 1 --2- 172.21.15.5:0/3394116120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3380158d50 0x7f338015b8f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f336c00d890 tx=0x7f336c008040 comp rx=0 tx=0).stop 2024-08-17T02:47:46.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.665+0000 7f3387400640 1 -- 172.21.15.5:0/3394116120 shutdown_connections 2024-08-17T02:47:46.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.665+0000 7f3387400640 1 --2- 172.21.15.5:0/3394116120 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3360065150 0x7f3360067600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.665+0000 7f3387400640 1 --2- 172.21.15.5:0/3394116120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3380159120 0x7f338015be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.665+0000 7f3387400640 1 --2- 172.21.15.5:0/3394116120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3380158d50 0x7f338015b8f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.665+0000 7f3387400640 1 --2- 172.21.15.5:0/3394116120 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f33800abe30 0x7f338015dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.666+0000 7f3387400640 1 -- 172.21.15.5:0/3394116120 >> 172.21.15.5:0/3394116120 conn(0x7f3380095a70 msgr2=0x7f33800b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:46.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.666+0000 7f3387400640 1 -- 172.21.15.5:0/3394116120 shutdown_connections 2024-08-17T02:47:46.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.666+0000 7f3387400640 1 -- 172.21.15.5:0/3394116120 wait complete. 2024-08-17T02:47:46.682 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:46.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.832+0000 7f8b00c00640 1 Processor -- start 2024-08-17T02:47:46.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.832+0000 7f8b00c00640 1 -- start start 2024-08-17T02:47:46.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.833+0000 7f8b00c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8afc0aea20 0x7f8afc0aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:46.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.833+0000 7f8b00c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8afc0af3a0 con 0x7f8afc158b90 2024-08-17T02:47:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.833+0000 7f8b00c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8afc0afd20 con 0x7f8afc0ca8e0 2024-08-17T02:47:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.833+0000 7f8b00c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8afc0affe0 con 0x7f8afc0aea20 2024-08-17T02:47:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.834+0000 7f8af9e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8afc158b90 0x7f8afc0b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58850/0 (socket says 172.21.15.5:58850) 2024-08-17T02:47:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.834+0000 7f8af9e00640 1 -- 172.21.15.5:0/3049885288 learned_addr learned my addr 172.21.15.5:0/3049885288 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.834+0000 7f8af3e00640 1 --2- 172.21.15.5:0/3049885288 >> v2:172.21.15.107:3300/0 conn(0x7f8afc0aea20 0x7f8afc0aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.834+0000 7f8af9400640 1 -- 172.21.15.5:0/3049885288 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532925791 0 0) 0x7f8afc0af3a0 con 0x7f8afc158b90 2024-08-17T02:47:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.834+0000 7f8af9400640 1 -- 172.21.15.5:0/3049885288 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae00034e0 con 0x7f8afc158b90 2024-08-17T02:47:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.834+0000 7f8af3e00640 1 -- 172.21.15.5:0/3049885288 >> v1:172.21.15.107:6789/0 conn(0x7f8afc0ca8e0 legacy=0x7f8afc0cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.834+0000 7f8af3e00640 1 -- 172.21.15.5:0/3049885288 >> v1:172.21.15.5:6789/0 conn(0x7f8afc158b90 legacy=0x7f8afc0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.834+0000 7f8af3e00640 1 -- 172.21.15.5:0/3049885288 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc0b02c0 con 0x7f8afc0aea20 2024-08-17T02:47:46.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.835+0000 7f8af3e00640 1 --2- 172.21.15.5:0/3049885288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8afc0aea20 0x7f8afc0aee60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4009850 tx=0x7f8ae40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=806b2c6276b34998 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:46.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.836+0000 7f8af9400640 1 -- 172.21.15.5:0/3049885288 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae402ae20 con 0x7f8afc0aea20 2024-08-17T02:47:46.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.836+0000 7f8af9400640 1 -- 172.21.15.5:0/3049885288 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae4032440 con 0x7f8afc0aea20 2024-08-17T02:47:46.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.836+0000 7f8af9400640 1 -- 172.21.15.5:0/3049885288 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae40327c0 con 0x7f8afc0aea20 2024-08-17T02:47:46.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.836+0000 7f8b00c00640 1 -- 172.21.15.5:0/3049885288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8afc0aea20 msgr2=0x7f8afc0aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:46.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.836+0000 7f8b00c00640 1 --2- 172.21.15.5:0/3049885288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8afc0aea20 0x7f8afc0aee60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4009850 tx=0x7f8ae40090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.836+0000 7f8b00c00640 1 -- 172.21.15.5:0/3049885288 shutdown_connections 2024-08-17T02:47:46.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.836+0000 7f8b00c00640 1 --2- 172.21.15.5:0/3049885288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8afc0aea20 0x7f8afc0aee60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.836+0000 7f8b00c00640 1 -- 172.21.15.5:0/3049885288 >> 172.21.15.5:0/3049885288 conn(0x7f8afc06e590 msgr2=0x7f8afc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:46.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.836+0000 7f8b00c00640 1 -- 172.21.15.5:0/3049885288 shutdown_connections 2024-08-17T02:47:46.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.836+0000 7f8b00c00640 1 -- 172.21.15.5:0/3049885288 wait complete. 2024-08-17T02:47:46.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.838+0000 7f8b00c00640 1 Processor -- start 2024-08-17T02:47:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.838+0000 7f8b00c00640 1 -- start start 2024-08-17T02:47:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.839+0000 7f8b00c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8afc0aea20 0x7f8afc15a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.839+0000 7f8b00c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8afc0ca8e0 0x7f8afc0c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.839+0000 7f8b00c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8afc158b90 0x7f8afc0c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.839+0000 7f8b00c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc159ce0 con 0x7f8afc0aea20 2024-08-17T02:47:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.839+0000 7f8b00c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc159110 con 0x7f8afc158b90 2024-08-17T02:47:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.839+0000 7f8b00c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc1593b0 con 0x7f8afc0ca8e0 2024-08-17T02:47:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.839+0000 7f8af9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8afc0aea20 0x7f8afc15a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.839+0000 7f8af9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8afc0aea20 0x7f8afc15a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47636/0 (socket says 172.21.15.5:47636) 2024-08-17T02:47:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.839+0000 7f8af9e00640 1 -- 172.21.15.5:0/1532178873 learned_addr learned my addr 172.21.15.5:0/1532178873 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.839+0000 7f8af3e00640 1 --2- 172.21.15.5:0/1532178873 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8afc0ca8e0 0x7f8afc0c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.839+0000 7f8af9e00640 1 -- 172.21.15.5:0/1532178873 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8afc0ca8e0 msgr2=0x7f8afc0c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.840+0000 7f8af9e00640 1 --2- 172.21.15.5:0/1532178873 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8afc0ca8e0 0x7f8afc0c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.840+0000 7f8af9e00640 1 -- 172.21.15.5:0/1532178873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8afc158b90 msgr2=0x7f8afc0c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.840+0000 7f8afa800640 1 --2- 172.21.15.5:0/1532178873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8afc158b90 0x7f8afc0c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.840+0000 7f8af9e00640 1 --2- 172.21.15.5:0/1532178873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8afc158b90 0x7f8afc0c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.840+0000 7f8af9e00640 1 -- 172.21.15.5:0/1532178873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae4009390 con 0x7f8afc0aea20 2024-08-17T02:47:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.840+0000 7f8af3e00640 1 --2- 172.21.15.5:0/1532178873 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8afc0ca8e0 0x7f8afc0c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.840+0000 7f8afa800640 1 --2- 172.21.15.5:0/1532178873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8afc158b90 0x7f8afc0c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.840+0000 7f8af9e00640 1 --2- 172.21.15.5:0/1532178873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8afc0aea20 0x7f8afc15a170 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00c590 tx=0x7f8aec007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.840+0000 7f8af1600640 1 -- 172.21.15.5:0/1532178873 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec005aa0 con 0x7f8afc0aea20 2024-08-17T02:47:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.840+0000 7f8af1600640 1 -- 172.21.15.5:0/1532178873 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec005c40 con 0x7f8afc0aea20 2024-08-17T02:47:46.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.840+0000 7f8b00c00640 1 -- 172.21.15.5:0/1532178873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8afc159690 con 0x7f8afc0aea20 2024-08-17T02:47:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.840+0000 7f8af1600640 1 -- 172.21.15.5:0/1532178873 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec0070f0 con 0x7f8afc0aea20 2024-08-17T02:47:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.840+0000 7f8b00c00640 1 -- 172.21.15.5:0/1532178873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8afc15a6b0 con 0x7f8afc0aea20 2024-08-17T02:47:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.841+0000 7f8b00c00640 1 -- 172.21.15.5:0/1532178873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8afc063fb0 con 0x7f8afc0aea20 2024-08-17T02:47:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.842+0000 7f8af1600640 1 -- 172.21.15.5:0/1532178873 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8aec007520 con 0x7f8afc0aea20 2024-08-17T02:47:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.843+0000 7f8af1600640 1 --2- 172.21.15.5:0/1532178873 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8ad8065150 0x7f8ad8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.843+0000 7f8af1600640 1 -- 172.21.15.5:0/1532178873 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8aec081c60 con 0x7f8afc0aea20 2024-08-17T02:47:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.843+0000 7f8af3e00640 1 --2- 172.21.15.5:0/1532178873 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8ad8065150 0x7f8ad8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:46.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.844+0000 7f8af3e00640 1 --2- 172.21.15.5:0/1532178873 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8ad8065150 0x7f8ad8067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4034000 tx=0x7f8ae4032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:46.846+0000 7f8af1600640 1 -- 172.21.15.5:0/1532178873 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8aec050050 con 0x7f8afc0aea20 2024-08-17T02:47:47.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.030+0000 7f8b00c00640 1 -- 172.21.15.5:0/1532178873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8afc0af270 con 0x7f8afc0aea20 2024-08-17T02:47:47.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.030+0000 7f8af1600640 1 -- 172.21.15.5:0/1532178873 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12086 (secure 0 0 0) 0x7f8aec053670 con 0x7f8afc0aea20 2024-08-17T02:47:47.032 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:47.032 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":28,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:47:43.601504+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:47.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.033+0000 7f8b00c00640 1 -- 172.21.15.5:0/1532178873 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8ad8065150 msgr2=0x7f8ad8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.033+0000 7f8b00c00640 1 --2- 172.21.15.5:0/1532178873 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8ad8065150 0x7f8ad8067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4034000 tx=0x7f8ae4032000 comp rx=0 tx=0).stop 2024-08-17T02:47:47.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.033+0000 7f8b00c00640 1 -- 172.21.15.5:0/1532178873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8afc0aea20 msgr2=0x7f8afc15a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.033+0000 7f8b00c00640 1 --2- 172.21.15.5:0/1532178873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8afc0aea20 0x7f8afc15a170 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00c590 tx=0x7f8aec007d40 comp rx=0 tx=0).stop 2024-08-17T02:47:47.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.033+0000 7f8b00c00640 1 -- 172.21.15.5:0/1532178873 shutdown_connections 2024-08-17T02:47:47.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.033+0000 7f8b00c00640 1 --2- 172.21.15.5:0/1532178873 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8ad8065150 0x7f8ad8067600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.033+0000 7f8b00c00640 1 --2- 172.21.15.5:0/1532178873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8afc158b90 0x7f8afc0c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.033+0000 7f8b00c00640 1 --2- 172.21.15.5:0/1532178873 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8afc0ca8e0 0x7f8afc0c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.033+0000 7f8b00c00640 1 --2- 172.21.15.5:0/1532178873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8afc0aea20 0x7f8afc15a170 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.033+0000 7f8b00c00640 1 -- 172.21.15.5:0/1532178873 >> 172.21.15.5:0/1532178873 conn(0x7f8afc06e590 msgr2=0x7f8afc158440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:47.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.033+0000 7f8b00c00640 1 -- 172.21.15.5:0/1532178873 shutdown_connections 2024-08-17T02:47:47.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.033+0000 7f8b00c00640 1 -- 172.21.15.5:0/1532178873 wait complete. 2024-08-17T02:47:47.050 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:47.106425+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:47:47.050 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.203+0000 7ff81fe00640 1 Processor -- start 2024-08-17T02:47:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.203+0000 7ff81fe00640 1 -- start start 2024-08-17T02:47:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.204+0000 7ff81fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff818158be0 0x7ff8180a9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.204+0000 7ff81fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff81809a590 0x7ff8180af920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.204+0000 7ff81fe00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff81815d730 con 0x7ff8180a9cb0 2024-08-17T02:47:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.204+0000 7ff81fe00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81815cb20 con 0x7ff81809a590 2024-08-17T02:47:47.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.204+0000 7ff81fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81815ce00 con 0x7ff818158be0 2024-08-17T02:47:47.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.204+0000 7ff81ca00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff8180a9cb0 0x7ff818099e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58862/0 (socket says 172.21.15.5:58862) 2024-08-17T02:47:47.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.204+0000 7ff81ca00640 1 -- 172.21.15.5:0/2277742077 learned_addr learned my addr 172.21.15.5:0/2277742077 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:47.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.204+0000 7ff81d400640 1 --2- 172.21.15.5:0/2277742077 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff818158be0 0x7ff8180a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.204+0000 7ff81de00640 1 --2- 172.21.15.5:0/2277742077 >> v2:172.21.15.107:3300/0 conn(0x7ff81809a590 0x7ff8180af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.205+0000 7ff817e00640 1 -- 172.21.15.5:0/2277742077 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691023675 0 0) 0x7ff81815d730 con 0x7ff8180a9cb0 2024-08-17T02:47:47.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.205+0000 7ff817e00640 1 -- 172.21.15.5:0/2277742077 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8000034e0 con 0x7ff8180a9cb0 2024-08-17T02:47:47.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.205+0000 7ff81de00640 1 -- 172.21.15.5:0/2277742077 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff818158be0 msgr2=0x7ff8180a9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:47.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.205+0000 7ff81de00640 1 --2- 172.21.15.5:0/2277742077 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff818158be0 0x7ff8180a9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.205+0000 7ff81de00640 1 -- 172.21.15.5:0/2277742077 >> v1:172.21.15.5:6789/0 conn(0x7ff8180a9cb0 legacy=0x7ff818099e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.205+0000 7ff81de00640 1 -- 172.21.15.5:0/2277742077 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81815d0e0 con 0x7ff81809a590 2024-08-17T02:47:47.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.205+0000 7ff81d400640 1 --2- 172.21.15.5:0/2277742077 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff818158be0 0x7ff8180a9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.206+0000 7ff81de00640 1 --2- 172.21.15.5:0/2277742077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff81809a590 0x7ff8180af920 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff810009e60 tx=0x7ff810009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a02887f1094a5023 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.207+0000 7ff817e00640 1 -- 172.21.15.5:0/2277742077 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff810007550 con 0x7ff81809a590 2024-08-17T02:47:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.207+0000 7ff817e00640 1 -- 172.21.15.5:0/2277742077 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81002d050 con 0x7ff81809a590 2024-08-17T02:47:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.207+0000 7ff817e00640 1 -- 172.21.15.5:0/2277742077 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff810007920 con 0x7ff81809a590 2024-08-17T02:47:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.207+0000 7ff81fe00640 1 -- 172.21.15.5:0/2277742077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff81809a590 msgr2=0x7ff8180af920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.207+0000 7ff81fe00640 1 --2- 172.21.15.5:0/2277742077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff81809a590 0x7ff8180af920 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff810009e60 tx=0x7ff810009780 comp rx=0 tx=0).stop 2024-08-17T02:47:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.207+0000 7ff81fe00640 1 -- 172.21.15.5:0/2277742077 shutdown_connections 2024-08-17T02:47:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.207+0000 7ff81fe00640 1 --2- 172.21.15.5:0/2277742077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff81809a590 0x7ff8180af920 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.207+0000 7ff81fe00640 1 --2- 172.21.15.5:0/2277742077 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff818158be0 0x7ff8180a9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.207+0000 7ff81fe00640 1 -- 172.21.15.5:0/2277742077 >> 172.21.15.5:0/2277742077 conn(0x7ff8180b1cd0 msgr2=0x7ff8180b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.207+0000 7ff81fe00640 1 -- 172.21.15.5:0/2277742077 shutdown_connections 2024-08-17T02:47:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.207+0000 7ff81fe00640 1 -- 172.21.15.5:0/2277742077 wait complete. 2024-08-17T02:47:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.209+0000 7ff81fe00640 1 Processor -- start 2024-08-17T02:47:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.209+0000 7ff81fe00640 1 -- start start 2024-08-17T02:47:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.210+0000 7ff81fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff81809a590 0x7ff818158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.210+0000 7ff81fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8180a9cb0 0x7ff81816d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.210+0000 7ff81fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff818158be0 0x7ff81815a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.210+0000 7ff81fe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81816d940 con 0x7ff8180a9cb0 2024-08-17T02:47:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.210+0000 7ff81fe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81815ac90 con 0x7ff818158be0 2024-08-17T02:47:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.210+0000 7ff81fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81815a2c0 con 0x7ff81809a590 2024-08-17T02:47:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.210+0000 7ff81ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8180a9cb0 0x7ff81816d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.210+0000 7ff81ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8180a9cb0 0x7ff81816d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47652/0 (socket says 172.21.15.5:47652) 2024-08-17T02:47:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.210+0000 7ff81ca00640 1 -- 172.21.15.5:0/368026651 learned_addr learned my addr 172.21.15.5:0/368026651 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.210+0000 7ff81d400640 1 --2- 172.21.15.5:0/368026651 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff81809a590 0x7ff818158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.210+0000 7ff81de00640 1 --2- 172.21.15.5:0/368026651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff818158be0 0x7ff81815a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.210+0000 7ff81ca00640 1 -- 172.21.15.5:0/368026651 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff81809a590 msgr2=0x7ff818158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.210+0000 7ff81ca00640 1 --2- 172.21.15.5:0/368026651 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff81809a590 0x7ff818158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.210+0000 7ff81ca00640 1 -- 172.21.15.5:0/368026651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff818158be0 msgr2=0x7ff81815a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.210+0000 7ff81ca00640 1 --2- 172.21.15.5:0/368026651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff818158be0 0x7ff81815a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.210+0000 7ff81ca00640 1 -- 172.21.15.5:0/368026651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c009390 con 0x7ff8180a9cb0 2024-08-17T02:47:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.211+0000 7ff81ca00640 1 --2- 172.21.15.5:0/368026651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8180a9cb0 0x7ff81816d400 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff80400c590 tx=0x7ff804007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.211+0000 7ff814c00640 1 -- 172.21.15.5:0/368026651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804005aa0 con 0x7ff8180a9cb0 2024-08-17T02:47:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.211+0000 7ff814c00640 1 -- 172.21.15.5:0/368026651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff804005c00 con 0x7ff8180a9cb0 2024-08-17T02:47:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.211+0000 7ff814c00640 1 -- 172.21.15.5:0/368026651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8040070d0 con 0x7ff8180a9cb0 2024-08-17T02:47:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.211+0000 7ff81fe00640 1 -- 172.21.15.5:0/368026651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff810009a20 con 0x7ff8180a9cb0 2024-08-17T02:47:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.211+0000 7ff81fe00640 1 -- 172.21.15.5:0/368026651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff818159990 con 0x7ff8180a9cb0 2024-08-17T02:47:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.212+0000 7ff81fe00640 1 -- 172.21.15.5:0/368026651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff818063fb0 con 0x7ff8180a9cb0 2024-08-17T02:47:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.213+0000 7ff814c00640 1 -- 172.21.15.5:0/368026651 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff8040074c0 con 0x7ff8180a9cb0 2024-08-17T02:47:47.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.214+0000 7ff814c00640 1 --2- 172.21.15.5:0/368026651 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff7f8065180 0x7ff7f8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.214+0000 7ff814c00640 1 -- 172.21.15.5:0/368026651 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff8040815f0 con 0x7ff8180a9cb0 2024-08-17T02:47:47.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.214+0000 7ff81d400640 1 --2- 172.21.15.5:0/368026651 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff7f8065180 0x7ff7f8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.215+0000 7ff81d400640 1 --2- 172.21.15.5:0/368026651 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff7f8065180 0x7ff7f8067630 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009e10 tx=0x7ff80c0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.218+0000 7ff814c00640 1 -- 172.21.15.5:0/368026651 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff80404fa10 con 0x7ff8180a9cb0 2024-08-17T02:47:47.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.399+0000 7ff81fe00640 1 -- 172.21.15.5:0/368026651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff818071010 con 0x7ff8180a9cb0 2024-08-17T02:47:47.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.400+0000 7ff814c00640 1 -- 172.21.15.5:0/368026651 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8040170a0 con 0x7ff8180a9cb0 2024-08-17T02:47:47.401 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:47:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.402+0000 7ff81fe00640 1 -- 172.21.15.5:0/368026651 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff7f8065180 msgr2=0x7ff7f8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.402+0000 7ff81fe00640 1 --2- 172.21.15.5:0/368026651 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff7f8065180 0x7ff7f8067630 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009e10 tx=0x7ff80c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.402+0000 7ff81fe00640 1 -- 172.21.15.5:0/368026651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8180a9cb0 msgr2=0x7ff81816d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.402+0000 7ff81fe00640 1 --2- 172.21.15.5:0/368026651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8180a9cb0 0x7ff81816d400 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff80400c590 tx=0x7ff804007d40 comp rx=0 tx=0).stop 2024-08-17T02:47:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.402+0000 7ff81fe00640 1 -- 172.21.15.5:0/368026651 shutdown_connections 2024-08-17T02:47:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.402+0000 7ff81fe00640 1 --2- 172.21.15.5:0/368026651 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff7f8065180 0x7ff7f8067630 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.402+0000 7ff81fe00640 1 --2- 172.21.15.5:0/368026651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff818158be0 0x7ff81815a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.402+0000 7ff81fe00640 1 --2- 172.21.15.5:0/368026651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8180a9cb0 0x7ff81816d400 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.402+0000 7ff81fe00640 1 --2- 172.21.15.5:0/368026651 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff81809a590 0x7ff818158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.402+0000 7ff81fe00640 1 -- 172.21.15.5:0/368026651 >> 172.21.15.5:0/368026651 conn(0x7ff8180b1cd0 msgr2=0x7ff818066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.403+0000 7ff81fe00640 1 -- 172.21.15.5:0/368026651 shutdown_connections 2024-08-17T02:47:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.403+0000 7ff81fe00640 1 -- 172.21.15.5:0/368026651 wait complete. 2024-08-17T02:47:47.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:47:47.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.568+0000 7fbf61000640 1 Processor -- start 2024-08-17T02:47:47.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.568+0000 7fbf61000640 1 -- start start 2024-08-17T02:47:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.569+0000 7fbf61000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf5c0ad790 0x7fbf5c0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.569+0000 7fbf61000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5c0cb180 con 0x7fbf5c0c9d20 2024-08-17T02:47:47.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.569+0000 7fbf61000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5c0af530 con 0x7fbf5c1559e0 2024-08-17T02:47:47.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.569+0000 7fbf61000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0ca8e0 con 0x7fbf5c0ad790 2024-08-17T02:47:47.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.569+0000 7fbf5aa00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbf5c0c9d20 0x7fbf5c1552d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58864/0 (socket says 172.21.15.5:58864) 2024-08-17T02:47:47.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.569+0000 7fbf5aa00640 1 -- 172.21.15.5:0/851427524 learned_addr learned my addr 172.21.15.5:0/851427524 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:47.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.569+0000 7fbf5b400640 1 --2- 172.21.15.5:0/851427524 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf5c0ad790 0x7fbf5c0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.570+0000 7fbf5a000640 1 -- 172.21.15.5:0/851427524 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260941671 0 0) 0x7fbf5c0cb180 con 0x7fbf5c0c9d20 2024-08-17T02:47:47.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.570+0000 7fbf5a000640 1 -- 172.21.15.5:0/851427524 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf400034e0 con 0x7fbf5c0c9d20 2024-08-17T02:47:47.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.570+0000 7fbf5a000640 1 -- 172.21.15.5:0/851427524 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590319780 0 0) 0x7fbf5c0af530 con 0x7fbf5c1559e0 2024-08-17T02:47:47.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.570+0000 7fbf5a000640 1 -- 172.21.15.5:0/851427524 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf5c0cb180 con 0x7fbf5c1559e0 2024-08-17T02:47:47.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.570+0000 7fbf5b400640 1 -- 172.21.15.5:0/851427524 >> v1:172.21.15.107:6789/0 conn(0x7fbf5c1559e0 legacy=0x7fbf5c0af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.570+0000 7fbf5b400640 1 -- 172.21.15.5:0/851427524 >> v1:172.21.15.5:6789/0 conn(0x7fbf5c0c9d20 legacy=0x7fbf5c1552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.570+0000 7fbf5b400640 1 -- 172.21.15.5:0/851427524 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c0cabc0 con 0x7fbf5c0ad790 2024-08-17T02:47:47.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.571+0000 7fbf5b400640 1 --2- 172.21.15.5:0/851427524 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf5c0ad790 0x7fbf5c0adb60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009880 tx=0x7fbf4c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ce85165dccf6ad9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:47.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.571+0000 7fbf5a000640 1 -- 172.21.15.5:0/851427524 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c02ad70 con 0x7fbf5c0ad790 2024-08-17T02:47:47.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.572+0000 7fbf5a000640 1 -- 172.21.15.5:0/851427524 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c032440 con 0x7fbf5c0ad790 2024-08-17T02:47:47.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.572+0000 7fbf5a000640 1 -- 172.21.15.5:0/851427524 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c0327c0 con 0x7fbf5c0ad790 2024-08-17T02:47:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.572+0000 7fbf61000640 1 -- 172.21.15.5:0/851427524 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf5c0ad790 msgr2=0x7fbf5c0adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.572+0000 7fbf61000640 1 --2- 172.21.15.5:0/851427524 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf5c0ad790 0x7fbf5c0adb60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009880 tx=0x7fbf4c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.572+0000 7fbf61000640 1 -- 172.21.15.5:0/851427524 shutdown_connections 2024-08-17T02:47:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.572+0000 7fbf61000640 1 --2- 172.21.15.5:0/851427524 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf5c0ad790 0x7fbf5c0adb60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.572+0000 7fbf61000640 1 -- 172.21.15.5:0/851427524 >> 172.21.15.5:0/851427524 conn(0x7fbf5c062af0 msgr2=0x7fbf5c062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.572+0000 7fbf61000640 1 -- 172.21.15.5:0/851427524 shutdown_connections 2024-08-17T02:47:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.572+0000 7fbf61000640 1 -- 172.21.15.5:0/851427524 wait complete. 2024-08-17T02:47:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.573+0000 7fbf61000640 1 Processor -- start 2024-08-17T02:47:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.574+0000 7fbf61000640 1 -- start start 2024-08-17T02:47:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.574+0000 7fbf61000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf5c0ad790 0x7fbf5c14c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.574+0000 7fbf61000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf5c0c9d20 0x7fbf5c13f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.574+0000 7fbf61000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf5c1559e0 0x7fbf5c13fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.574+0000 7fbf61000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c14a270 con 0x7fbf5c1559e0 2024-08-17T02:47:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.575+0000 7fbf61000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c13c850 con 0x7fbf5c0c9d20 2024-08-17T02:47:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.575+0000 7fbf61000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c14a450 con 0x7fbf5c0ad790 2024-08-17T02:47:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.575+0000 7fbf5be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf5c1559e0 0x7fbf5c13fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.575+0000 7fbf5be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf5c1559e0 0x7fbf5c13fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47666/0 (socket says 172.21.15.5:47666) 2024-08-17T02:47:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.575+0000 7fbf5be00640 1 -- 172.21.15.5:0/2188854658 learned_addr learned my addr 172.21.15.5:0/2188854658 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.575+0000 7fbf5aa00640 1 --2- 172.21.15.5:0/2188854658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf5c0c9d20 0x7fbf5c13f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.575+0000 7fbf5b400640 1 --2- 172.21.15.5:0/2188854658 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf5c0ad790 0x7fbf5c14c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.575+0000 7fbf5be00640 1 -- 172.21.15.5:0/2188854658 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf5c0ad790 msgr2=0x7fbf5c14c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.575+0000 7fbf5be00640 1 --2- 172.21.15.5:0/2188854658 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf5c0ad790 0x7fbf5c14c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.575+0000 7fbf5be00640 1 -- 172.21.15.5:0/2188854658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf5c0c9d20 msgr2=0x7fbf5c13f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.575+0000 7fbf5be00640 1 --2- 172.21.15.5:0/2188854658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf5c0c9d20 0x7fbf5c13f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.575+0000 7fbf5be00640 1 -- 172.21.15.5:0/2188854658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c009390 con 0x7fbf5c1559e0 2024-08-17T02:47:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.575+0000 7fbf5be00640 1 --2- 172.21.15.5:0/2188854658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf5c1559e0 0x7fbf5c13fd60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400c840 tx=0x7fbf54002650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.576+0000 7fbf52a00640 1 -- 172.21.15.5:0/2188854658 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400a640 con 0x7fbf5c1559e0 2024-08-17T02:47:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.576+0000 7fbf52a00640 1 -- 172.21.15.5:0/2188854658 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5400a7a0 con 0x7fbf5c1559e0 2024-08-17T02:47:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.576+0000 7fbf61000640 1 -- 172.21.15.5:0/2188854658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5c14a730 con 0x7fbf5c1559e0 2024-08-17T02:47:47.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.576+0000 7fbf52a00640 1 -- 172.21.15.5:0/2188854658 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400aba0 con 0x7fbf5c1559e0 2024-08-17T02:47:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.576+0000 7fbf61000640 1 -- 172.21.15.5:0/2188854658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5c14acf0 con 0x7fbf5c1559e0 2024-08-17T02:47:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.577+0000 7fbf61000640 1 -- 172.21.15.5:0/2188854658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf5c13ca00 con 0x7fbf5c1559e0 2024-08-17T02:47:47.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.578+0000 7fbf52a00640 1 -- 172.21.15.5:0/2188854658 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbf54012420 con 0x7fbf5c1559e0 2024-08-17T02:47:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.579+0000 7fbf52a00640 1 --2- 172.21.15.5:0/2188854658 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbf3c065180 0x7fbf3c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.579+0000 7fbf52a00640 1 -- 172.21.15.5:0/2188854658 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbf54082470 con 0x7fbf5c1559e0 2024-08-17T02:47:47.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.579+0000 7fbf5b400640 1 --2- 172.21.15.5:0/2188854658 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbf3c065180 0x7fbf3c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.580+0000 7fbf5b400640 1 --2- 172.21.15.5:0/2188854658 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbf3c065180 0x7fbf3c067630 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c034000 tx=0x7fbf4c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.582+0000 7fbf52a00640 1 -- 172.21.15.5:0/2188854658 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbf5c13ca00 con 0x7fbf5c1559e0 2024-08-17T02:47:47.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.770+0000 7fbf61000640 1 -- 172.21.15.5:0/2188854658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbf5c13ca00 con 0x7fbf5c1559e0 2024-08-17T02:47:47.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.770+0000 7fbf52a00640 1 -- 172.21.15.5:0/2188854658 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7fbf54016060 con 0x7fbf5c1559e0 2024-08-17T02:47:47.771 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:47.771 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-17T02:47:47.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:47:47.772 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-17T02:47:47.772 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-17T02:47:47.772 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:47:47.772 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-17T02:47:47.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.772+0000 7fbf61000640 1 -- 172.21.15.5:0/2188854658 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbf3c065180 msgr2=0x7fbf3c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.772+0000 7fbf61000640 1 --2- 172.21.15.5:0/2188854658 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbf3c065180 0x7fbf3c067630 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c034000 tx=0x7fbf4c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:47.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.772+0000 7fbf61000640 1 -- 172.21.15.5:0/2188854658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf5c1559e0 msgr2=0x7fbf5c13fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.772+0000 7fbf61000640 1 --2- 172.21.15.5:0/2188854658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf5c1559e0 0x7fbf5c13fd60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400c840 tx=0x7fbf54002650 comp rx=0 tx=0).stop 2024-08-17T02:47:47.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.772+0000 7fbf61000640 1 -- 172.21.15.5:0/2188854658 shutdown_connections 2024-08-17T02:47:47.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.772+0000 7fbf61000640 1 --2- 172.21.15.5:0/2188854658 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbf3c065180 0x7fbf3c067630 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.772+0000 7fbf61000640 1 --2- 172.21.15.5:0/2188854658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf5c1559e0 0x7fbf5c13fd60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.772+0000 7fbf61000640 1 --2- 172.21.15.5:0/2188854658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf5c0c9d20 0x7fbf5c13f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.772+0000 7fbf61000640 1 --2- 172.21.15.5:0/2188854658 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbf5c0ad790 0x7fbf5c14c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.772+0000 7fbf61000640 1 -- 172.21.15.5:0/2188854658 >> 172.21.15.5:0/2188854658 conn(0x7fbf5c062af0 msgr2=0x7fbf5c0aa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:47.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.772+0000 7fbf61000640 1 -- 172.21.15.5:0/2188854658 shutdown_connections 2024-08-17T02:47:47.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.773+0000 7fbf61000640 1 -- 172.21.15.5:0/2188854658 wait complete. 2024-08-17T02:47:47.788 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:47:47.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:47:47.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.942+0000 7fb862a00640 1 Processor -- start 2024-08-17T02:47:47.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.942+0000 7fb862a00640 1 -- start start 2024-08-17T02:47:47.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.943+0000 7fb862a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb85c158bb0 0x7fb85c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.943+0000 7fb862a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb85c158f80 0x7fb85c0cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.943+0000 7fb862a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85c0cc9e0 con 0x7fb85c0cb600 2024-08-17T02:47:47.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.943+0000 7fb862a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85c0cbdd0 con 0x7fb85c158f80 2024-08-17T02:47:47.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.943+0000 7fb862a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0cc0b0 con 0x7fb85c158bb0 2024-08-17T02:47:47.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.943+0000 7fb85b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb85c158f80 0x7fb85c0cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.943+0000 7fb85b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb85c158f80 0x7fb85c0cb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47680/0 (socket says 172.21.15.5:47680) 2024-08-17T02:47:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.943+0000 7fb85b400640 1 -- 172.21.15.5:0/3888285744 learned_addr learned my addr 172.21.15.5:0/3888285744 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.943+0000 7fb860a00640 1 --1- 172.21.15.5:0/3888285744 >> v1:172.21.15.5:6789/0 conn(0x7fb85c0cb600 0x7fb85c0b1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58880/0 (socket says 172.21.15.5:58880) 2024-08-17T02:47:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.944+0000 7fb85be00640 1 --2- 172.21.15.5:0/3888285744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb85c158bb0 0x7fb85c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.944+0000 7fb85b400640 1 -- 172.21.15.5:0/3888285744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb85c158bb0 msgr2=0x7fb85c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.944+0000 7fb85b400640 1 --2- 172.21.15.5:0/3888285744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb85c158bb0 0x7fb85c0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.944+0000 7fb85b400640 1 -- 172.21.15.5:0/3888285744 >> v1:172.21.15.5:6789/0 conn(0x7fb85c0cb600 legacy=0x7fb85c0b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.944+0000 7fb85b400640 1 -- 172.21.15.5:0/3888285744 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c0cc390 con 0x7fb85c158f80 2024-08-17T02:47:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.944+0000 7fb85aa00640 1 -- 172.21.15.5:0/3888285744 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995881498 0 0) 0x7fb85c0cc9e0 con 0x7fb85c0cb600 2024-08-17T02:47:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.944+0000 7fb85be00640 1 --2- 172.21.15.5:0/3888285744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb85c158bb0 0x7fb85c0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:47.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.945+0000 7fb85b400640 1 --2- 172.21.15.5:0/3888285744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c158f80 0x7fb85c0cb0c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb848009910 tx=0x7fb8480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401ef1e15eb95668 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:47.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.945+0000 7fb85aa00640 1 -- 172.21.15.5:0/3888285744 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84802add0 con 0x7fb85c158f80 2024-08-17T02:47:47.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.945+0000 7fb85aa00640 1 -- 172.21.15.5:0/3888285744 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb848032440 con 0x7fb85c158f80 2024-08-17T02:47:47.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.945+0000 7fb85aa00640 1 -- 172.21.15.5:0/3888285744 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8480327e0 con 0x7fb85c158f80 2024-08-17T02:47:47.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.946+0000 7fb862a00640 1 -- 172.21.15.5:0/3888285744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c158f80 msgr2=0x7fb85c0cb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.946+0000 7fb862a00640 1 --2- 172.21.15.5:0/3888285744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c158f80 0x7fb85c0cb0c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb848009910 tx=0x7fb8480091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.946+0000 7fb862a00640 1 -- 172.21.15.5:0/3888285744 shutdown_connections 2024-08-17T02:47:47.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.946+0000 7fb862a00640 1 --2- 172.21.15.5:0/3888285744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c158f80 0x7fb85c0cb0c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.946+0000 7fb862a00640 1 --2- 172.21.15.5:0/3888285744 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb85c158bb0 0x7fb85c0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.946+0000 7fb862a00640 1 -- 172.21.15.5:0/3888285744 >> 172.21.15.5:0/3888285744 conn(0x7fb85c06e590 msgr2=0x7fb85c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:47.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.946+0000 7fb862a00640 1 -- 172.21.15.5:0/3888285744 shutdown_connections 2024-08-17T02:47:47.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.946+0000 7fb862a00640 1 -- 172.21.15.5:0/3888285744 wait complete. 2024-08-17T02:47:47.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.947+0000 7fb862a00640 1 Processor -- start 2024-08-17T02:47:47.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.948+0000 7fb862a00640 1 -- start start 2024-08-17T02:47:47.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.948+0000 7fb862a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c0cb600 0x7fb85c0c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.948+0000 7fb862a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c158bb0 0x7fb85c0c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.949+0000 7fb862a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb85c158f80 0x7fb85c159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.949+0000 7fb862a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c159880 con 0x7fb85c158bb0 2024-08-17T02:47:47.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.949+0000 7fb862a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0cf2a0 con 0x7fb85c0cb600 2024-08-17T02:47:47.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.949+0000 7fb862a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c15a250 con 0x7fb85c158f80 2024-08-17T02:47:47.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.949+0000 7fb85b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c158bb0 0x7fb85c0c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.949+0000 7fb85b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c158bb0 0x7fb85c0c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47696/0 (socket says 172.21.15.5:47696) 2024-08-17T02:47:47.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.949+0000 7fb85b400640 1 -- 172.21.15.5:0/2776002828 learned_addr learned my addr 172.21.15.5:0/2776002828 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:47.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.949+0000 7fb85be00640 1 --2- 172.21.15.5:0/2776002828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c0cb600 0x7fb85c0c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.949+0000 7fb860a00640 1 --2- 172.21.15.5:0/2776002828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb85c158f80 0x7fb85c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.949+0000 7fb85b400640 1 -- 172.21.15.5:0/2776002828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb85c158f80 msgr2=0x7fb85c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.949+0000 7fb85b400640 1 --2- 172.21.15.5:0/2776002828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb85c158f80 0x7fb85c159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.949+0000 7fb85b400640 1 -- 172.21.15.5:0/2776002828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c0cb600 msgr2=0x7fb85c0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:47.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.949+0000 7fb85b400640 1 --2- 172.21.15.5:0/2776002828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c0cb600 0x7fb85c0c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:47.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.949+0000 7fb85b400640 1 -- 172.21.15.5:0/2776002828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848009450 con 0x7fb85c158bb0 2024-08-17T02:47:47.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.949+0000 7fb85be00640 1 --2- 172.21.15.5:0/2776002828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c0cb600 0x7fb85c0c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:47.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.949+0000 7fb85b400640 1 --2- 172.21.15.5:0/2776002828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c158bb0 0x7fb85c0c6d40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb848009970 tx=0x7fb848032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:47.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.950+0000 7fb853400640 1 -- 172.21.15.5:0/2776002828 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848006ea0 con 0x7fb85c158bb0 2024-08-17T02:47:47.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.950+0000 7fb853400640 1 -- 172.21.15.5:0/2776002828 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb848032880 con 0x7fb85c158bb0 2024-08-17T02:47:47.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.950+0000 7fb853400640 1 -- 172.21.15.5:0/2776002828 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848031cd0 con 0x7fb85c158bb0 2024-08-17T02:47:47.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.950+0000 7fb862a00640 1 -- 172.21.15.5:0/2776002828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c0c77a0 con 0x7fb85c158bb0 2024-08-17T02:47:47.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.950+0000 7fb862a00640 1 -- 172.21.15.5:0/2776002828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c159510 con 0x7fb85c158bb0 2024-08-17T02:47:47.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.951+0000 7fb862a00640 1 -- 172.21.15.5:0/2776002828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85c159370 con 0x7fb85c158bb0 2024-08-17T02:47:47.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.952+0000 7fb853400640 1 -- 172.21.15.5:0/2776002828 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb848039040 con 0x7fb85c158bb0 2024-08-17T02:47:47.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.953+0000 7fb853400640 1 --2- 172.21.15.5:0/2776002828 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb83c065150 0x7fb83c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:47.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.953+0000 7fb853400640 1 -- 172.21.15.5:0/2776002828 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb8480a1c50 con 0x7fb85c158bb0 2024-08-17T02:47:47.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.953+0000 7fb85be00640 1 --2- 172.21.15.5:0/2776002828 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb83c065150 0x7fb83c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:47.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.953+0000 7fb85be00640 1 --2- 172.21.15.5:0/2776002828 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb83c065150 0x7fb83c067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb84c006e70 tx=0x7fb84c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:47.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:47.957+0000 7fb853400640 1 -- 172.21.15.5:0/2776002828 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb85c159370 con 0x7fb85c158bb0 2024-08-17T02:47:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.144+0000 7fb862a00640 1 -- 172.21.15.5:0/2776002828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb85c159a30 con 0x7fb85c158bb0 2024-08-17T02:47:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.671+0000 7fb853400640 1 -- 172.21.15.5:0/2776002828 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb85c159a30 con 0x7fb85c158bb0 2024-08-17T02:47:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-17T02:47:48.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.675+0000 7fb862a00640 1 -- 172.21.15.5:0/2776002828 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb83c065150 msgr2=0x7fb83c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.675+0000 7fb862a00640 1 --2- 172.21.15.5:0/2776002828 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb83c065150 0x7fb83c067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb84c006e70 tx=0x7fb84c008040 comp rx=0 tx=0).stop 2024-08-17T02:47:48.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.675+0000 7fb862a00640 1 -- 172.21.15.5:0/2776002828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c158bb0 msgr2=0x7fb85c0c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.675+0000 7fb862a00640 1 --2- 172.21.15.5:0/2776002828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c158bb0 0x7fb85c0c6d40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb848009970 tx=0x7fb848032000 comp rx=0 tx=0).stop 2024-08-17T02:47:48.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.675+0000 7fb862a00640 1 -- 172.21.15.5:0/2776002828 shutdown_connections 2024-08-17T02:47:48.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.675+0000 7fb862a00640 1 --2- 172.21.15.5:0/2776002828 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb83c065150 0x7fb83c067600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.675+0000 7fb862a00640 1 --2- 172.21.15.5:0/2776002828 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb85c158f80 0x7fb85c159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.675+0000 7fb862a00640 1 --2- 172.21.15.5:0/2776002828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c158bb0 0x7fb85c0c6d40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.675+0000 7fb862a00640 1 --2- 172.21.15.5:0/2776002828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c0cb600 0x7fb85c0c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.675+0000 7fb862a00640 1 -- 172.21.15.5:0/2776002828 >> 172.21.15.5:0/2776002828 conn(0x7fb85c06e590 msgr2=0x7fb85c0ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:48.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.675+0000 7fb862a00640 1 -- 172.21.15.5:0/2776002828 shutdown_connections 2024-08-17T02:47:48.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.675+0000 7fb862a00640 1 -- 172.21.15.5:0/2776002828 wait complete. 2024-08-17T02:47:48.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:47:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.862+0000 7f2858600640 1 Processor -- start 2024-08-17T02:47:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.863+0000 7f2858600640 1 -- start start 2024-08-17T02:47:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.864+0000 7f2858600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f28500add30 0x7f2850156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.864+0000 7f2858600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28500cb160 con 0x7f28500ca050 2024-08-17T02:47:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.864+0000 7f2858600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28500b0d10 con 0x7f28500ad960 2024-08-17T02:47:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.864+0000 7f2858600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28500ca550 con 0x7f28500add30 2024-08-17T02:47:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.864+0000 7f2855200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f28500ca050 0x7f28500aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58896/0 (socket says 172.21.15.5:58896) 2024-08-17T02:47:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.864+0000 7f2855200640 1 -- 172.21.15.5:0/2352418227 learned_addr learned my addr 172.21.15.5:0/2352418227 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.864+0000 7f2856600640 1 --2- 172.21.15.5:0/2352418227 >> v2:172.21.15.107:3300/0 conn(0x7f28500add30 0x7f2850156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.864+0000 7f284fe00640 1 -- 172.21.15.5:0/2352418227 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693934566 0 0) 0x7f28500cb160 con 0x7f28500ca050 2024-08-17T02:47:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f284fe00640 1 -- 172.21.15.5:0/2352418227 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28380034e0 con 0x7f28500ca050 2024-08-17T02:47:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f284fe00640 1 -- 172.21.15.5:0/2352418227 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216510462 0 0) 0x7f28500b0d10 con 0x7f28500ad960 2024-08-17T02:47:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f284fe00640 1 -- 172.21.15.5:0/2352418227 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28500cb160 con 0x7f28500ad960 2024-08-17T02:47:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f284fe00640 1 -- 172.21.15.5:0/2352418227 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3242673809 0 0) 0x7f28380034e0 con 0x7f28500ca050 2024-08-17T02:47:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f284fe00640 1 -- 172.21.15.5:0/2352418227 >> v2:172.21.15.107:3300/0 conn(0x7f28500add30 msgr2=0x7f2850156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f284fe00640 1 --2- 172.21.15.5:0/2352418227 >> v2:172.21.15.107:3300/0 conn(0x7f28500add30 0x7f2850156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f284fe00640 1 -- 172.21.15.5:0/2352418227 >> v1:172.21.15.107:6789/0 conn(0x7f28500ad960 legacy=0x7f2850156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f284fe00640 1 -- 172.21.15.5:0/2352418227 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28500ca830 con 0x7f28500ca050 2024-08-17T02:47:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f284fe00640 1 -- 172.21.15.5:0/2352418227 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7f283c001470 con 0x7f28500ca050 2024-08-17T02:47:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f284fe00640 1 -- 172.21.15.5:0/2352418227 >> v1:172.21.15.5:6789/0 conn(0x7f28500ca050 legacy=0x7f28500aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f284fe00640 1 --2- 172.21.15.5:0/2352418227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2838003b60 0x7f2838003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f284fe00640 1 --2- 172.21.15.5:0/2352418227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2838004780 0x7f2838004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f284fe00640 1 --2- 172.21.15.5:0/2352418227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2838005130 0x7f283800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f284fe00640 1 -- 172.21.15.5:0/2352418227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28500ca550 con 0x7f2838004780 2024-08-17T02:47:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f284fe00640 1 -- 172.21.15.5:0/2352418227 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283800c020 con 0x7f2838005130 2024-08-17T02:47:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f284fe00640 1 -- 172.21.15.5:0/2352418227 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283800c1e0 con 0x7f2838003b60 2024-08-17T02:47:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f2855200640 1 --2- 172.21.15.5:0/2352418227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2838004780 0x7f2838004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f2855c00640 1 --2- 172.21.15.5:0/2352418227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2838003b60 0x7f2838003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.865+0000 7f2856600640 1 --2- 172.21.15.5:0/2352418227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2838005130 0x7f283800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.866+0000 7f2855200640 1 -- 172.21.15.5:0/2352418227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2838003b60 msgr2=0x7f2838003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.866+0000 7f2855200640 1 --2- 172.21.15.5:0/2352418227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2838003b60 0x7f2838003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.866+0000 7f2855200640 1 -- 172.21.15.5:0/2352418227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2838005130 msgr2=0x7f283800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.866+0000 7f2855200640 1 --2- 172.21.15.5:0/2352418227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2838005130 0x7f283800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.866+0000 7f2855200640 1 -- 172.21.15.5:0/2352418227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28380034e0 con 0x7f2838004780 2024-08-17T02:47:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.866+0000 7f2856600640 1 -- 172.21.15.5:0/2352418227 reap_dead start 2024-08-17T02:47:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.867+0000 7f2855200640 1 --2- 172.21.15.5:0/2352418227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2838004780 0x7f2838004bf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f283c00c210 tx=0x7f283c001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b49c38dc2649f1a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.867+0000 7f284fe00640 1 -- 172.21.15.5:0/2352418227 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c005960 con 0x7f2838004780 2024-08-17T02:47:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.867+0000 7f284fe00640 1 -- 172.21.15.5:0/2352418227 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c005ae0 con 0x7f2838004780 2024-08-17T02:47:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.867+0000 7f284fe00640 1 -- 172.21.15.5:0/2352418227 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c005ea0 con 0x7f2838004780 2024-08-17T02:47:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.868+0000 7f2858600640 1 -- 172.21.15.5:0/2352418227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2838004780 msgr2=0x7f2838004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.868+0000 7f2858600640 1 --2- 172.21.15.5:0/2352418227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2838004780 0x7f2838004bf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f283c00c210 tx=0x7f283c001e10 comp rx=0 tx=0).stop 2024-08-17T02:47:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.868+0000 7f2858600640 1 -- 172.21.15.5:0/2352418227 shutdown_connections 2024-08-17T02:47:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.868+0000 7f2858600640 1 --2- 172.21.15.5:0/2352418227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2838004780 0x7f2838004bf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.868+0000 7f2858600640 1 -- 172.21.15.5:0/2352418227 >> 172.21.15.5:0/2352418227 conn(0x7f2850066e60 msgr2=0x7f2850067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.868+0000 7f2858600640 1 -- 172.21.15.5:0/2352418227 shutdown_connections 2024-08-17T02:47:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.868+0000 7f2858600640 1 -- 172.21.15.5:0/2352418227 wait complete. 2024-08-17T02:47:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.869+0000 7f2858600640 1 Processor -- start 2024-08-17T02:47:48.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.869+0000 7f2858600640 1 -- start start 2024-08-17T02:47:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.870+0000 7f2858600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2838004780 0x7f28500a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.870+0000 7f2858600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2850159810 0x7f28501514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.870+0000 7f2858600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28500ac650 0x7f28500acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.870+0000 7f2858600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28500aa290 con 0x7f2850159810 2024-08-17T02:47:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.870+0000 7f2858600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2850169410 con 0x7f2838004780 2024-08-17T02:47:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.870+0000 7f2858600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285015a330 con 0x7f28500ac650 2024-08-17T02:47:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.870+0000 7f2855200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2850159810 0x7f28501514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.871+0000 7f2855200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2850159810 0x7f28501514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47712/0 (socket says 172.21.15.5:47712) 2024-08-17T02:47:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.871+0000 7f2855200640 1 -- 172.21.15.5:0/178215048 learned_addr learned my addr 172.21.15.5:0/178215048 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.871+0000 7f2856600640 1 --2- 172.21.15.5:0/178215048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28500ac650 0x7f28500acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.871+0000 7f2855c00640 1 --2- 172.21.15.5:0/178215048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2838004780 0x7f28500a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.871+0000 7f2855200640 1 -- 172.21.15.5:0/178215048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28500ac650 msgr2=0x7f28500acad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.871+0000 7f2855200640 1 --2- 172.21.15.5:0/178215048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28500ac650 0x7f28500acad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.871+0000 7f2855200640 1 -- 172.21.15.5:0/178215048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2838004780 msgr2=0x7f28500a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.871+0000 7f2855200640 1 --2- 172.21.15.5:0/178215048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2838004780 0x7f28500a9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.871+0000 7f2855200640 1 -- 172.21.15.5:0/178215048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28501696b0 con 0x7f2850159810 2024-08-17T02:47:48.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.871+0000 7f2856600640 1 --2- 172.21.15.5:0/178215048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28500ac650 0x7f28500acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:48.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.871+0000 7f2855200640 1 --2- 172.21.15.5:0/178215048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2850159810 0x7f28501514d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f283c02ad50 tx=0x7f283c034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:48.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.872+0000 7f284cc00640 1 -- 172.21.15.5:0/178215048 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c005e60 con 0x7f2850159810 2024-08-17T02:47:48.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.872+0000 7f284cc00640 1 -- 172.21.15.5:0/178215048 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c001470 con 0x7f2850159810 2024-08-17T02:47:48.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.872+0000 7f284cc00640 1 -- 172.21.15.5:0/178215048 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c03e6a0 con 0x7f2850159810 2024-08-17T02:47:48.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.872+0000 7f2858600640 1 -- 172.21.15.5:0/178215048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2850151a10 con 0x7f2850159810 2024-08-17T02:47:48.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.872+0000 7f2858600640 1 -- 172.21.15.5:0/178215048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28500a9cd0 con 0x7f2850159810 2024-08-17T02:47:48.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.873+0000 7f2858600640 1 -- 172.21.15.5:0/178215048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2850169840 con 0x7f2850159810 2024-08-17T02:47:48.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.874+0000 7f284cc00640 1 -- 172.21.15.5:0/178215048 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f283c03ea10 con 0x7f2850159810 2024-08-17T02:47:48.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.875+0000 7f284cc00640 1 --2- 172.21.15.5:0/178215048 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2830065180 0x7f2830067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:48.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.875+0000 7f284cc00640 1 -- 172.21.15.5:0/178215048 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f283c0a2ec0 con 0x7f2850159810 2024-08-17T02:47:48.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.875+0000 7f2855c00640 1 --2- 172.21.15.5:0/178215048 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2830065180 0x7f2830067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:48.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.876+0000 7f2855c00640 1 --2- 172.21.15.5:0/178215048 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2830065180 0x7f2830067630 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2844000c00 tx=0x7f2844007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:48.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:48.880+0000 7f284cc00640 1 -- 172.21.15.5:0/178215048 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f283c0710c0 con 0x7f2850159810 2024-08-17T02:47:49.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.065+0000 7f2858600640 1 -- 172.21.15.5:0/178215048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2850063fb0 con 0x7f2850159810 2024-08-17T02:47:49.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.680+0000 7f284cc00640 1 -- 172.21.15.5:0/178215048 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f283c0746e0 con 0x7f2850159810 2024-08-17T02:47:49.682 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-17T02:47:49.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.684+0000 7f2858600640 1 -- 172.21.15.5:0/178215048 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2830065180 msgr2=0x7f2830067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:49.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.684+0000 7f2858600640 1 --2- 172.21.15.5:0/178215048 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2830065180 0x7f2830067630 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2844000c00 tx=0x7f2844007ca0 comp rx=0 tx=0).stop 2024-08-17T02:47:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.685+0000 7f2858600640 1 -- 172.21.15.5:0/178215048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2850159810 msgr2=0x7f28501514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.685+0000 7f2858600640 1 --2- 172.21.15.5:0/178215048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2850159810 0x7f28501514d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f283c02ad50 tx=0x7f283c034000 comp rx=0 tx=0).stop 2024-08-17T02:47:49.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.686+0000 7f2858600640 1 -- 172.21.15.5:0/178215048 shutdown_connections 2024-08-17T02:47:49.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.686+0000 7f2858600640 1 --2- 172.21.15.5:0/178215048 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2830065180 0x7f2830067630 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:49.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.686+0000 7f2858600640 1 --2- 172.21.15.5:0/178215048 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28500ac650 0x7f28500acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:49.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.686+0000 7f2858600640 1 --2- 172.21.15.5:0/178215048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2850159810 0x7f28501514d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:49.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.686+0000 7f2858600640 1 --2- 172.21.15.5:0/178215048 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2838004780 0x7f28500a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:49.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.686+0000 7f2858600640 1 -- 172.21.15.5:0/178215048 >> 172.21.15.5:0/178215048 conn(0x7f2850066e60 msgr2=0x7f28500698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:49.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.687+0000 7f2858600640 1 -- 172.21.15.5:0/178215048 shutdown_connections 2024-08-17T02:47:49.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.687+0000 7f2858600640 1 -- 172.21.15.5:0/178215048 wait complete. 2024-08-17T02:47:49.719 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:47:49.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.872+0000 7f97f6200640 1 Processor -- start 2024-08-17T02:47:49.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.872+0000 7f97f6200640 1 -- start start 2024-08-17T02:47:49.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.873+0000 7f97f6200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f97f00aea20 0x7f97f00aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:49.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.873+0000 7f97f6200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f97f00ca8e0 0x7f97f00cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:49.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.873+0000 7f97f6200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f00af3a0 con 0x7f97f0158b90 2024-08-17T02:47:49.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.873+0000 7f97f6200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f00afd20 con 0x7f97f00aea20 2024-08-17T02:47:49.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.873+0000 7f97f6200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f00affe0 con 0x7f97f00ca8e0 2024-08-17T02:47:49.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.873+0000 7f97ef400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f97f0158b90 0x7f97f00b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58906/0 (socket says 172.21.15.5:58906) 2024-08-17T02:47:49.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.873+0000 7f97ef400640 1 -- 172.21.15.5:0/1672368386 learned_addr learned my addr 172.21.15.5:0/1672368386 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:49.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.873+0000 7f97eea00640 1 --2- 172.21.15.5:0/1672368386 >> v2:172.21.15.5:3300/0 conn(0x7f97f00aea20 0x7f97f00aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.874+0000 7f97efe00640 1 --2- 172.21.15.5:0/1672368386 >> v2:172.21.15.107:3300/0 conn(0x7f97f00ca8e0 0x7f97f00cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.874+0000 7f97ee000640 1 -- 172.21.15.5:0/1672368386 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453464098 0 0) 0x7f97f00af3a0 con 0x7f97f0158b90 2024-08-17T02:47:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.874+0000 7f97ee000640 1 -- 172.21.15.5:0/1672368386 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97d40034e0 con 0x7f97f0158b90 2024-08-17T02:47:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.874+0000 7f97eea00640 1 -- 172.21.15.5:0/1672368386 >> v2:172.21.15.107:3300/0 conn(0x7f97f00ca8e0 msgr2=0x7f97f00cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.874+0000 7f97eea00640 1 --2- 172.21.15.5:0/1672368386 >> v2:172.21.15.107:3300/0 conn(0x7f97f00ca8e0 0x7f97f00cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.874+0000 7f97eea00640 1 -- 172.21.15.5:0/1672368386 >> v1:172.21.15.5:6789/0 conn(0x7f97f0158b90 legacy=0x7f97f00b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.874+0000 7f97eea00640 1 -- 172.21.15.5:0/1672368386 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00b02c0 con 0x7f97f00aea20 2024-08-17T02:47:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.875+0000 7f97eea00640 1 --2- 172.21.15.5:0/1672368386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97f00aea20 0x7f97f00aee60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f97f0066fc0 tx=0x7f97dc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ab5af97117ac3b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.875+0000 7f97ee000640 1 -- 172.21.15.5:0/1672368386 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc02adb0 con 0x7f97f00aea20 2024-08-17T02:47:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.875+0000 7f97ee000640 1 -- 172.21.15.5:0/1672368386 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc032440 con 0x7f97f00aea20 2024-08-17T02:47:49.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.875+0000 7f97ee000640 1 -- 172.21.15.5:0/1672368386 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc032800 con 0x7f97f00aea20 2024-08-17T02:47:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.876+0000 7f97f6200640 1 -- 172.21.15.5:0/1672368386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97f00aea20 msgr2=0x7f97f00aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.876+0000 7f97f6200640 1 --2- 172.21.15.5:0/1672368386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97f00aea20 0x7f97f00aee60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f97f0066fc0 tx=0x7f97dc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.876+0000 7f97f6200640 1 -- 172.21.15.5:0/1672368386 shutdown_connections 2024-08-17T02:47:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.876+0000 7f97f6200640 1 --2- 172.21.15.5:0/1672368386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97f00aea20 0x7f97f00aee60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.876+0000 7f97f6200640 1 --2- 172.21.15.5:0/1672368386 >> v2:172.21.15.107:3300/0 conn(0x7f97f00ca8e0 0x7f97f00cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.876+0000 7f97f6200640 1 -- 172.21.15.5:0/1672368386 >> 172.21.15.5:0/1672368386 conn(0x7f97f006e590 msgr2=0x7f97f006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.876+0000 7f97f6200640 1 -- 172.21.15.5:0/1672368386 shutdown_connections 2024-08-17T02:47:49.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.876+0000 7f97f6200640 1 -- 172.21.15.5:0/1672368386 wait complete. 2024-08-17T02:47:49.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.877+0000 7f97f6200640 1 Processor -- start 2024-08-17T02:47:49.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.878+0000 7f97f6200640 1 -- start start 2024-08-17T02:47:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.878+0000 7f97f6200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97f00aea20 0x7f97f0169860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.878+0000 7f97f6200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97f00ca8e0 0x7f97f015e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.878+0000 7f97f6200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97f0158b90 0x7f97f00c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.878+0000 7f97f6200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f0169da0 con 0x7f97f00ca8e0 2024-08-17T02:47:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.878+0000 7f97f6200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00c7ef0 con 0x7f97f0158b90 2024-08-17T02:47:49.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.878+0000 7f97f6200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f015e6d0 con 0x7f97f00aea20 2024-08-17T02:47:49.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.879+0000 7f97eea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97f00ca8e0 0x7f97f015e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:49.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.879+0000 7f97eea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97f00ca8e0 0x7f97f015e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47728/0 (socket says 172.21.15.5:47728) 2024-08-17T02:47:49.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.879+0000 7f97eea00640 1 -- 172.21.15.5:0/1858650819 learned_addr learned my addr 172.21.15.5:0/1858650819 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:49.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.879+0000 7f97ef400640 1 --2- 172.21.15.5:0/1858650819 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97f00aea20 0x7f97f0169860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:49.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.879+0000 7f97efe00640 1 --2- 172.21.15.5:0/1858650819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97f0158b90 0x7f97f00c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:49.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.879+0000 7f97eea00640 1 -- 172.21.15.5:0/1858650819 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97f00aea20 msgr2=0x7f97f0169860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:49.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.879+0000 7f97eea00640 1 --2- 172.21.15.5:0/1858650819 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97f00aea20 0x7f97f0169860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:49.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.879+0000 7f97eea00640 1 -- 172.21.15.5:0/1858650819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97f0158b90 msgr2=0x7f97f00c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:49.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.879+0000 7f97eea00640 1 --2- 172.21.15.5:0/1858650819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97f0158b90 0x7f97f00c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:49.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.879+0000 7f97eea00640 1 -- 172.21.15.5:0/1858650819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc009390 con 0x7f97f00ca8e0 2024-08-17T02:47:49.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.880+0000 7f97eea00640 1 --2- 172.21.15.5:0/1858650819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97f00ca8e0 0x7f97f015e190 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009880 tx=0x7f97dc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:49.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.880+0000 7f97e6a00640 1 -- 172.21.15.5:0/1858650819 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc000d10 con 0x7f97f00ca8e0 2024-08-17T02:47:49.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.880+0000 7f97e6a00640 1 -- 172.21.15.5:0/1858650819 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc031a60 con 0x7f97f00ca8e0 2024-08-17T02:47:49.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.880+0000 7f97e6a00640 1 -- 172.21.15.5:0/1858650819 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc031e40 con 0x7f97f00ca8e0 2024-08-17T02:47:49.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.880+0000 7f97f6200640 1 -- 172.21.15.5:0/1858650819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f00c72e0 con 0x7f97f00ca8e0 2024-08-17T02:47:49.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.880+0000 7f97f6200640 1 -- 172.21.15.5:0/1858650819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f00c78a0 con 0x7f97f00ca8e0 2024-08-17T02:47:49.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.881+0000 7f97f6200640 1 -- 172.21.15.5:0/1858650819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f00b4fd0 con 0x7f97f00ca8e0 2024-08-17T02:47:49.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.882+0000 7f97e6a00640 1 -- 172.21.15.5:0/1858650819 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f97dc03c400 con 0x7f97f00ca8e0 2024-08-17T02:47:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.883+0000 7f97e6a00640 1 --2- 172.21.15.5:0/1858650819 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f97d0065150 0x7f97d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.883+0000 7f97e6a00640 1 -- 172.21.15.5:0/1858650819 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f97dc0a28e0 con 0x7f97f00ca8e0 2024-08-17T02:47:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.883+0000 7f97ef400640 1 --2- 172.21.15.5:0/1858650819 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f97d0065150 0x7f97d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.884+0000 7f97ef400640 1 --2- 172.21.15.5:0/1858650819 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f97d0065150 0x7f97d0067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f97f00ccf70 tx=0x7f97e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:49.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:49.888+0000 7f97e6a00640 1 -- 172.21.15.5:0/1858650819 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f97f00b4fd0 con 0x7f97f00ca8e0 2024-08-17T02:47:50.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.107+0000 7f97f6200640 1 -- 172.21.15.5:0/1858650819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f97f00b4fd0 con 0x7f97f00ca8e0 2024-08-17T02:47:50.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.685+0000 7f97e6a00640 1 -- 172.21.15.5:0/1858650819 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f97f00b4fd0 con 0x7f97f00ca8e0 2024-08-17T02:47:50.686 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:47:50.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.693+0000 7f97f6200640 1 -- 172.21.15.5:0/1858650819 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f97d0065150 msgr2=0x7f97d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.693+0000 7f97f6200640 1 --2- 172.21.15.5:0/1858650819 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f97d0065150 0x7f97d0067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f97f00ccf70 tx=0x7f97e0009040 comp rx=0 tx=0).stop 2024-08-17T02:47:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.693+0000 7f97f6200640 1 -- 172.21.15.5:0/1858650819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97f00ca8e0 msgr2=0x7f97f015e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:50.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.693+0000 7f97f6200640 1 --2- 172.21.15.5:0/1858650819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97f00ca8e0 0x7f97f015e190 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009880 tx=0x7f97dc032000 comp rx=0 tx=0).stop 2024-08-17T02:47:50.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.695+0000 7f97f6200640 1 -- 172.21.15.5:0/1858650819 shutdown_connections 2024-08-17T02:47:50.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.695+0000 7f97f6200640 1 --2- 172.21.15.5:0/1858650819 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f97d0065150 0x7f97d0067600 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:50.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.695+0000 7f97f6200640 1 --2- 172.21.15.5:0/1858650819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97f0158b90 0x7f97f00c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:50.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.695+0000 7f97f6200640 1 --2- 172.21.15.5:0/1858650819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97f00ca8e0 0x7f97f015e190 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:50.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.695+0000 7f97f6200640 1 --2- 172.21.15.5:0/1858650819 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97f00aea20 0x7f97f0169860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:50.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.695+0000 7f97f6200640 1 -- 172.21.15.5:0/1858650819 >> 172.21.15.5:0/1858650819 conn(0x7f97f006e590 msgr2=0x7f97f00d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.695+0000 7f97f6200640 1 -- 172.21.15.5:0/1858650819 shutdown_connections 2024-08-17T02:47:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.695+0000 7f97f6200640 1 -- 172.21.15.5:0/1858650819 wait complete. 2024-08-17T02:47:50.730 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.881+0000 7f8542600640 1 Processor -- start 2024-08-17T02:47:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.881+0000 7f8542600640 1 -- start start 2024-08-17T02:47:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.882+0000 7f8542600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f853c0acf10 0x7f853c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.882+0000 7f8542600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853c0c92b0 con 0x7f853c0afca0 2024-08-17T02:47:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.882+0000 7f8542600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853c0ad480 con 0x7f853c1590b0 2024-08-17T02:47:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.882+0000 7f8542600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f853c0b0980 con 0x7f853c0acf10 2024-08-17T02:47:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.882+0000 7f853b400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f853c0afca0 0x7f853c1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58914/0 (socket says 172.21.15.5:58914) 2024-08-17T02:47:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.882+0000 7f853b400640 1 -- 172.21.15.5:0/2113042560 learned_addr learned my addr 172.21.15.5:0/2113042560 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.883+0000 7f853be00640 1 --2- 172.21.15.5:0/2113042560 >> v2:172.21.15.107:3300/0 conn(0x7f853c0acf10 0x7f853c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.883+0000 7f853aa00640 1 -- 172.21.15.5:0/2113042560 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397287634 0 0) 0x7f853c0c92b0 con 0x7f853c0afca0 2024-08-17T02:47:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.883+0000 7f853aa00640 1 -- 172.21.15.5:0/2113042560 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85200034e0 con 0x7f853c0afca0 2024-08-17T02:47:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.883+0000 7f853aa00640 1 -- 172.21.15.5:0/2113042560 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640591274 0 0) 0x7f853c0ad480 con 0x7f853c1590b0 2024-08-17T02:47:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.883+0000 7f853aa00640 1 -- 172.21.15.5:0/2113042560 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f853c0c92b0 con 0x7f853c1590b0 2024-08-17T02:47:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.883+0000 7f853be00640 1 -- 172.21.15.5:0/2113042560 >> v1:172.21.15.107:6789/0 conn(0x7f853c1590b0 legacy=0x7f853c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.883+0000 7f853aa00640 1 -- 172.21.15.5:0/2113042560 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3022907972 0 0) 0x7f85200034e0 con 0x7f853c0afca0 2024-08-17T02:47:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.883+0000 7f853be00640 1 -- 172.21.15.5:0/2113042560 >> v1:172.21.15.5:6789/0 conn(0x7f853c0afca0 legacy=0x7f853c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.883+0000 7f853be00640 1 -- 172.21.15.5:0/2113042560 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c0ad760 con 0x7f853c0acf10 2024-08-17T02:47:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.884+0000 7f853be00640 1 --2- 172.21.15.5:0/2113042560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f853c0acf10 0x7f853c0b0070 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8534009e60 tx=0x7f8534009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13e252660f965988 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.884+0000 7f853aa00640 1 -- 172.21.15.5:0/2113042560 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c001470 con 0x7f853c0acf10 2024-08-17T02:47:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.885+0000 7f853aa00640 1 -- 172.21.15.5:0/2113042560 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853402d050 con 0x7f853c0acf10 2024-08-17T02:47:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.885+0000 7f853aa00640 1 -- 172.21.15.5:0/2113042560 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8534031610 con 0x7f853c0acf10 2024-08-17T02:47:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.885+0000 7f8542600640 1 -- 172.21.15.5:0/2113042560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f853c0acf10 msgr2=0x7f853c0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.885+0000 7f8542600640 1 --2- 172.21.15.5:0/2113042560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f853c0acf10 0x7f853c0b0070 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8534009e60 tx=0x7f8534009780 comp rx=0 tx=0).stop 2024-08-17T02:47:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.885+0000 7f8542600640 1 -- 172.21.15.5:0/2113042560 shutdown_connections 2024-08-17T02:47:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.885+0000 7f8542600640 1 --2- 172.21.15.5:0/2113042560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f853c0acf10 0x7f853c0b0070 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.885+0000 7f8542600640 1 -- 172.21.15.5:0/2113042560 >> 172.21.15.5:0/2113042560 conn(0x7f853c066e60 msgr2=0x7f853c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.885+0000 7f8542600640 1 -- 172.21.15.5:0/2113042560 shutdown_connections 2024-08-17T02:47:50.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.885+0000 7f8542600640 1 -- 172.21.15.5:0/2113042560 wait complete. 2024-08-17T02:47:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.887+0000 7f8542600640 1 Processor -- start 2024-08-17T02:47:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.887+0000 7f8542600640 1 -- start start 2024-08-17T02:47:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.888+0000 7f8542600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f853c0acf10 0x7f853c149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.888+0000 7f8542600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f853c0afca0 0x7f853c14ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.888+0000 7f8542600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f853c1590b0 0x7f853c153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.888+0000 7f8542600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c14f760 con 0x7f853c1590b0 2024-08-17T02:47:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.888+0000 7f8542600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c14fa40 con 0x7f853c0afca0 2024-08-17T02:47:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.888+0000 7f8542600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c14fd20 con 0x7f853c0acf10 2024-08-17T02:47:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.888+0000 7f853be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f853c1590b0 0x7f853c153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.888+0000 7f853be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f853c1590b0 0x7f853c153040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47730/0 (socket says 172.21.15.5:47730) 2024-08-17T02:47:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.888+0000 7f853be00640 1 -- 172.21.15.5:0/1679639998 learned_addr learned my addr 172.21.15.5:0/1679639998 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.888+0000 7f853b400640 1 --2- 172.21.15.5:0/1679639998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f853c0acf10 0x7f853c149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.888+0000 7f8532a00640 1 --2- 172.21.15.5:0/1679639998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f853c0afca0 0x7f853c14ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.888+0000 7f853be00640 1 -- 172.21.15.5:0/1679639998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f853c0acf10 msgr2=0x7f853c149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.888+0000 7f853be00640 1 --2- 172.21.15.5:0/1679639998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f853c0acf10 0x7f853c149510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.888+0000 7f853be00640 1 -- 172.21.15.5:0/1679639998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f853c0afca0 msgr2=0x7f853c14ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.888+0000 7f853be00640 1 --2- 172.21.15.5:0/1679639998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f853c0afca0 0x7f853c14ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.888+0000 7f853be00640 1 -- 172.21.15.5:0/1679639998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8534009a20 con 0x7f853c1590b0 2024-08-17T02:47:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.889+0000 7f853b400640 1 --2- 172.21.15.5:0/1679639998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f853c0acf10 0x7f853c149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.889+0000 7f853be00640 1 --2- 172.21.15.5:0/1679639998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f853c1590b0 0x7f853c153040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f85340099f0 tx=0x7f8534037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.889+0000 7f8533400640 1 -- 172.21.15.5:0/1679639998 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8534030a60 con 0x7f853c1590b0 2024-08-17T02:47:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.889+0000 7f8533400640 1 -- 172.21.15.5:0/1679639998 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8534030bc0 con 0x7f853c1590b0 2024-08-17T02:47:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.889+0000 7f8542600640 1 -- 172.21.15.5:0/1679639998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853c150000 con 0x7f853c1590b0 2024-08-17T02:47:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.889+0000 7f8533400640 1 -- 172.21.15.5:0/1679639998 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853403d430 con 0x7f853c1590b0 2024-08-17T02:47:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.889+0000 7f8542600640 1 -- 172.21.15.5:0/1679639998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853c149a50 con 0x7f853c1590b0 2024-08-17T02:47:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.890+0000 7f8542600640 1 -- 172.21.15.5:0/1679639998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853c150500 con 0x7f853c1590b0 2024-08-17T02:47:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.891+0000 7f8533400640 1 -- 172.21.15.5:0/1679639998 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8534003040 con 0x7f853c1590b0 2024-08-17T02:47:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.892+0000 7f8533400640 1 --2- 172.21.15.5:0/1679639998 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8518065150 0x7f8518067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.892+0000 7f8533400640 1 -- 172.21.15.5:0/1679639998 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f85340a3ce0 con 0x7f853c1590b0 2024-08-17T02:47:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.892+0000 7f853b400640 1 --2- 172.21.15.5:0/1679639998 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8518065150 0x7f8518067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.893+0000 7f853b400640 1 --2- 172.21.15.5:0/1679639998 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8518065150 0x7f8518067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f852c0011e0 tx=0x7f852c001a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:50.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:50.896+0000 7f8533400640 1 -- 172.21.15.5:0/1679639998 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8534071e60 con 0x7f853c1590b0 2024-08-17T02:47:51.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.079+0000 7f8542600640 1 -- 172.21.15.5:0/1679639998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f853c063fb0 con 0x7f853c1590b0 2024-08-17T02:47:51.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.080+0000 7f8533400640 1 -- 172.21.15.5:0/1679639998 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f8534075480 con 0x7f853c1590b0 2024-08-17T02:47:51.081 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:51.081 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:47:50.109705+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:48.185879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:49.106113+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:51.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.082+0000 7f8542600640 1 -- 172.21.15.5:0/1679639998 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8518065150 msgr2=0x7f8518067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.082+0000 7f8542600640 1 --2- 172.21.15.5:0/1679639998 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8518065150 0x7f8518067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f852c0011e0 tx=0x7f852c001a50 comp rx=0 tx=0).stop 2024-08-17T02:47:51.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.082+0000 7f8542600640 1 -- 172.21.15.5:0/1679639998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f853c1590b0 msgr2=0x7f853c153040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.082+0000 7f8542600640 1 --2- 172.21.15.5:0/1679639998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f853c1590b0 0x7f853c153040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f85340099f0 tx=0x7f8534037000 comp rx=0 tx=0).stop 2024-08-17T02:47:51.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.082+0000 7f8542600640 1 -- 172.21.15.5:0/1679639998 shutdown_connections 2024-08-17T02:47:51.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.082+0000 7f8542600640 1 --2- 172.21.15.5:0/1679639998 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8518065150 0x7f8518067600 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.082+0000 7f8542600640 1 --2- 172.21.15.5:0/1679639998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f853c1590b0 0x7f853c153040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.082+0000 7f8542600640 1 --2- 172.21.15.5:0/1679639998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f853c0afca0 0x7f853c14ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.082+0000 7f8542600640 1 --2- 172.21.15.5:0/1679639998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f853c0acf10 0x7f853c149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.082+0000 7f8542600640 1 -- 172.21.15.5:0/1679639998 >> 172.21.15.5:0/1679639998 conn(0x7f853c066e60 msgr2=0x7f853c1542e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:51.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.083+0000 7f8542600640 1 -- 172.21.15.5:0/1679639998 shutdown_connections 2024-08-17T02:47:51.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.083+0000 7f8542600640 1 -- 172.21.15.5:0/1679639998 wait complete. 2024-08-17T02:47:51.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:51.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.249+0000 7f5046e00640 1 Processor -- start 2024-08-17T02:47:51.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.250+0000 7f5046e00640 1 -- start start 2024-08-17T02:47:51.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.251+0000 7f5046e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5040156f90 0x7f50400b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:51.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.251+0000 7f5046e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504006d7c0 con 0x7f504015a590 2024-08-17T02:47:51.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.251+0000 7f5046e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504015ab30 con 0x7f50400b0e30 2024-08-17T02:47:51.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.251+0000 7f5046e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504015ae10 con 0x7f5040156f90 2024-08-17T02:47:51.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.251+0000 7f5046400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f504015a590 0x7f504013fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58924/0 (socket says 172.21.15.5:58924) 2024-08-17T02:47:51.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.251+0000 7f5046400640 1 -- 172.21.15.5:0/2165836543 learned_addr learned my addr 172.21.15.5:0/2165836543 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:51.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.251+0000 7f5045000640 1 --2- 172.21.15.5:0/2165836543 >> v2:172.21.15.107:3300/0 conn(0x7f5040156f90 0x7f50400b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.251+0000 7f503fe00640 1 -- 172.21.15.5:0/2165836543 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490391913 0 0) 0x7f504006d7c0 con 0x7f504015a590 2024-08-17T02:47:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.252+0000 7f503fe00640 1 -- 172.21.15.5:0/2165836543 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50280034e0 con 0x7f504015a590 2024-08-17T02:47:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.252+0000 7f503fe00640 1 -- 172.21.15.5:0/2165836543 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580112362 0 0) 0x7f504015ab30 con 0x7f50400b0e30 2024-08-17T02:47:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.252+0000 7f503fe00640 1 -- 172.21.15.5:0/2165836543 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f504006d7c0 con 0x7f50400b0e30 2024-08-17T02:47:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.252+0000 7f5045000640 1 -- 172.21.15.5:0/2165836543 >> v1:172.21.15.107:6789/0 conn(0x7f50400b0e30 legacy=0x7f50400cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.252+0000 7f5045000640 1 -- 172.21.15.5:0/2165836543 >> v1:172.21.15.5:6789/0 conn(0x7f504015a590 legacy=0x7f504013fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.252+0000 7f5045000640 1 -- 172.21.15.5:0/2165836543 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504015b0f0 con 0x7f5040156f90 2024-08-17T02:47:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.253+0000 7f5045000640 1 --2- 172.21.15.5:0/2165836543 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5040156f90 0x7f50400b1200 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f502c009850 tx=0x7f502c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c6f191bd1f85dfa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:51.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.253+0000 7f503fe00640 1 -- 172.21.15.5:0/2165836543 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c02ae20 con 0x7f5040156f90 2024-08-17T02:47:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.253+0000 7f503fe00640 1 -- 172.21.15.5:0/2165836543 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c032440 con 0x7f5040156f90 2024-08-17T02:47:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.253+0000 7f503fe00640 1 -- 172.21.15.5:0/2165836543 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c0327c0 con 0x7f5040156f90 2024-08-17T02:47:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.254+0000 7f5046e00640 1 -- 172.21.15.5:0/2165836543 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5040156f90 msgr2=0x7f50400b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.254+0000 7f5046e00640 1 --2- 172.21.15.5:0/2165836543 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5040156f90 0x7f50400b1200 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f502c009850 tx=0x7f502c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.254+0000 7f5046e00640 1 -- 172.21.15.5:0/2165836543 shutdown_connections 2024-08-17T02:47:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.254+0000 7f5046e00640 1 --2- 172.21.15.5:0/2165836543 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5040156f90 0x7f50400b1200 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.254+0000 7f5046e00640 1 -- 172.21.15.5:0/2165836543 >> 172.21.15.5:0/2165836543 conn(0x7f5040062af0 msgr2=0x7f5040062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.254+0000 7f5046e00640 1 -- 172.21.15.5:0/2165836543 shutdown_connections 2024-08-17T02:47:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.254+0000 7f5046e00640 1 -- 172.21.15.5:0/2165836543 wait complete. 2024-08-17T02:47:51.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.255+0000 7f5046e00640 1 Processor -- start 2024-08-17T02:47:51.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.255+0000 7f5046e00640 1 -- start start 2024-08-17T02:47:51.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.256+0000 7f5046e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50400b0e30 0x7f5040136300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:51.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.256+0000 7f5046e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5040156f90 0x7f5040167a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:51.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.256+0000 7f5046e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504015a590 0x7f50400c0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:51.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.256+0000 7f5046e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50400c0fc0 con 0x7f504015a590 2024-08-17T02:47:51.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.256+0000 7f5046e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5040136cc0 con 0x7f50400b0e30 2024-08-17T02:47:51.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.256+0000 7f5046e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5040137650 con 0x7f5040156f90 2024-08-17T02:47:51.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.256+0000 7f5046400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504015a590 0x7f50400c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:51.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.256+0000 7f5046400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504015a590 0x7f50400c0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47742/0 (socket says 172.21.15.5:47742) 2024-08-17T02:47:51.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.256+0000 7f5046400640 1 -- 172.21.15.5:0/1205193830 learned_addr learned my addr 172.21.15.5:0/1205193830 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:51.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.257+0000 7f5045a00640 1 --2- 172.21.15.5:0/1205193830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50400b0e30 0x7f5040136300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:51.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.257+0000 7f5045000640 1 --2- 172.21.15.5:0/1205193830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5040156f90 0x7f5040167a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:51.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.257+0000 7f5046400640 1 -- 172.21.15.5:0/1205193830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5040156f90 msgr2=0x7f5040167a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.257+0000 7f5046400640 1 --2- 172.21.15.5:0/1205193830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5040156f90 0x7f5040167a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.257+0000 7f5046400640 1 -- 172.21.15.5:0/1205193830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50400b0e30 msgr2=0x7f5040136300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.257+0000 7f5046400640 1 --2- 172.21.15.5:0/1205193830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50400b0e30 0x7f5040136300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.257+0000 7f5046400640 1 -- 172.21.15.5:0/1205193830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c009390 con 0x7f504015a590 2024-08-17T02:47:51.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.257+0000 7f5046400640 1 --2- 172.21.15.5:0/1205193830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504015a590 0x7f50400c0870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f503800cbc0 tx=0x7f5038001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.257+0000 7f503cc00640 1 -- 172.21.15.5:0/1205193830 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503800a640 con 0x7f504015a590 2024-08-17T02:47:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.257+0000 7f503cc00640 1 -- 172.21.15.5:0/1205193830 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503800a7a0 con 0x7f504015a590 2024-08-17T02:47:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.258+0000 7f503cc00640 1 -- 172.21.15.5:0/1205193830 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503800aba0 con 0x7f504015a590 2024-08-17T02:47:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.258+0000 7f5046e00640 1 -- 172.21.15.5:0/1205193830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50401378f0 con 0x7f504015a590 2024-08-17T02:47:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.258+0000 7f5046e00640 1 -- 172.21.15.5:0/1205193830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50401371b0 con 0x7f504015a590 2024-08-17T02:47:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.259+0000 7f5046e00640 1 -- 172.21.15.5:0/1205193830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5040070720 con 0x7f504015a590 2024-08-17T02:47:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.259+0000 7f503cc00640 1 -- 172.21.15.5:0/1205193830 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5038007300 con 0x7f504015a590 2024-08-17T02:47:51.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.260+0000 7f503cc00640 1 --2- 172.21.15.5:0/1205193830 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5020065150 0x7f5020067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:51.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.260+0000 7f503cc00640 1 -- 172.21.15.5:0/1205193830 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50380826a0 con 0x7f504015a590 2024-08-17T02:47:51.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.260+0000 7f5045a00640 1 --2- 172.21.15.5:0/1205193830 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5020065150 0x7f5020067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:51.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.261+0000 7f5045a00640 1 --2- 172.21.15.5:0/1205193830 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5020065150 0x7f5020067600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5040139b60 tx=0x7f5034007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.264+0000 7f503cc00640 1 -- 172.21.15.5:0/1205193830 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f50380507f0 con 0x7f504015a590 2024-08-17T02:47:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.447+0000 7f5046e00640 1 -- 172.21.15.5:0/1205193830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50400c7f30 con 0x7f504015a590 2024-08-17T02:47:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.448+0000 7f503cc00640 1 -- 172.21.15.5:0/1205193830 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f5038004b20 con 0x7f504015a590 2024-08-17T02:47:51.450 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:51.450 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:47:50.109705+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:48.185879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:49.106113+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.450+0000 7f5046e00640 1 -- 172.21.15.5:0/1205193830 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5020065150 msgr2=0x7f5020067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.450+0000 7f5046e00640 1 --2- 172.21.15.5:0/1205193830 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5020065150 0x7f5020067600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5040139b60 tx=0x7f5034007ca0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.450+0000 7f5046e00640 1 -- 172.21.15.5:0/1205193830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504015a590 msgr2=0x7f50400c0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.450+0000 7f5046e00640 1 --2- 172.21.15.5:0/1205193830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504015a590 0x7f50400c0870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f503800cbc0 tx=0x7f5038001a20 comp rx=0 tx=0).stop 2024-08-17T02:47:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.450+0000 7f5046e00640 1 -- 172.21.15.5:0/1205193830 shutdown_connections 2024-08-17T02:47:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.450+0000 7f5046e00640 1 --2- 172.21.15.5:0/1205193830 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5020065150 0x7f5020067600 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.450+0000 7f5046e00640 1 --2- 172.21.15.5:0/1205193830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f504015a590 0x7f50400c0870 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.450+0000 7f5046e00640 1 --2- 172.21.15.5:0/1205193830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5040156f90 0x7f5040167a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.450+0000 7f5046e00640 1 --2- 172.21.15.5:0/1205193830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50400b0e30 0x7f5040136300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.450+0000 7f5046e00640 1 -- 172.21.15.5:0/1205193830 >> 172.21.15.5:0/1205193830 conn(0x7f5040062af0 msgr2=0x7f50400cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.450+0000 7f5046e00640 1 -- 172.21.15.5:0/1205193830 shutdown_connections 2024-08-17T02:47:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.451+0000 7f5046e00640 1 -- 172.21.15.5:0/1205193830 wait complete. 2024-08-17T02:47:51.467 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:47:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.620+0000 7fddcc800640 1 Processor -- start 2024-08-17T02:47:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.620+0000 7fddcc800640 1 -- start start 2024-08-17T02:47:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.621+0000 7fddcc800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fddc40af1f0 0x7fddc40ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.621+0000 7fddcc800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc40b14e0 con 0x7fddc4069d40 2024-08-17T02:47:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.621+0000 7fddcc800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc4069210 con 0x7fddc4159100 2024-08-17T02:47:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.621+0000 7fddcc800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc40694f0 con 0x7fddc40af1f0 2024-08-17T02:47:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.621+0000 7fddca800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fddc4069d40 0x7fddc40cd170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58932/0 (socket says 172.21.15.5:58932) 2024-08-17T02:47:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.621+0000 7fddca800640 1 -- 172.21.15.5:0/1328071886 learned_addr learned my addr 172.21.15.5:0/1328071886 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.622+0000 7fddc9400640 1 --2- 172.21.15.5:0/1328071886 >> v2:172.21.15.107:3300/0 conn(0x7fddc40af1f0 0x7fddc40ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.622+0000 7fddc8a00640 1 -- 172.21.15.5:0/1328071886 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99125158 0 0) 0x7fddc40b14e0 con 0x7fddc4069d40 2024-08-17T02:47:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.622+0000 7fddc8a00640 1 -- 172.21.15.5:0/1328071886 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddac0034e0 con 0x7fddc4069d40 2024-08-17T02:47:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.622+0000 7fddc9400640 1 -- 172.21.15.5:0/1328071886 >> v1:172.21.15.107:6789/0 conn(0x7fddc4159100 legacy=0x7fddc40aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.622+0000 7fddc9400640 1 -- 172.21.15.5:0/1328071886 >> v1:172.21.15.5:6789/0 conn(0x7fddc4069d40 legacy=0x7fddc40cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.622+0000 7fddc9400640 1 -- 172.21.15.5:0/1328071886 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc40697d0 con 0x7fddc40af1f0 2024-08-17T02:47:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.623+0000 7fddc9400640 1 --2- 172.21.15.5:0/1328071886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddc40af1f0 0x7fddc40ccc30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009850 tx=0x7fddb40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f58a9310e35403ea server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.623+0000 7fddc8a00640 1 -- 172.21.15.5:0/1328071886 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb402ad90 con 0x7fddc40af1f0 2024-08-17T02:47:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.623+0000 7fddc8a00640 1 -- 172.21.15.5:0/1328071886 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb4032440 con 0x7fddc40af1f0 2024-08-17T02:47:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.623+0000 7fddc8a00640 1 -- 172.21.15.5:0/1328071886 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb40327e0 con 0x7fddc40af1f0 2024-08-17T02:47:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.624+0000 7fddcc800640 1 -- 172.21.15.5:0/1328071886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddc40af1f0 msgr2=0x7fddc40ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.624+0000 7fddcc800640 1 --2- 172.21.15.5:0/1328071886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddc40af1f0 0x7fddc40ccc30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009850 tx=0x7fddb40090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.624+0000 7fddcc800640 1 -- 172.21.15.5:0/1328071886 shutdown_connections 2024-08-17T02:47:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.624+0000 7fddcc800640 1 --2- 172.21.15.5:0/1328071886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddc40af1f0 0x7fddc40ccc30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.624+0000 7fddcc800640 1 -- 172.21.15.5:0/1328071886 >> 172.21.15.5:0/1328071886 conn(0x7fddc40ce5e0 msgr2=0x7fddc4095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.624+0000 7fddcc800640 1 -- 172.21.15.5:0/1328071886 shutdown_connections 2024-08-17T02:47:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.624+0000 7fddcc800640 1 -- 172.21.15.5:0/1328071886 wait complete. 2024-08-17T02:47:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.625+0000 7fddcc800640 1 Processor -- start 2024-08-17T02:47:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.626+0000 7fddcc800640 1 -- start start 2024-08-17T02:47:51.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.626+0000 7fddcc800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc4069d40 0x7fddc4158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:51.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.626+0000 7fddcc800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddc40af1f0 0x7fddc4097930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:51.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.626+0000 7fddcc800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddc4159100 0x7fddc4097e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.626+0000 7fddcc800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc416c550 con 0x7fddc4069d40 2024-08-17T02:47:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.626+0000 7fddcc800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc416b940 con 0x7fddc40af1f0 2024-08-17T02:47:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.626+0000 7fddcc800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc416bc20 con 0x7fddc4159100 2024-08-17T02:47:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.627+0000 7fddc9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc4069d40 0x7fddc4158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.627+0000 7fddc9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc4069d40 0x7fddc4158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47752/0 (socket says 172.21.15.5:47752) 2024-08-17T02:47:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.627+0000 7fddc9e00640 1 -- 172.21.15.5:0/2163669005 learned_addr learned my addr 172.21.15.5:0/2163669005 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.627+0000 7fddc9e00640 1 -- 172.21.15.5:0/2163669005 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddc4159100 msgr2=0x7fddc4097e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.627+0000 7fddc9e00640 1 --2- 172.21.15.5:0/2163669005 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddc4159100 0x7fddc4097e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.627+0000 7fddc9e00640 1 -- 172.21.15.5:0/2163669005 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddc40af1f0 msgr2=0x7fddc4097930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.627+0000 7fddc9e00640 1 --2- 172.21.15.5:0/2163669005 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddc40af1f0 0x7fddc4097930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.627+0000 7fddc9e00640 1 -- 172.21.15.5:0/2163669005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb4009390 con 0x7fddc4069d40 2024-08-17T02:47:51.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.627+0000 7fddc9e00640 1 --2- 172.21.15.5:0/2163669005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc4069d40 0x7fddc4158290 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fddb800c4c0 tx=0x7fddb8007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:51.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.628+0000 7fddbd600640 1 -- 172.21.15.5:0/2163669005 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb8011590 con 0x7fddc4069d40 2024-08-17T02:47:51.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.628+0000 7fddbd600640 1 -- 172.21.15.5:0/2163669005 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb8011710 con 0x7fddc4069d40 2024-08-17T02:47:51.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.628+0000 7fddcc800640 1 -- 172.21.15.5:0/2163669005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc416bf00 con 0x7fddc4069d40 2024-08-17T02:47:51.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.628+0000 7fddbd600640 1 -- 172.21.15.5:0/2163669005 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb8011ad0 con 0x7fddc4069d40 2024-08-17T02:47:51.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.628+0000 7fddcc800640 1 -- 172.21.15.5:0/2163669005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc41587d0 con 0x7fddc4069d40 2024-08-17T02:47:51.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.629+0000 7fddcc800640 1 -- 172.21.15.5:0/2163669005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc41589c0 con 0x7fddc4069d40 2024-08-17T02:47:51.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.630+0000 7fddbd600640 1 -- 172.21.15.5:0/2163669005 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fddb801b3b0 con 0x7fddc4069d40 2024-08-17T02:47:51.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.630+0000 7fddbd600640 1 --2- 172.21.15.5:0/2163669005 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fdda8065150 0x7fdda8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.630+0000 7fddbd600640 1 -- 172.21.15.5:0/2163669005 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fddb80819c0 con 0x7fddc4069d40 2024-08-17T02:47:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.631+0000 7fddc9400640 1 --2- 172.21.15.5:0/2163669005 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fdda8065150 0x7fdda8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.631+0000 7fddc9400640 1 --2- 172.21.15.5:0/2163669005 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fdda8065150 0x7fdda8067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fddb4034000 tx=0x7fddb4032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:51.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.635+0000 7fddbd600640 1 -- 172.21.15.5:0/2163669005 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fddb804f9e0 con 0x7fddc4069d40 2024-08-17T02:47:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:51.859+0000 7fddcc800640 1 -- 172.21.15.5:0/2163669005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fddc4063fb0 con 0x7fddc4069d40 2024-08-17T02:47:52.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.706+0000 7fddbd600640 1 -- 172.21.15.5:0/2163669005 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fddb8017070 con 0x7fddc4069d40 2024-08-17T02:47:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.708+0000 7fddcc800640 1 -- 172.21.15.5:0/2163669005 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fdda8065150 msgr2=0x7fdda8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.708+0000 7fddcc800640 1 --2- 172.21.15.5:0/2163669005 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fdda8065150 0x7fdda8067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fddb4034000 tx=0x7fddb4032000 comp rx=0 tx=0).stop 2024-08-17T02:47:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.708+0000 7fddcc800640 1 -- 172.21.15.5:0/2163669005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc4069d40 msgr2=0x7fddc4158290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.708+0000 7fddcc800640 1 --2- 172.21.15.5:0/2163669005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc4069d40 0x7fddc4158290 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fddb800c4c0 tx=0x7fddb8007ef0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.709+0000 7fddcc800640 1 -- 172.21.15.5:0/2163669005 shutdown_connections 2024-08-17T02:47:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.709+0000 7fddcc800640 1 --2- 172.21.15.5:0/2163669005 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fdda8065150 0x7fdda8067600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.709+0000 7fddcc800640 1 --2- 172.21.15.5:0/2163669005 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fddc4159100 0x7fddc4097e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.709+0000 7fddcc800640 1 --2- 172.21.15.5:0/2163669005 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddc40af1f0 0x7fddc4097930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.709+0000 7fddcc800640 1 --2- 172.21.15.5:0/2163669005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc4069d40 0x7fddc4158290 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.709+0000 7fddcc800640 1 -- 172.21.15.5:0/2163669005 >> 172.21.15.5:0/2163669005 conn(0x7fddc40ce5e0 msgr2=0x7fddc40ad400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:52.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.709+0000 7fddcc800640 1 -- 172.21.15.5:0/2163669005 shutdown_connections 2024-08-17T02:47:52.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.709+0000 7fddcc800640 1 -- 172.21.15.5:0/2163669005 wait complete. 2024-08-17T02:47:52.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:47:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.885+0000 7fa4b4200640 1 Processor -- start 2024-08-17T02:47:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.885+0000 7fa4b4200640 1 -- start start 2024-08-17T02:47:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.886+0000 7fa4b4200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4ac0add30 0x7fa4ac156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.887+0000 7fa4b4200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ac0cb160 con 0x7fa4ac0ad960 2024-08-17T02:47:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.887+0000 7fa4b4200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ac0b0d10 con 0x7fa4ac0ca050 2024-08-17T02:47:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.887+0000 7fa4b4200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac0ca550 con 0x7fa4ac0add30 2024-08-17T02:47:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.887+0000 7fa4b1800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa4ac0ad960 0x7fa4ac156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58940/0 (socket says 172.21.15.5:58940) 2024-08-17T02:47:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.887+0000 7fa4b1800640 1 -- 172.21.15.5:0/2815687971 learned_addr learned my addr 172.21.15.5:0/2815687971 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.887+0000 7fa4b2200640 1 --2- 172.21.15.5:0/2815687971 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4ac0add30 0x7fa4ac156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.887+0000 7fa4abe00640 1 -- 172.21.15.5:0/2815687971 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687920603 0 0) 0x7fa4ac0cb160 con 0x7fa4ac0ad960 2024-08-17T02:47:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.887+0000 7fa4abe00640 1 -- 172.21.15.5:0/2815687971 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4940034e0 con 0x7fa4ac0ad960 2024-08-17T02:47:52.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.887+0000 7fa4abe00640 1 -- 172.21.15.5:0/2815687971 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813214011 0 0) 0x7fa4ac0b0d10 con 0x7fa4ac0ca050 2024-08-17T02:47:52.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.887+0000 7fa4abe00640 1 -- 172.21.15.5:0/2815687971 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4ac0cb160 con 0x7fa4ac0ca050 2024-08-17T02:47:52.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.887+0000 7fa4b2200640 1 -- 172.21.15.5:0/2815687971 >> v1:172.21.15.107:6789/0 conn(0x7fa4ac0ca050 legacy=0x7fa4ac0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.888+0000 7fa4b2200640 1 -- 172.21.15.5:0/2815687971 >> v1:172.21.15.5:6789/0 conn(0x7fa4ac0ad960 legacy=0x7fa4ac156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.888+0000 7fa4b2200640 1 -- 172.21.15.5:0/2815687971 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac0ca830 con 0x7fa4ac0add30 2024-08-17T02:47:52.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.889+0000 7fa4b2200640 1 --2- 172.21.15.5:0/2815687971 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4ac0add30 0x7fa4ac156b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009e90 tx=0x7fa4a4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c33e456f4d94733 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:52.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.889+0000 7fa4abe00640 1 -- 172.21.15.5:0/2815687971 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4032420 con 0x7fa4ac0add30 2024-08-17T02:47:52.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.889+0000 7fa4abe00640 1 -- 172.21.15.5:0/2815687971 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a4032580 con 0x7fa4ac0add30 2024-08-17T02:47:52.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.889+0000 7fa4abe00640 1 -- 172.21.15.5:0/2815687971 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4032920 con 0x7fa4ac0add30 2024-08-17T02:47:52.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.889+0000 7fa4b4200640 1 -- 172.21.15.5:0/2815687971 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4ac0add30 msgr2=0x7fa4ac156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.889+0000 7fa4b4200640 1 --2- 172.21.15.5:0/2815687971 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4ac0add30 0x7fa4ac156b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009e90 tx=0x7fa4a4009780 comp rx=0 tx=0).stop 2024-08-17T02:47:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.890+0000 7fa4b4200640 1 -- 172.21.15.5:0/2815687971 shutdown_connections 2024-08-17T02:47:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.890+0000 7fa4b4200640 1 --2- 172.21.15.5:0/2815687971 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4ac0add30 0x7fa4ac156b30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.890+0000 7fa4b4200640 1 -- 172.21.15.5:0/2815687971 >> 172.21.15.5:0/2815687971 conn(0x7fa4ac066e60 msgr2=0x7fa4ac067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.890+0000 7fa4b4200640 1 -- 172.21.15.5:0/2815687971 shutdown_connections 2024-08-17T02:47:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.890+0000 7fa4b4200640 1 -- 172.21.15.5:0/2815687971 wait complete. 2024-08-17T02:47:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.891+0000 7fa4b4200640 1 Processor -- start 2024-08-17T02:47:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.891+0000 7fa4b4200640 1 -- start start 2024-08-17T02:47:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.892+0000 7fa4b4200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4ac0ad960 0x7fa4ac148440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.892+0000 7fa4b4200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4ac0add30 0x7fa4ac0a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.892+0000 7fa4b4200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0ca050 0x7fa4ac168a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.892+0000 7fa4b4200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac0a8f10 con 0x7fa4ac0ca050 2024-08-17T02:47:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.892+0000 7fa4b4200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac0a88e0 con 0x7fa4ac0ad960 2024-08-17T02:47:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.892+0000 7fa4b4200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac169570 con 0x7fa4ac0add30 2024-08-17T02:47:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.893+0000 7fa4b2200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0ca050 0x7fa4ac168a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.893+0000 7fa4b2200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0ca050 0x7fa4ac168a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47762/0 (socket says 172.21.15.5:47762) 2024-08-17T02:47:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.893+0000 7fa4b2200640 1 -- 172.21.15.5:0/989711892 learned_addr learned my addr 172.21.15.5:0/989711892 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.893+0000 7fa4b0e00640 1 --2- 172.21.15.5:0/989711892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4ac0add30 0x7fa4ac0a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.893+0000 7fa4b1800640 1 --2- 172.21.15.5:0/989711892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4ac0ad960 0x7fa4ac148440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.893+0000 7fa4b2200640 1 -- 172.21.15.5:0/989711892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4ac0add30 msgr2=0x7fa4ac0a93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.893+0000 7fa4b2200640 1 --2- 172.21.15.5:0/989711892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4ac0add30 0x7fa4ac0a93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.893+0000 7fa4b2200640 1 -- 172.21.15.5:0/989711892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4ac0ad960 msgr2=0x7fa4ac148440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.893+0000 7fa4b2200640 1 --2- 172.21.15.5:0/989711892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4ac0ad960 0x7fa4ac148440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.893+0000 7fa4b2200640 1 -- 172.21.15.5:0/989711892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a4009a20 con 0x7fa4ac0ca050 2024-08-17T02:47:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.893+0000 7fa4b1800640 1 --2- 172.21.15.5:0/989711892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4ac0ad960 0x7fa4ac148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.893+0000 7fa4b2200640 1 --2- 172.21.15.5:0/989711892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0ca050 0x7fa4ac168a40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40099f0 tx=0x7fa4a4038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.893+0000 7fa4a8c00640 1 -- 172.21.15.5:0/989711892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4031870 con 0x7fa4ac0ca050 2024-08-17T02:47:52.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.894+0000 7fa4a8c00640 1 -- 172.21.15.5:0/989711892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a4041070 con 0x7fa4ac0ca050 2024-08-17T02:47:52.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.894+0000 7fa4a8c00640 1 -- 172.21.15.5:0/989711892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4031c00 con 0x7fa4ac0ca050 2024-08-17T02:47:52.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.894+0000 7fa4b4200640 1 -- 172.21.15.5:0/989711892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ac169850 con 0x7fa4ac0ca050 2024-08-17T02:47:52.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.894+0000 7fa4b4200640 1 -- 172.21.15.5:0/989711892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ac148980 con 0x7fa4ac0ca050 2024-08-17T02:47:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.895+0000 7fa4b4200640 1 -- 172.21.15.5:0/989711892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ac1699e0 con 0x7fa4ac0ca050 2024-08-17T02:47:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.895+0000 7fa4a8c00640 1 -- 172.21.15.5:0/989711892 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa4a4043030 con 0x7fa4ac0ca050 2024-08-17T02:47:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.896+0000 7fa4a8c00640 1 --2- 172.21.15.5:0/989711892 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa48c065150 0x7fa48c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.896+0000 7fa4a8c00640 1 -- 172.21.15.5:0/989711892 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4a40a3a70 con 0x7fa4ac0ca050 2024-08-17T02:47:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.897+0000 7fa4b1800640 1 --2- 172.21.15.5:0/989711892 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa48c065150 0x7fa48c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.897+0000 7fa4b1800640 1 --2- 172.21.15.5:0/989711892 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa48c065150 0x7fa48c067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0005840 tx=0x7fa4a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:52.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:52.900+0000 7fa4a8c00640 1 -- 172.21.15.5:0/989711892 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa4a4071c00 con 0x7fa4ac0ca050 2024-08-17T02:47:53.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.121+0000 7fa4b4200640 1 -- 172.21.15.5:0/989711892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa4ac063fb0 con 0x7fa4ac0ca050 2024-08-17T02:47:53.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.712+0000 7fa4a8c00640 1 -- 172.21.15.5:0/989711892 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa4a4075220 con 0x7fa4ac0ca050 2024-08-17T02:47:53.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.714+0000 7fa4b4200640 1 -- 172.21.15.5:0/989711892 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa48c065150 msgr2=0x7fa48c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:53.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.714+0000 7fa4b4200640 1 --2- 172.21.15.5:0/989711892 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa48c065150 0x7fa48c067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0005840 tx=0x7fa4a0009040 comp rx=0 tx=0).stop 2024-08-17T02:47:53.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.714+0000 7fa4b4200640 1 -- 172.21.15.5:0/989711892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0ca050 msgr2=0x7fa4ac168a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:53.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.714+0000 7fa4b4200640 1 --2- 172.21.15.5:0/989711892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0ca050 0x7fa4ac168a40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40099f0 tx=0x7fa4a4038000 comp rx=0 tx=0).stop 2024-08-17T02:47:53.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.715+0000 7fa4b4200640 1 -- 172.21.15.5:0/989711892 shutdown_connections 2024-08-17T02:47:53.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.715+0000 7fa4b4200640 1 --2- 172.21.15.5:0/989711892 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa48c065150 0x7fa48c067600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:53.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.715+0000 7fa4b4200640 1 --2- 172.21.15.5:0/989711892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0ca050 0x7fa4ac168a40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:53.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.715+0000 7fa4b4200640 1 --2- 172.21.15.5:0/989711892 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa4ac0add30 0x7fa4ac0a93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:53.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.715+0000 7fa4b4200640 1 --2- 172.21.15.5:0/989711892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4ac0ad960 0x7fa4ac148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:53.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.715+0000 7fa4b4200640 1 -- 172.21.15.5:0/989711892 >> 172.21.15.5:0/989711892 conn(0x7fa4ac066e60 msgr2=0x7fa4ac1527d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:53.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.715+0000 7fa4b4200640 1 -- 172.21.15.5:0/989711892 shutdown_connections 2024-08-17T02:47:53.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.715+0000 7fa4b4200640 1 -- 172.21.15.5:0/989711892 wait complete. 2024-08-17T02:47:53.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.889+0000 7fd3c6600640 1 Processor -- start 2024-08-17T02:47:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.889+0000 7fd3c6600640 1 -- start start 2024-08-17T02:47:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.890+0000 7fd3c6600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3c00afca0 0x7fd3c00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:53.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.890+0000 7fd3c6600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd3c00acf10 0x7fd3c0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:53.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.890+0000 7fd3c6600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c015a4e0 con 0x7fd3c01589a0 2024-08-17T02:47:53.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.890+0000 7fd3c6600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c00b0980 con 0x7fd3c00acf10 2024-08-17T02:47:53.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.890+0000 7fd3c6600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00c92b0 con 0x7fd3c00afca0 2024-08-17T02:47:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.892+0000 7fd3bf400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3c00afca0 0x7fd3c00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.892+0000 7fd3bea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd3c00acf10 0x7fd3c0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.892+0000 7fd3bf400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3c00afca0 0x7fd3c00b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:51252/0 (socket says 172.21.15.5:51252) 2024-08-17T02:47:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.892+0000 7fd3bf400640 1 -- 172.21.15.5:0/966576473 learned_addr learned my addr 172.21.15.5:0/966576473 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.892+0000 7fd3bea00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd3c00acf10 0x7fd3c0159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:46274/0 (socket says 172.21.15.5:46274) 2024-08-17T02:47:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.892+0000 7fd3bfe00640 1 --1- 172.21.15.5:0/966576473 >> v1:172.21.15.107:6789/0 conn(0x7fd3c01589a0 0x7fd3c006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:54808/0 (socket says 172.21.15.5:54808) 2024-08-17T02:47:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.892+0000 7fd3bf400640 1 -- 172.21.15.5:0/966576473 >> v2:172.21.15.107:3300/0 conn(0x7fd3c00acf10 msgr2=0x7fd3c0159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.892+0000 7fd3bf400640 1 --2- 172.21.15.5:0/966576473 >> v2:172.21.15.107:3300/0 conn(0x7fd3c00acf10 0x7fd3c0159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.892+0000 7fd3bf400640 1 -- 172.21.15.5:0/966576473 >> v1:172.21.15.107:6789/0 conn(0x7fd3c01589a0 legacy=0x7fd3c006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.892+0000 7fd3bf400640 1 -- 172.21.15.5:0/966576473 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c00ad480 con 0x7fd3c00afca0 2024-08-17T02:47:53.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.892+0000 7fd3bea00640 1 --2- 172.21.15.5:0/966576473 >> v2:172.21.15.107:3300/0 conn(0x7fd3c00acf10 0x7fd3c0159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:53.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.893+0000 7fd3bf400640 1 --2- 172.21.15.5:0/966576473 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3c00afca0 0x7fd3c00b0070 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000bbf0 tx=0x7fd3b000b460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5bf8dbf0eeb846c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:53.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.893+0000 7fd3be000640 1 -- 172.21.15.5:0/966576473 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0031610 con 0x7fd3c00afca0 2024-08-17T02:47:53.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.893+0000 7fd3be000640 1 -- 172.21.15.5:0/966576473 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b0031770 con 0x7fd3c00afca0 2024-08-17T02:47:53.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.893+0000 7fd3be000640 1 -- 172.21.15.5:0/966576473 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0031b50 con 0x7fd3c00afca0 2024-08-17T02:47:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.894+0000 7fd3c6600640 1 -- 172.21.15.5:0/966576473 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3c00afca0 msgr2=0x7fd3c00b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.894+0000 7fd3c6600640 1 --2- 172.21.15.5:0/966576473 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3c00afca0 0x7fd3c00b0070 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000bbf0 tx=0x7fd3b000b460 comp rx=0 tx=0).stop 2024-08-17T02:47:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.894+0000 7fd3c6600640 1 -- 172.21.15.5:0/966576473 shutdown_connections 2024-08-17T02:47:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.894+0000 7fd3c6600640 1 --2- 172.21.15.5:0/966576473 >> v2:172.21.15.107:3300/0 conn(0x7fd3c00acf10 0x7fd3c0159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.894+0000 7fd3c6600640 1 --2- 172.21.15.5:0/966576473 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3c00afca0 0x7fd3c00b0070 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:53.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.894+0000 7fd3c6600640 1 -- 172.21.15.5:0/966576473 >> 172.21.15.5:0/966576473 conn(0x7fd3c0066e60 msgr2=0x7fd3c0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:53.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.894+0000 7fd3c6600640 1 -- 172.21.15.5:0/966576473 shutdown_connections 2024-08-17T02:47:53.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.894+0000 7fd3c6600640 1 -- 172.21.15.5:0/966576473 wait complete. 2024-08-17T02:47:53.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.895+0000 7fd3c6600640 1 Processor -- start 2024-08-17T02:47:53.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.895+0000 7fd3c6600640 1 -- start start 2024-08-17T02:47:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.896+0000 7fd3c6600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3c00acf10 0x7fd3c0151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.896+0000 7fd3c6600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3c00afca0 0x7fd3c0169bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.896+0000 7fd3c6600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3c01589a0 0x7fd3c014a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.896+0000 7fd3c6600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c01524f0 con 0x7fd3c00afca0 2024-08-17T02:47:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.896+0000 7fd3c6600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c01527d0 con 0x7fd3c01589a0 2024-08-17T02:47:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.896+0000 7fd3c6600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c0152ab0 con 0x7fd3c00acf10 2024-08-17T02:47:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.897+0000 7fd3bea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3c00afca0 0x7fd3c0169bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.897+0000 7fd3bea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3c00afca0 0x7fd3c0169bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47766/0 (socket says 172.21.15.5:47766) 2024-08-17T02:47:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.897+0000 7fd3bea00640 1 -- 172.21.15.5:0/258014544 learned_addr learned my addr 172.21.15.5:0/258014544 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.897+0000 7fd3bfe00640 1 --2- 172.21.15.5:0/258014544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3c01589a0 0x7fd3c014a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.897+0000 7fd3bf400640 1 --2- 172.21.15.5:0/258014544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3c00acf10 0x7fd3c0151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:53.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.897+0000 7fd3bea00640 1 -- 172.21.15.5:0/258014544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3c00acf10 msgr2=0x7fd3c0151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:53.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.897+0000 7fd3bea00640 1 --2- 172.21.15.5:0/258014544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3c00acf10 0x7fd3c0151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.897+0000 7fd3bea00640 1 -- 172.21.15.5:0/258014544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3c01589a0 msgr2=0x7fd3c014a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.897+0000 7fd3bea00640 1 --2- 172.21.15.5:0/258014544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3c01589a0 0x7fd3c014a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.897+0000 7fd3bea00640 1 -- 172.21.15.5:0/258014544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac009390 con 0x7fd3c00afca0 2024-08-17T02:47:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.897+0000 7fd3bea00640 1 --2- 172.21.15.5:0/258014544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3c00afca0 0x7fd3c0169bf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00ec80 tx=0x7fd3ac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.898+0000 7fd3b6a00640 1 -- 172.21.15.5:0/258014544 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac00eec0 con 0x7fd3c00afca0 2024-08-17T02:47:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.898+0000 7fd3b6a00640 1 -- 172.21.15.5:0/258014544 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac00cbc0 con 0x7fd3c00afca0 2024-08-17T02:47:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.898+0000 7fd3b6a00640 1 -- 172.21.15.5:0/258014544 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac013470 con 0x7fd3c00afca0 2024-08-17T02:47:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.898+0000 7fd3c6600640 1 -- 172.21.15.5:0/258014544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b000b700 con 0x7fd3c00afca0 2024-08-17T02:47:53.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.898+0000 7fd3c6600640 1 -- 172.21.15.5:0/258014544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c0153070 con 0x7fd3c00afca0 2024-08-17T02:47:53.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.899+0000 7fd3c6600640 1 -- 172.21.15.5:0/258014544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c0063fb0 con 0x7fd3c00afca0 2024-08-17T02:47:53.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.901+0000 7fd3b6a00640 1 -- 172.21.15.5:0/258014544 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd3ac0137e0 con 0x7fd3c00afca0 2024-08-17T02:47:53.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.901+0000 7fd3b6a00640 1 --2- 172.21.15.5:0/258014544 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd3a0065180 0x7fd3a0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:53.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.901+0000 7fd3b6a00640 1 -- 172.21.15.5:0/258014544 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3ac0827c0 con 0x7fd3c00afca0 2024-08-17T02:47:53.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.901+0000 7fd3bf400640 1 --2- 172.21.15.5:0/258014544 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd3a0065180 0x7fd3a0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:53.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.901+0000 7fd3bf400640 1 --2- 172.21.15.5:0/258014544 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd3a0065180 0x7fd3a0067630 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0037000 tx=0x7fd3b003a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:53.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:53.904+0000 7fd3b6a00640 1 -- 172.21.15.5:0/258014544 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd3ac050890 con 0x7fd3c00afca0 2024-08-17T02:47:54.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.124+0000 7fd3c6600640 1 -- 172.21.15.5:0/258014544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3c00b0d00 con 0x7fd3c00afca0 2024-08-17T02:47:54.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.124+0000 7fd3b6a00640 1 -- 172.21.15.5:0/258014544 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fd3ac053eb0 con 0x7fd3c00afca0 2024-08-17T02:47:54.125 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:54.125 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2464391944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2464391944},{"type":"v1","addr":"172.21.15.107:6835","nonce":2464391944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2049823505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2049823505},{"type":"v1","addr":"172.21.15.107:6834","nonce":2049823505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1768626934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1768626934},{"type":"v1","addr":"172.21.15.5:6837","nonce":1768626934}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:50.110026+0000","modified":"2024-08-17T02:47:53.706251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/723455700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":723455700},{"type":"v1","addr":"172.21.15.5:6836","nonce":723455700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:47:54.125 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2024-08-17T02:47:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.126+0000 7fd3c6600640 1 -- 172.21.15.5:0/258014544 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd3a0065180 msgr2=0x7fd3a0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.126+0000 7fd3c6600640 1 --2- 172.21.15.5:0/258014544 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd3a0065180 0x7fd3a0067630 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0037000 tx=0x7fd3b003a000 comp rx=0 tx=0).stop 2024-08-17T02:47:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.126+0000 7fd3c6600640 1 -- 172.21.15.5:0/258014544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3c00afca0 msgr2=0x7fd3c0169bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.126+0000 7fd3c6600640 1 --2- 172.21.15.5:0/258014544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3c00afca0 0x7fd3c0169bf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00ec80 tx=0x7fd3ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.126+0000 7fd3c6600640 1 -- 172.21.15.5:0/258014544 shutdown_connections 2024-08-17T02:47:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.126+0000 7fd3c6600640 1 --2- 172.21.15.5:0/258014544 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd3a0065180 0x7fd3a0067630 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.126+0000 7fd3c6600640 1 --2- 172.21.15.5:0/258014544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3c01589a0 0x7fd3c014a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.126+0000 7fd3c6600640 1 --2- 172.21.15.5:0/258014544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3c00afca0 0x7fd3c0169bf0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.126+0000 7fd3c6600640 1 --2- 172.21.15.5:0/258014544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3c00acf10 0x7fd3c0151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.126+0000 7fd3c6600640 1 -- 172.21.15.5:0/258014544 >> 172.21.15.5:0/258014544 conn(0x7fd3c0066e60 msgr2=0x7fd3c014c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.127+0000 7fd3c6600640 1 -- 172.21.15.5:0/258014544 shutdown_connections 2024-08-17T02:47:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.127+0000 7fd3c6600640 1 -- 172.21.15.5:0/258014544 wait complete. 2024-08-17T02:47:54.142 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:54.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.291+0000 7fc336400640 1 Processor -- start 2024-08-17T02:47:54.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.292+0000 7fc336400640 1 -- start start 2024-08-17T02:47:54.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.293+0000 7fc336400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc330158c60 0x7fc33015a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:54.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.293+0000 7fc336400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33015b6b0 con 0x7fc330159030 2024-08-17T02:47:54.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.293+0000 7fc336400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33015aac0 con 0x7fc330159420 2024-08-17T02:47:54.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.293+0000 7fc336400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300b0540 con 0x7fc330158c60 2024-08-17T02:47:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.293+0000 7fc32fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc330159030 0x7fc3300ca8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58942/0 (socket says 172.21.15.5:58942) 2024-08-17T02:47:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.293+0000 7fc32fe00640 1 -- 172.21.15.5:0/2041002867 learned_addr learned my addr 172.21.15.5:0/2041002867 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.293+0000 7fc335000640 1 --2- 172.21.15.5:0/2041002867 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc330158c60 0x7fc33015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.293+0000 7fc32f400640 1 -- 172.21.15.5:0/2041002867 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275601210 0 0) 0x7fc33015b6b0 con 0x7fc330159030 2024-08-17T02:47:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.293+0000 7fc32f400640 1 -- 172.21.15.5:0/2041002867 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3180034e0 con 0x7fc330159030 2024-08-17T02:47:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc32f400640 1 -- 172.21.15.5:0/2041002867 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660798760 0 0) 0x7fc33015aac0 con 0x7fc330159420 2024-08-17T02:47:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc32f400640 1 -- 172.21.15.5:0/2041002867 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc33015b6b0 con 0x7fc330159420 2024-08-17T02:47:54.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc32f400640 1 -- 172.21.15.5:0/2041002867 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3805540674 0 0) 0x7fc3180034e0 con 0x7fc330159030 2024-08-17T02:47:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc32f400640 1 -- 172.21.15.5:0/2041002867 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc330158c60 msgr2=0x7fc33015a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc32f400640 1 --2- 172.21.15.5:0/2041002867 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc330158c60 0x7fc33015a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc32f400640 1 -- 172.21.15.5:0/2041002867 >> v1:172.21.15.107:6789/0 conn(0x7fc330159420 legacy=0x7fc3300b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc32f400640 1 -- 172.21.15.5:0/2041002867 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33015ad80 con 0x7fc330159030 2024-08-17T02:47:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc32f400640 1 -- 172.21.15.5:0/2041002867 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7fc31c001470 con 0x7fc330159030 2024-08-17T02:47:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc32f400640 1 -- 172.21.15.5:0/2041002867 >> v1:172.21.15.5:6789/0 conn(0x7fc330159030 legacy=0x7fc3300ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc32f400640 1 --2- 172.21.15.5:0/2041002867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc318003c00 0x7fc318003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc32f400640 1 --2- 172.21.15.5:0/2041002867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc318004780 0x7fc318004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc32f400640 1 --2- 172.21.15.5:0/2041002867 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc330158c60 0x7fc3180051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc32f400640 1 -- 172.21.15.5:0/2041002867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300b0540 con 0x7fc318003c00 2024-08-17T02:47:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc32f400640 1 -- 172.21.15.5:0/2041002867 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31800bb60 con 0x7fc318004780 2024-08-17T02:47:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc32f400640 1 -- 172.21.15.5:0/2041002867 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31800bcf0 con 0x7fc330158c60 2024-08-17T02:47:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc335000640 1 --2- 172.21.15.5:0/2041002867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc318003c00 0x7fc318003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc32fe00640 1 --2- 172.21.15.5:0/2041002867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc318004780 0x7fc318004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc335a00640 1 --2- 172.21.15.5:0/2041002867 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc330158c60 0x7fc3180051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc335000640 1 -- 172.21.15.5:0/2041002867 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc330158c60 msgr2=0x7fc3180051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc335000640 1 --2- 172.21.15.5:0/2041002867 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc330158c60 0x7fc3180051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc335000640 1 -- 172.21.15.5:0/2041002867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc318004780 msgr2=0x7fc318004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.294+0000 7fc335000640 1 --2- 172.21.15.5:0/2041002867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc318004780 0x7fc318004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.295+0000 7fc335000640 1 -- 172.21.15.5:0/2041002867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3180034e0 con 0x7fc318003c00 2024-08-17T02:47:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.296+0000 7fc335000640 1 --2- 172.21.15.5:0/2041002867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc318003c00 0x7fc318003ff0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc324009ba0 tx=0x7fc3240090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e2d7231dab7d61 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.296+0000 7fc32f400640 1 -- 172.21.15.5:0/2041002867 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc324031400 con 0x7fc318003c00 2024-08-17T02:47:54.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.296+0000 7fc32f400640 1 -- 172.21.15.5:0/2041002867 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32402d050 con 0x7fc318003c00 2024-08-17T02:47:54.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.296+0000 7fc32f400640 1 -- 172.21.15.5:0/2041002867 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc324031790 con 0x7fc318003c00 2024-08-17T02:47:54.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.296+0000 7fc336400640 1 -- 172.21.15.5:0/2041002867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc318003c00 msgr2=0x7fc318003ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:54.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.296+0000 7fc336400640 1 --2- 172.21.15.5:0/2041002867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc318003c00 0x7fc318003ff0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc324009ba0 tx=0x7fc3240090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.296+0000 7fc335a00640 1 -- 172.21.15.5:0/2041002867 reap_dead start 2024-08-17T02:47:54.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.297+0000 7fc336400640 1 -- 172.21.15.5:0/2041002867 shutdown_connections 2024-08-17T02:47:54.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.297+0000 7fc336400640 1 -- 172.21.15.5:0/2041002867 >> 172.21.15.5:0/2041002867 conn(0x7fc33006e590 msgr2=0x7fc33006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:54.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.297+0000 7fc336400640 1 -- 172.21.15.5:0/2041002867 shutdown_connections 2024-08-17T02:47:54.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.297+0000 7fc336400640 1 -- 172.21.15.5:0/2041002867 wait complete. 2024-08-17T02:47:54.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.298+0000 7fc336400640 1 Processor -- start 2024-08-17T02:47:54.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.298+0000 7fc336400640 1 -- start start 2024-08-17T02:47:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.299+0000 7fc336400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc318003c00 0x7fc330155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.299+0000 7fc336400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3301562f0 0x7fc3301697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.299+0000 7fc336400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3300cf480 0x7fc3300cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.299+0000 7fc336400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3301560f0 con 0x7fc318003c00 2024-08-17T02:47:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.299+0000 7fc336400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300cfe30 con 0x7fc3300cf480 2024-08-17T02:47:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.299+0000 7fc336400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300c3a70 con 0x7fc3301562f0 2024-08-17T02:47:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.299+0000 7fc335000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc318003c00 0x7fc330155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.299+0000 7fc335000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc318003c00 0x7fc330155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47770/0 (socket says 172.21.15.5:47770) 2024-08-17T02:47:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.299+0000 7fc335000640 1 -- 172.21.15.5:0/1355672705 learned_addr learned my addr 172.21.15.5:0/1355672705 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.299+0000 7fc335a00640 1 --2- 172.21.15.5:0/1355672705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3300cf480 0x7fc3300cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.299+0000 7fc32fe00640 1 --2- 172.21.15.5:0/1355672705 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3301562f0 0x7fc3301697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.300+0000 7fc335000640 1 -- 172.21.15.5:0/1355672705 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3301562f0 msgr2=0x7fc3301697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.300+0000 7fc335000640 1 --2- 172.21.15.5:0/1355672705 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3301562f0 0x7fc3301697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.300+0000 7fc335000640 1 -- 172.21.15.5:0/1355672705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3300cf480 msgr2=0x7fc3300cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.300+0000 7fc335000640 1 --2- 172.21.15.5:0/1355672705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3300cf480 0x7fc3300cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.300+0000 7fc335000640 1 -- 172.21.15.5:0/1355672705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc330169d20 con 0x7fc318003c00 2024-08-17T02:47:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.300+0000 7fc335a00640 1 --2- 172.21.15.5:0/1355672705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3300cf480 0x7fc3300cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.300+0000 7fc32fe00640 1 --2- 172.21.15.5:0/1355672705 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3301562f0 0x7fc3301697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.300+0000 7fc335000640 1 --2- 172.21.15.5:0/1355672705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc318003c00 0x7fc330155bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc32402ab10 tx=0x7fc324035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.300+0000 7fc323e00640 1 -- 172.21.15.5:0/1355672705 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32403c700 con 0x7fc318003c00 2024-08-17T02:47:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.300+0000 7fc323e00640 1 -- 172.21.15.5:0/1355672705 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32403c860 con 0x7fc318003c00 2024-08-17T02:47:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.300+0000 7fc323e00640 1 -- 172.21.15.5:0/1355672705 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32403cc20 con 0x7fc318003c00 2024-08-17T02:47:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.300+0000 7fc336400640 1 -- 172.21.15.5:0/1355672705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3300c6030 con 0x7fc318003c00 2024-08-17T02:47:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.300+0000 7fc336400640 1 -- 172.21.15.5:0/1355672705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3300c3740 con 0x7fc318003c00 2024-08-17T02:47:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.301+0000 7fc336400640 1 -- 172.21.15.5:0/1355672705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc330070720 con 0x7fc318003c00 2024-08-17T02:47:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.302+0000 7fc323e00640 1 -- 172.21.15.5:0/1355672705 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc324045460 con 0x7fc318003c00 2024-08-17T02:47:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.303+0000 7fc323e00640 1 --2- 172.21.15.5:0/1355672705 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc310065180 0x7fc310067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.303+0000 7fc323e00640 1 -- 172.21.15.5:0/1355672705 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc3240a39a0 con 0x7fc318003c00 2024-08-17T02:47:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.304+0000 7fc32fe00640 1 --2- 172.21.15.5:0/1355672705 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc310065180 0x7fc310067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:54.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.304+0000 7fc32fe00640 1 --2- 172.21.15.5:0/1355672705 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc310065180 0x7fc310067630 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc31c001ed0 tx=0x7fc31c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:54.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.308+0000 7fc323e00640 1 -- 172.21.15.5:0/1355672705 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc324071a70 con 0x7fc318003c00 2024-08-17T02:47:54.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.492+0000 7fc336400640 1 -- 172.21.15.5:0/1355672705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3300c6cf0 con 0x7fc318003c00 2024-08-17T02:47:54.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.493+0000 7fc323e00640 1 -- 172.21.15.5:0/1355672705 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fc32404a090 con 0x7fc318003c00 2024-08-17T02:47:54.493 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:54.493 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:47:51.692561+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:48.185879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:49.106113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:54.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.495+0000 7fc336400640 1 -- 172.21.15.5:0/1355672705 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc310065180 msgr2=0x7fc310067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:54.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.495+0000 7fc336400640 1 --2- 172.21.15.5:0/1355672705 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc310065180 0x7fc310067630 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc31c001ed0 tx=0x7fc31c009040 comp rx=0 tx=0).stop 2024-08-17T02:47:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.495+0000 7fc336400640 1 -- 172.21.15.5:0/1355672705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc318003c00 msgr2=0x7fc330155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.495+0000 7fc336400640 1 --2- 172.21.15.5:0/1355672705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc318003c00 0x7fc330155bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc32402ab10 tx=0x7fc324035000 comp rx=0 tx=0).stop 2024-08-17T02:47:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.495+0000 7fc336400640 1 -- 172.21.15.5:0/1355672705 shutdown_connections 2024-08-17T02:47:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.495+0000 7fc336400640 1 --2- 172.21.15.5:0/1355672705 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc310065180 0x7fc310067630 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.495+0000 7fc336400640 1 --2- 172.21.15.5:0/1355672705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3300cf480 0x7fc3300cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.495+0000 7fc336400640 1 --2- 172.21.15.5:0/1355672705 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc3301562f0 0x7fc3301697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.495+0000 7fc336400640 1 --2- 172.21.15.5:0/1355672705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc318003c00 0x7fc330155bb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.495+0000 7fc336400640 1 -- 172.21.15.5:0/1355672705 >> 172.21.15.5:0/1355672705 conn(0x7fc33006e590 msgr2=0x7fc3300afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.495+0000 7fc336400640 1 -- 172.21.15.5:0/1355672705 shutdown_connections 2024-08-17T02:47:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.495+0000 7fc336400640 1 -- 172.21.15.5:0/1355672705 wait complete. 2024-08-17T02:47:54.511 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:47:54.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:47:54.604 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-08-17T02:47:54.604+0000 7f86d2600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:47:54.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.661+0000 7f69c6600640 1 Processor -- start 2024-08-17T02:47:54.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.661+0000 7f69c6600640 1 -- start start 2024-08-17T02:47:54.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.662+0000 7f69c6600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f69c00afca0 0x7f69c00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:54.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.662+0000 7f69c6600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69c00acf10 0x7f69c0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:54.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.662+0000 7f69c6600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c015a4e0 con 0x7f69c01589a0 2024-08-17T02:47:54.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.662+0000 7f69c6600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c00b0980 con 0x7f69c00afca0 2024-08-17T02:47:54.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.662+0000 7f69c6600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c00c92b0 con 0x7f69c00acf10 2024-08-17T02:47:54.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.663+0000 7f69bf400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f69c00afca0 0x7f69c00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:54.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.663+0000 7f69bf400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f69c00afca0 0x7f69c00b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:46318/0 (socket says 172.21.15.5:46318) 2024-08-17T02:47:54.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.663+0000 7f69bf400640 1 -- 172.21.15.5:0/567874914 learned_addr learned my addr 172.21.15.5:0/567874914 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:54.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.663+0000 7f69bea00640 1 --2- 172.21.15.5:0/567874914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69c00acf10 0x7f69c0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:54.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.663+0000 7f69bf400640 1 -- 172.21.15.5:0/567874914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69c00acf10 msgr2=0x7f69c0159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:54.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.663+0000 7f69bf400640 1 --2- 172.21.15.5:0/567874914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69c00acf10 0x7f69c0159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.663+0000 7f69bf400640 1 -- 172.21.15.5:0/567874914 >> v1:172.21.15.107:6789/0 conn(0x7f69c01589a0 legacy=0x7f69c006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:54.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.663+0000 7f69bf400640 1 -- 172.21.15.5:0/567874914 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c00ad480 con 0x7f69c00afca0 2024-08-17T02:47:54.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.664+0000 7f69bf400640 1 --2- 172.21.15.5:0/567874914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69c00afca0 0x7f69c00b0070 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009940 tx=0x7f69b00091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83698c907f72e59c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:54.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.665+0000 7f69be000640 1 -- 172.21.15.5:0/567874914 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b002ae40 con 0x7f69c00afca0 2024-08-17T02:47:54.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.665+0000 7f69be000640 1 -- 172.21.15.5:0/567874914 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b0032440 con 0x7f69c00afca0 2024-08-17T02:47:54.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.665+0000 7f69be000640 1 -- 172.21.15.5:0/567874914 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b0032820 con 0x7f69c00afca0 2024-08-17T02:47:54.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.665+0000 7f69c6600640 1 -- 172.21.15.5:0/567874914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69c00afca0 msgr2=0x7f69c00b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:54.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.665+0000 7f69c6600640 1 --2- 172.21.15.5:0/567874914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69c00afca0 0x7f69c00b0070 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009940 tx=0x7f69b00091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.665+0000 7f69c6600640 1 -- 172.21.15.5:0/567874914 shutdown_connections 2024-08-17T02:47:54.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.665+0000 7f69c6600640 1 --2- 172.21.15.5:0/567874914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69c00acf10 0x7f69c0159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.665+0000 7f69c6600640 1 --2- 172.21.15.5:0/567874914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69c00afca0 0x7f69c00b0070 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.665+0000 7f69c6600640 1 -- 172.21.15.5:0/567874914 >> 172.21.15.5:0/567874914 conn(0x7f69c0066e60 msgr2=0x7f69c0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:54.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.666+0000 7f69c6600640 1 -- 172.21.15.5:0/567874914 shutdown_connections 2024-08-17T02:47:54.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.666+0000 7f69c6600640 1 -- 172.21.15.5:0/567874914 wait complete. 2024-08-17T02:47:54.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.667+0000 7f69c6600640 1 Processor -- start 2024-08-17T02:47:54.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.667+0000 7f69c6600640 1 -- start start 2024-08-17T02:47:54.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.668+0000 7f69c6600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69c00acf10 0x7f69c016c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:54.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.668+0000 7f69c6600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c00afca0 0x7f69c00c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:54.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.668+0000 7f69c6600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69c01589a0 0x7f69c01547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:54.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.668+0000 7f69c6600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c00c6ed0 con 0x7f69c00afca0 2024-08-17T02:47:54.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.668+0000 7f69c6600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c016d6a0 con 0x7f69c00acf10 2024-08-17T02:47:54.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.668+0000 7f69c6600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c016ce00 con 0x7f69c01589a0 2024-08-17T02:47:54.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.668+0000 7f69bea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c00afca0 0x7f69c00c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:54.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.668+0000 7f69bea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c00afca0 0x7f69c00c6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47784/0 (socket says 172.21.15.5:47784) 2024-08-17T02:47:54.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.669+0000 7f69bea00640 1 -- 172.21.15.5:0/3583531435 learned_addr learned my addr 172.21.15.5:0/3583531435 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:54.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.669+0000 7f69bf400640 1 --2- 172.21.15.5:0/3583531435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69c00acf10 0x7f69c016c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:54.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.669+0000 7f69bfe00640 1 --2- 172.21.15.5:0/3583531435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69c01589a0 0x7f69c01547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:54.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.669+0000 7f69bf400640 1 -- 172.21.15.5:0/3583531435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69c01589a0 msgr2=0x7f69c01547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:54.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.669+0000 7f69bf400640 1 --2- 172.21.15.5:0/3583531435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69c01589a0 0x7f69c01547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.669+0000 7f69bf400640 1 -- 172.21.15.5:0/3583531435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c00afca0 msgr2=0x7f69c00c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:54.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.669+0000 7f69bf400640 1 --2- 172.21.15.5:0/3583531435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c00afca0 0x7f69c00c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.669+0000 7f69bf400640 1 -- 172.21.15.5:0/3583531435 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b0009450 con 0x7f69c00acf10 2024-08-17T02:47:54.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.669+0000 7f69bea00640 1 --2- 172.21.15.5:0/3583531435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c00afca0 0x7f69c00c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:54.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.669+0000 7f69bf400640 1 --2- 172.21.15.5:0/3583531435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69c00acf10 0x7f69c016c770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f69b0031000 tx=0x7f69b0032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:54.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.670+0000 7f69b6a00640 1 -- 172.21.15.5:0/3583531435 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b0031c80 con 0x7f69c00acf10 2024-08-17T02:47:54.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.670+0000 7f69b6a00640 1 -- 172.21.15.5:0/3583531435 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b0031e20 con 0x7f69c00acf10 2024-08-17T02:47:54.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.670+0000 7f69b6a00640 1 -- 172.21.15.5:0/3583531435 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b003d670 con 0x7f69c00acf10 2024-08-17T02:47:54.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.670+0000 7f69c6600640 1 -- 172.21.15.5:0/3583531435 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c016d0e0 con 0x7f69c00acf10 2024-08-17T02:47:54.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.670+0000 7f69c6600640 1 -- 172.21.15.5:0/3583531435 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c00c4d20 con 0x7f69c00acf10 2024-08-17T02:47:54.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.671+0000 7f69c6600640 1 -- 172.21.15.5:0/3583531435 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c0063fb0 con 0x7f69c00acf10 2024-08-17T02:47:54.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.672+0000 7f69b6a00640 1 -- 172.21.15.5:0/3583531435 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f69b0039040 con 0x7f69c00acf10 2024-08-17T02:47:54.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.673+0000 7f69b6a00640 1 --2- 172.21.15.5:0/3583531435 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f69a0065220 0x7f69a00676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:54.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.673+0000 7f69b6a00640 1 -- 172.21.15.5:0/3583531435 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f69b002ae40 con 0x7f69c00acf10 2024-08-17T02:47:54.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.673+0000 7f69bea00640 1 --2- 172.21.15.5:0/3583531435 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f69a0065220 0x7f69a00676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:54.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.673+0000 7f69bea00640 1 --2- 172.21.15.5:0/3583531435 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f69a0065220 0x7f69a00676d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f69c00af530 tx=0x7f69ac0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:54.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.678+0000 7f69b6a00640 1 -- 172.21.15.5:0/3583531435 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f69b0070500 con 0x7f69c00acf10 2024-08-17T02:47:54.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.863+0000 7f69c6600640 1 -- 172.21.15.5:0/3583531435 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69c0067b70 con 0x7f69a0065220 2024-08-17T02:47:54.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.871+0000 7f69b6a00640 1 -- 172.21.15.5:0/3583531435 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289607 (secure 0 0 0) 0x7f69c0067b70 con 0x7f69a0065220 2024-08-17T02:47:54.875 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:54.877 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:47:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.876+0000 7f69c6600640 1 -- 172.21.15.5:0/3583531435 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f69a0065220 msgr2=0x7f69a00676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.876+0000 7f69c6600640 1 --2- 172.21.15.5:0/3583531435 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f69a0065220 0x7f69a00676d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f69c00af530 tx=0x7f69ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.876+0000 7f69c6600640 1 -- 172.21.15.5:0/3583531435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69c00acf10 msgr2=0x7f69c016c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:54.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.876+0000 7f69c6600640 1 --2- 172.21.15.5:0/3583531435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69c00acf10 0x7f69c016c770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f69b0031000 tx=0x7f69b0032000 comp rx=0 tx=0).stop 2024-08-17T02:47:54.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.876+0000 7f69c6600640 1 -- 172.21.15.5:0/3583531435 shutdown_connections 2024-08-17T02:47:54.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.876+0000 7f69c6600640 1 --2- 172.21.15.5:0/3583531435 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f69a0065220 0x7f69a00676d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.876+0000 7f69c6600640 1 --2- 172.21.15.5:0/3583531435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69c01589a0 0x7f69c01547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.876+0000 7f69c6600640 1 --2- 172.21.15.5:0/3583531435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69c00afca0 0x7f69c00c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.876+0000 7f69c6600640 1 --2- 172.21.15.5:0/3583531435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69c00acf10 0x7f69c016c770 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:54.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.876+0000 7f69c6600640 1 -- 172.21.15.5:0/3583531435 >> 172.21.15.5:0/3583531435 conn(0x7f69c0066e60 msgr2=0x7f69c0158e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:54.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.876+0000 7f69c6600640 1 -- 172.21.15.5:0/3583531435 shutdown_connections 2024-08-17T02:47:54.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:54.876+0000 7f69c6600640 1 -- 172.21.15.5:0/3583531435 wait complete. 2024-08-17T02:47:54.891 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-08-17T02:47:53.063769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399308,"kb_used_data":3820,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575412,"statfs":{"total":773094113280,"available":770637221888,"internally_reserved":0,"allocated":3911680,"data_stored":2211940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.391942"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.698676+0000","last_change":"2024-08-17T02:47:50.698676+0000","last_active":"2024-08-17T02:47:50.698676+0000","last_peered":"2024-08-17T02:47:50.698676+0000","last_clean":"2024-08-17T02:47:50.698676+0000","last_became_active":"2024-08-17T02:47:50.698411+0000","last_became_peered":"2024-08-17T02:47:50.698411+0000","last_unstale":"2024-08-17T02:47:50.698676+0000","last_undegraded":"2024-08-17T02:47:50.698676+0000","last_fullsized":"2024-08-17T02:47:50.698676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:02.038974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.713600+0000","last_change":"2024-08-17T02:47:50.713600+0000","last_active":"2024-08-17T02:47:50.713600+0000","last_peered":"2024-08-17T02:47:50.713600+0000","last_clean":"2024-08-17T02:47:50.713600+0000","last_became_active":"2024-08-17T02:47:50.713277+0000","last_became_peered":"2024-08-17T02:47:50.713277+0000","last_unstale":"2024-08-17T02:47:50.713600+0000","last_undegraded":"2024-08-17T02:47:50.713600+0000","last_fullsized":"2024-08-17T02:47:50.713600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:23.844672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.722447+0000","last_change":"2024-08-17T02:47:50.722447+0000","last_active":"2024-08-17T02:47:50.722447+0000","last_peered":"2024-08-17T02:47:50.722447+0000","last_clean":"2024-08-17T02:47:50.722447+0000","last_became_active":"2024-08-17T02:47:50.722161+0000","last_became_peered":"2024-08-17T02:47:50.722161+0000","last_unstale":"2024-08-17T02:47:50.722447+0000","last_undegraded":"2024-08-17T02:47:50.722447+0000","last_fullsized":"2024-08-17T02:47:50.722447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:17.624303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.720497+0000","last_change":"2024-08-17T02:47:50.720497+0000","last_active":"2024-08-17T02:47:50.720497+0000","last_peered":"2024-08-17T02:47:50.720497+0000","last_clean":"2024-08-17T02:47:50.720497+0000","last_became_active":"2024-08-17T02:47:50.720089+0000","last_became_peered":"2024-08-17T02:47:50.720089+0000","last_unstale":"2024-08-17T02:47:50.720497+0000","last_undegraded":"2024-08-17T02:47:50.720497+0000","last_fullsized":"2024-08-17T02:47:50.720497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:32.996250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.713724+0000","last_change":"2024-08-17T02:47:50.713724+0000","last_active":"2024-08-17T02:47:50.713724+0000","last_peered":"2024-08-17T02:47:50.713724+0000","last_clean":"2024-08-17T02:47:50.713724+0000","last_became_active":"2024-08-17T02:47:50.713440+0000","last_became_peered":"2024-08-17T02:47:50.713440+0000","last_unstale":"2024-08-17T02:47:50.713724+0000","last_undegraded":"2024-08-17T02:47:50.713724+0000","last_fullsized":"2024-08-17T02:47:50.713724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:55.544419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.713818+0000","last_change":"2024-08-17T02:47:50.713818+0000","last_active":"2024-08-17T02:47:50.713818+0000","last_peered":"2024-08-17T02:47:50.713818+0000","last_clean":"2024-08-17T02:47:50.713818+0000","last_became_active":"2024-08-17T02:47:50.712510+0000","last_became_peered":"2024-08-17T02:47:50.712510+0000","last_unstale":"2024-08-17T02:47:50.713818+0000","last_undegraded":"2024-08-17T02:47:50.713818+0000","last_fullsized":"2024-08-17T02:47:50.713818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:40.650168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.706705+0000","last_change":"2024-08-17T02:47:50.706705+0000","last_active":"2024-08-17T02:47:50.706705+0000","last_peered":"2024-08-17T02:47:50.706705+0000","last_clean":"2024-08-17T02:47:50.706705+0000","last_became_active":"2024-08-17T02:47:50.706445+0000","last_became_peered":"2024-08-17T02:47:50.706445+0000","last_unstale":"2024-08-17T02:47:50.706705+0000","last_undegraded":"2024-08-17T02:47:50.706705+0000","last_fullsized":"2024-08-17T02:47:50.706705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:56.659610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.700524+0000","last_change":"2024-08-17T02:47:50.700524+0000","last_active":"2024-08-17T02:47:50.700524+0000","last_peered":"2024-08-17T02:47:50.700524+0000","last_clean":"2024-08-17T02:47:50.700524+0000","last_became_active":"2024-08-17T02:47:50.700240+0000","last_became_peered":"2024-08-17T02:47:50.700240+0000","last_unstale":"2024-08-17T02:47:50.700524+0000","last_undegraded":"2024-08-17T02:47:50.700524+0000","last_fullsized":"2024-08-17T02:47:50.700524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:43.959759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.721340+0000","last_change":"2024-08-17T02:47:50.721340+0000","last_active":"2024-08-17T02:47:50.721340+0000","last_peered":"2024-08-17T02:47:50.721340+0000","last_clean":"2024-08-17T02:47:50.721340+0000","last_became_active":"2024-08-17T02:47:50.721067+0000","last_became_peered":"2024-08-17T02:47:50.721067+0000","last_unstale":"2024-08-17T02:47:50.721340+0000","last_undegraded":"2024-08-17T02:47:50.721340+0000","last_fullsized":"2024-08-17T02:47:50.721340+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:48.951074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.719191+0000","last_change":"2024-08-17T02:47:50.719191+0000","last_active":"2024-08-17T02:47:50.719191+0000","last_peered":"2024-08-17T02:47:50.719191+0000","last_clean":"2024-08-17T02:47:50.719191+0000","last_became_active":"2024-08-17T02:47:50.718943+0000","last_became_peered":"2024-08-17T02:47:50.718943+0000","last_unstale":"2024-08-17T02:47:50.719191+0000","last_undegraded":"2024-08-17T02:47:50.719191+0000","last_fullsized":"2024-08-17T02:47:50.719191+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:16:44.316358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.723562+0000","last_change":"2024-08-17T02:47:50.723562+0000","last_active":"2024-08-17T02:47:50.723562+0000","last_peered":"2024-08-17T02:47:50.723562+0000","last_clean":"2024-08-17T02:47:50.723562+0000","last_became_active":"2024-08-17T02:47:50.723303+0000","last_became_peered":"2024-08-17T02:47:50.723303+0000","last_unstale":"2024-08-17T02:47:50.723562+0000","last_undegraded":"2024-08-17T02:47:50.723562+0000","last_fullsized":"2024-08-17T02:47:50.723562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:16:44.316358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.713957+0000","last_change":"2024-08-17T02:47:50.713957+0000","last_active":"2024-08-17T02:47:50.713957+0000","last_peered":"2024-08-17T02:47:50.713957+0000","last_clean":"2024-08-17T02:47:50.713957+0000","last_became_active":"2024-08-17T02:47:50.713571+0000","last_became_peered":"2024-08-17T02:47:50.713571+0000","last_unstale":"2024-08-17T02:47:50.713957+0000","last_undegraded":"2024-08-17T02:47:50.713957+0000","last_fullsized":"2024-08-17T02:47:50.713957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:52:56.309723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.721159+0000","last_change":"2024-08-17T02:47:50.721159+0000","last_active":"2024-08-17T02:47:50.721159+0000","last_peered":"2024-08-17T02:47:50.721159+0000","last_clean":"2024-08-17T02:47:50.721159+0000","last_became_active":"2024-08-17T02:47:50.720856+0000","last_became_peered":"2024-08-17T02:47:50.720856+0000","last_unstale":"2024-08-17T02:47:50.721159+0000","last_undegraded":"2024-08-17T02:47:50.721159+0000","last_fullsized":"2024-08-17T02:47:50.721159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:38.530239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.714179+0000","last_change":"2024-08-17T02:47:50.714179+0000","last_active":"2024-08-17T02:47:50.714179+0000","last_peered":"2024-08-17T02:47:50.714179+0000","last_clean":"2024-08-17T02:47:50.714179+0000","last_became_active":"2024-08-17T02:47:50.713917+0000","last_became_peered":"2024-08-17T02:47:50.713917+0000","last_unstale":"2024-08-17T02:47:50.714179+0000","last_undegraded":"2024-08-17T02:47:50.714179+0000","last_fullsized":"2024-08-17T02:47:50.714179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:37.218481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.698869+0000","last_change":"2024-08-17T02:47:50.698869+0000","last_active":"2024-08-17T02:47:50.698869+0000","last_peered":"2024-08-17T02:47:50.698869+0000","last_clean":"2024-08-17T02:47:50.698869+0000","last_became_active":"2024-08-17T02:47:50.698589+0000","last_became_peered":"2024-08-17T02:47:50.698589+0000","last_unstale":"2024-08-17T02:47:50.698869+0000","last_undegraded":"2024-08-17T02:47:50.698869+0000","last_fullsized":"2024-08-17T02:47:50.698869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:56.659610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.704032+0000","last_change":"2024-08-17T02:47:50.704032+0000","last_active":"2024-08-17T02:47:50.704032+0000","last_peered":"2024-08-17T02:47:50.704032+0000","last_clean":"2024-08-17T02:47:50.704032+0000","last_became_active":"2024-08-17T02:47:50.703777+0000","last_became_peered":"2024-08-17T02:47:50.703777+0000","last_unstale":"2024-08-17T02:47:50.704032+0000","last_undegraded":"2024-08-17T02:47:50.704032+0000","last_fullsized":"2024-08-17T02:47:50.704032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:48.951074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.711131+0000","last_change":"2024-08-17T02:47:50.711131+0000","last_active":"2024-08-17T02:47:50.711131+0000","last_peered":"2024-08-17T02:47:50.711131+0000","last_clean":"2024-08-17T02:47:50.711131+0000","last_became_active":"2024-08-17T02:47:50.710858+0000","last_became_peered":"2024-08-17T02:47:50.710858+0000","last_unstale":"2024-08-17T02:47:50.711131+0000","last_undegraded":"2024-08-17T02:47:50.711131+0000","last_fullsized":"2024-08-17T02:47:50.711131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:48.663280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.725940+0000","last_change":"2024-08-17T02:47:50.725940+0000","last_active":"2024-08-17T02:47:50.725940+0000","last_peered":"2024-08-17T02:47:50.725940+0000","last_clean":"2024-08-17T02:47:50.725940+0000","last_became_active":"2024-08-17T02:47:50.725649+0000","last_became_peered":"2024-08-17T02:47:50.725649+0000","last_unstale":"2024-08-17T02:47:50.725940+0000","last_undegraded":"2024-08-17T02:47:50.725940+0000","last_fullsized":"2024-08-17T02:47:50.725940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:22.432694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.725878+0000","last_change":"2024-08-17T02:47:50.725878+0000","last_active":"2024-08-17T02:47:50.725878+0000","last_peered":"2024-08-17T02:47:50.725878+0000","last_clean":"2024-08-17T02:47:50.725878+0000","last_became_active":"2024-08-17T02:47:50.725507+0000","last_became_peered":"2024-08-17T02:47:50.725507+0000","last_unstale":"2024-08-17T02:47:50.725878+0000","last_undegraded":"2024-08-17T02:47:50.725878+0000","last_fullsized":"2024-08-17T02:47:50.725878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:43.959759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.699330+0000","last_change":"2024-08-17T02:47:50.699330+0000","last_active":"2024-08-17T02:47:50.699330+0000","last_peered":"2024-08-17T02:47:50.699330+0000","last_clean":"2024-08-17T02:47:50.699330+0000","last_became_active":"2024-08-17T02:47:50.699153+0000","last_became_peered":"2024-08-17T02:47:50.699153+0000","last_unstale":"2024-08-17T02:47:50.699330+0000","last_undegraded":"2024-08-17T02:47:50.699330+0000","last_fullsized":"2024-08-17T02:47:50.699330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:01.162355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.718164+0000","last_change":"2024-08-17T02:47:50.718164+0000","last_active":"2024-08-17T02:47:50.718164+0000","last_peered":"2024-08-17T02:47:50.718164+0000","last_clean":"2024-08-17T02:47:50.718164+0000","last_became_active":"2024-08-17T02:47:50.717903+0000","last_became_peered":"2024-08-17T02:47:50.717903+0000","last_unstale":"2024-08-17T02:47:50.718164+0000","last_undegraded":"2024-08-17T02:47:50.718164+0000","last_fullsized":"2024-08-17T02:47:50.718164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:27.269328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.713966+0000","last_change":"2024-08-17T02:47:50.713966+0000","last_active":"2024-08-17T02:47:50.713966+0000","last_peered":"2024-08-17T02:47:50.713966+0000","last_clean":"2024-08-17T02:47:50.713966+0000","last_became_active":"2024-08-17T02:47:50.713689+0000","last_became_peered":"2024-08-17T02:47:50.713689+0000","last_unstale":"2024-08-17T02:47:50.713966+0000","last_undegraded":"2024-08-17T02:47:50.713966+0000","last_fullsized":"2024-08-17T02:47:50.713966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:02.281483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.708813+0000","last_change":"2024-08-17T02:47:50.708813+0000","last_active":"2024-08-17T02:47:50.708813+0000","last_peered":"2024-08-17T02:47:50.708813+0000","last_clean":"2024-08-17T02:47:50.708813+0000","last_became_active":"2024-08-17T02:47:50.708570+0000","last_became_peered":"2024-08-17T02:47:50.708570+0000","last_unstale":"2024-08-17T02:47:50.708813+0000","last_undegraded":"2024-08-17T02:47:50.708813+0000","last_fullsized":"2024-08-17T02:47:50.708813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:32.996250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.692501+0000","last_change":"2024-08-17T02:47:50.692501+0000","last_active":"2024-08-17T02:47:50.692501+0000","last_peered":"2024-08-17T02:47:50.692501+0000","last_clean":"2024-08-17T02:47:50.692501+0000","last_became_active":"2024-08-17T02:47:50.692218+0000","last_became_peered":"2024-08-17T02:47:50.692218+0000","last_unstale":"2024-08-17T02:47:50.692501+0000","last_undegraded":"2024-08-17T02:47:50.692501+0000","last_fullsized":"2024-08-17T02:47:50.692501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:16:44.316358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.716072+0000","last_change":"2024-08-17T02:47:50.716072+0000","last_active":"2024-08-17T02:47:50.716072+0000","last_peered":"2024-08-17T02:47:50.716072+0000","last_clean":"2024-08-17T02:47:50.716072+0000","last_became_active":"2024-08-17T02:47:50.715748+0000","last_became_peered":"2024-08-17T02:47:50.715748+0000","last_unstale":"2024-08-17T02:47:50.716072+0000","last_undegraded":"2024-08-17T02:47:50.716072+0000","last_fullsized":"2024-08-17T02:47:50.716072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:52:56.309723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.715816+0000","last_change":"2024-08-17T02:47:50.715816+0000","last_active":"2024-08-17T02:47:50.715816+0000","last_peered":"2024-08-17T02:47:50.715816+0000","last_clean":"2024-08-17T02:47:50.715816+0000","last_became_active":"2024-08-17T02:47:50.715531+0000","last_became_peered":"2024-08-17T02:47:50.715531+0000","last_unstale":"2024-08-17T02:47:50.715816+0000","last_undegraded":"2024-08-17T02:47:50.715816+0000","last_fullsized":"2024-08-17T02:47:50.715816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:48.663280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.724924+0000","last_change":"2024-08-17T02:47:50.724924+0000","last_active":"2024-08-17T02:47:50.724924+0000","last_peered":"2024-08-17T02:47:50.724924+0000","last_clean":"2024-08-17T02:47:50.724924+0000","last_became_active":"2024-08-17T02:47:50.724656+0000","last_became_peered":"2024-08-17T02:47:50.724656+0000","last_unstale":"2024-08-17T02:47:50.724924+0000","last_undegraded":"2024-08-17T02:47:50.724924+0000","last_fullsized":"2024-08-17T02:47:50.724924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:02.038974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.696106+0000","last_change":"2024-08-17T02:47:50.696106+0000","last_active":"2024-08-17T02:47:50.696106+0000","last_peered":"2024-08-17T02:47:50.696106+0000","last_clean":"2024-08-17T02:47:50.696106+0000","last_became_active":"2024-08-17T02:47:50.695861+0000","last_became_peered":"2024-08-17T02:47:50.695861+0000","last_unstale":"2024-08-17T02:47:50.696106+0000","last_undegraded":"2024-08-17T02:47:50.696106+0000","last_fullsized":"2024-08-17T02:47:50.696106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:23.844672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.715626+0000","last_change":"2024-08-17T02:47:50.715626+0000","last_active":"2024-08-17T02:47:50.715626+0000","last_peered":"2024-08-17T02:47:50.715626+0000","last_clean":"2024-08-17T02:47:50.715626+0000","last_became_active":"2024-08-17T02:47:50.714773+0000","last_became_peered":"2024-08-17T02:47:50.714773+0000","last_unstale":"2024-08-17T02:47:50.715626+0000","last_undegraded":"2024-08-17T02:47:50.715626+0000","last_fullsized":"2024-08-17T02:47:50.715626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:02.038974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.706611+0000","last_change":"2024-08-17T02:47:50.706611+0000","last_active":"2024-08-17T02:47:50.706611+0000","last_peered":"2024-08-17T02:47:50.706611+0000","last_clean":"2024-08-17T02:47:50.706611+0000","last_became_active":"2024-08-17T02:47:50.706129+0000","last_became_peered":"2024-08-17T02:47:50.706129+0000","last_unstale":"2024-08-17T02:47:50.706611+0000","last_undegraded":"2024-08-17T02:47:50.706611+0000","last_fullsized":"2024-08-17T02:47:50.706611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:17.624303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.691416+0000","last_change":"2024-08-17T02:47:50.691416+0000","last_active":"2024-08-17T02:47:50.691416+0000","last_peered":"2024-08-17T02:47:50.691416+0000","last_clean":"2024-08-17T02:47:50.691416+0000","last_became_active":"2024-08-17T02:47:50.691153+0000","last_became_peered":"2024-08-17T02:47:50.691153+0000","last_unstale":"2024-08-17T02:47:50.691416+0000","last_undegraded":"2024-08-17T02:47:50.691416+0000","last_fullsized":"2024-08-17T02:47:50.691416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:02.281483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.706332+0000","last_change":"2024-08-17T02:47:50.706332+0000","last_active":"2024-08-17T02:47:50.706332+0000","last_peered":"2024-08-17T02:47:50.706332+0000","last_clean":"2024-08-17T02:47:50.706332+0000","last_became_active":"2024-08-17T02:47:50.706038+0000","last_became_peered":"2024-08-17T02:47:50.706038+0000","last_unstale":"2024-08-17T02:47:50.706332+0000","last_undegraded":"2024-08-17T02:47:50.706332+0000","last_fullsized":"2024-08-17T02:47:50.706332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:32.996250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.707154+0000","last_change":"2024-08-17T02:47:50.707154+0000","last_active":"2024-08-17T02:47:50.707154+0000","last_peered":"2024-08-17T02:47:50.707154+0000","last_clean":"2024-08-17T02:47:50.707154+0000","last_became_active":"2024-08-17T02:47:50.706954+0000","last_became_peered":"2024-08-17T02:47:50.706954+0000","last_unstale":"2024-08-17T02:47:50.707154+0000","last_undegraded":"2024-08-17T02:47:50.707154+0000","last_fullsized":"2024-08-17T02:47:50.707154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:02.038974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.715255+0000","last_change":"2024-08-17T02:47:49.701911+0000","last_active":"2024-08-17T02:47:50.715255+0000","last_peered":"2024-08-17T02:47:50.715255+0000","last_clean":"2024-08-17T02:47:50.715255+0000","last_became_active":"2024-08-17T02:47:49.701579+0000","last_became_peered":"2024-08-17T02:47:49.701579+0000","last_unstale":"2024-08-17T02:47:50.715255+0000","last_undegraded":"2024-08-17T02:47:50.715255+0000","last_fullsized":"2024-08-17T02:47:50.715255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:00.156010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.714295+0000","last_change":"2024-08-17T02:47:50.714295+0000","last_active":"2024-08-17T02:47:50.714295+0000","last_peered":"2024-08-17T02:47:50.714295+0000","last_clean":"2024-08-17T02:47:50.714295+0000","last_became_active":"2024-08-17T02:47:50.714002+0000","last_became_peered":"2024-08-17T02:47:50.714002+0000","last_unstale":"2024-08-17T02:47:50.714295+0000","last_undegraded":"2024-08-17T02:47:50.714295+0000","last_fullsized":"2024-08-17T02:47:50.714295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:48.951074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.694880+0000","last_change":"2024-08-17T02:47:49.706188+0000","last_active":"2024-08-17T02:47:50.694880+0000","last_peered":"2024-08-17T02:47:50.694880+0000","last_clean":"2024-08-17T02:47:50.694880+0000","last_became_active":"2024-08-17T02:47:49.705937+0000","last_became_peered":"2024-08-17T02:47:49.705937+0000","last_unstale":"2024-08-17T02:47:50.694880+0000","last_undegraded":"2024-08-17T02:47:50.694880+0000","last_fullsized":"2024-08-17T02:47:50.694880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:14.739902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.716845+0000","last_change":"2024-08-17T02:47:50.716845+0000","last_active":"2024-08-17T02:47:50.716845+0000","last_peered":"2024-08-17T02:47:50.716845+0000","last_clean":"2024-08-17T02:47:50.716845+0000","last_became_active":"2024-08-17T02:47:50.716540+0000","last_became_peered":"2024-08-17T02:47:50.716540+0000","last_unstale":"2024-08-17T02:47:50.716845+0000","last_undegraded":"2024-08-17T02:47:50.716845+0000","last_fullsized":"2024-08-17T02:47:50.716845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:32.996250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.725736+0000","last_change":"2024-08-17T02:47:49.704890+0000","last_active":"2024-08-17T02:47:50.725736+0000","last_peered":"2024-08-17T02:47:50.725736+0000","last_clean":"2024-08-17T02:47:50.725736+0000","last_became_active":"2024-08-17T02:47:49.704621+0000","last_became_peered":"2024-08-17T02:47:49.704621+0000","last_unstale":"2024-08-17T02:47:50.725736+0000","last_undegraded":"2024-08-17T02:47:50.725736+0000","last_fullsized":"2024-08-17T02:47:50.725736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:34:03.272796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.719015+0000","last_change":"2024-08-17T02:47:50.719015+0000","last_active":"2024-08-17T02:47:50.719015+0000","last_peered":"2024-08-17T02:47:50.719015+0000","last_clean":"2024-08-17T02:47:50.719015+0000","last_became_active":"2024-08-17T02:47:50.718747+0000","last_became_peered":"2024-08-17T02:47:50.718747+0000","last_unstale":"2024-08-17T02:47:50.719015+0000","last_undegraded":"2024-08-17T02:47:50.719015+0000","last_fullsized":"2024-08-17T02:47:50.719015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:10:31.116343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.727536+0000","last_change":"2024-08-17T02:47:49.703598+0000","last_active":"2024-08-17T02:47:50.727536+0000","last_peered":"2024-08-17T02:47:50.727536+0000","last_clean":"2024-08-17T02:47:50.727536+0000","last_became_active":"2024-08-17T02:47:49.703329+0000","last_became_peered":"2024-08-17T02:47:49.703329+0000","last_unstale":"2024-08-17T02:47:50.727536+0000","last_undegraded":"2024-08-17T02:47:50.727536+0000","last_fullsized":"2024-08-17T02:47:50.727536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:05:46.149986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.717225+0000","last_change":"2024-08-17T02:47:50.717225+0000","last_active":"2024-08-17T02:47:50.717225+0000","last_peered":"2024-08-17T02:47:50.717225+0000","last_clean":"2024-08-17T02:47:50.717225+0000","last_became_active":"2024-08-17T02:47:50.710854+0000","last_became_peered":"2024-08-17T02:47:50.710854+0000","last_unstale":"2024-08-17T02:47:50.717225+0000","last_undegraded":"2024-08-17T02:47:50.717225+0000","last_fullsized":"2024-08-17T02:47:50.717225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:40.279894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.697645+0000","last_change":"2024-08-17T02:47:49.705213+0000","last_active":"2024-08-17T02:47:50.697645+0000","last_peered":"2024-08-17T02:47:50.697645+0000","last_clean":"2024-08-17T02:47:50.697645+0000","last_became_active":"2024-08-17T02:47:49.704929+0000","last_became_peered":"2024-08-17T02:47:49.704929+0000","last_unstale":"2024-08-17T02:47:50.697645+0000","last_undegraded":"2024-08-17T02:47:50.697645+0000","last_fullsized":"2024-08-17T02:47:50.697645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:04.361359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.697533+0000","last_change":"2024-08-17T02:47:50.697533+0000","last_active":"2024-08-17T02:47:50.697533+0000","last_peered":"2024-08-17T02:47:50.697533+0000","last_clean":"2024-08-17T02:47:50.697533+0000","last_became_active":"2024-08-17T02:47:50.697266+0000","last_became_peered":"2024-08-17T02:47:50.697266+0000","last_unstale":"2024-08-17T02:47:50.697533+0000","last_undegraded":"2024-08-17T02:47:50.697533+0000","last_fullsized":"2024-08-17T02:47:50.697533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:43.959759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.697426+0000","last_change":"2024-08-17T02:47:49.705473+0000","last_active":"2024-08-17T02:47:50.697426+0000","last_peered":"2024-08-17T02:47:50.697426+0000","last_clean":"2024-08-17T02:47:50.697426+0000","last_became_active":"2024-08-17T02:47:49.705058+0000","last_became_peered":"2024-08-17T02:47:49.705058+0000","last_unstale":"2024-08-17T02:47:50.697426+0000","last_undegraded":"2024-08-17T02:47:50.697426+0000","last_fullsized":"2024-08-17T02:47:50.697426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:09.980062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.707595+0000","last_change":"2024-08-17T02:47:50.707595+0000","last_active":"2024-08-17T02:47:50.707595+0000","last_peered":"2024-08-17T02:47:50.707595+0000","last_clean":"2024-08-17T02:47:50.707595+0000","last_became_active":"2024-08-17T02:47:50.707013+0000","last_became_peered":"2024-08-17T02:47:50.707013+0000","last_unstale":"2024-08-17T02:47:50.707595+0000","last_undegraded":"2024-08-17T02:47:50.707595+0000","last_fullsized":"2024-08-17T02:47:50.707595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:06:32.357049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.708628+0000","last_change":"2024-08-17T02:47:49.705191+0000","last_active":"2024-08-17T02:47:49.708628+0000","last_peered":"2024-08-17T02:47:49.708628+0000","last_clean":"2024-08-17T02:47:49.708628+0000","last_became_active":"2024-08-17T02:47:49.704944+0000","last_became_peered":"2024-08-17T02:47:49.704944+0000","last_unstale":"2024-08-17T02:47:49.708628+0000","last_undegraded":"2024-08-17T02:47:49.708628+0000","last_fullsized":"2024-08-17T02:47:49.708628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:26.659030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.712148+0000","last_change":"2024-08-17T02:47:50.712148+0000","last_active":"2024-08-17T02:47:50.712148+0000","last_peered":"2024-08-17T02:47:50.712148+0000","last_clean":"2024-08-17T02:47:50.712148+0000","last_became_active":"2024-08-17T02:47:50.707608+0000","last_became_peered":"2024-08-17T02:47:50.707608+0000","last_unstale":"2024-08-17T02:47:50.712148+0000","last_undegraded":"2024-08-17T02:47:50.712148+0000","last_fullsized":"2024-08-17T02:47:50.712148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:58.825259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.703411+0000","last_change":"2024-08-17T02:47:49.699435+0000","last_active":"2024-08-17T02:47:49.703411+0000","last_peered":"2024-08-17T02:47:49.703411+0000","last_clean":"2024-08-17T02:47:49.703411+0000","last_became_active":"2024-08-17T02:47:49.699036+0000","last_became_peered":"2024-08-17T02:47:49.699036+0000","last_unstale":"2024-08-17T02:47:49.703411+0000","last_undegraded":"2024-08-17T02:47:49.703411+0000","last_fullsized":"2024-08-17T02:47:49.703411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:32.285788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.713576+0000","last_change":"2024-08-17T02:47:50.713576+0000","last_active":"2024-08-17T02:47:50.713576+0000","last_peered":"2024-08-17T02:47:50.713576+0000","last_clean":"2024-08-17T02:47:50.713576+0000","last_became_active":"2024-08-17T02:47:50.713324+0000","last_became_peered":"2024-08-17T02:47:50.713324+0000","last_unstale":"2024-08-17T02:47:50.713576+0000","last_undegraded":"2024-08-17T02:47:50.713576+0000","last_fullsized":"2024-08-17T02:47:50.713576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:51:33.320139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.709438+0000","last_change":"2024-08-17T02:47:49.708177+0000","last_active":"2024-08-17T02:47:49.709438+0000","last_peered":"2024-08-17T02:47:49.709438+0000","last_clean":"2024-08-17T02:47:49.709438+0000","last_became_active":"2024-08-17T02:47:49.707795+0000","last_became_peered":"2024-08-17T02:47:49.707795+0000","last_unstale":"2024-08-17T02:47:49.709438+0000","last_undegraded":"2024-08-17T02:47:49.709438+0000","last_fullsized":"2024-08-17T02:47:49.709438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:54.538074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.721250+0000","last_change":"2024-08-17T02:47:50.721250+0000","last_active":"2024-08-17T02:47:50.721250+0000","last_peered":"2024-08-17T02:47:50.721250+0000","last_clean":"2024-08-17T02:47:50.721250+0000","last_became_active":"2024-08-17T02:47:50.719947+0000","last_became_peered":"2024-08-17T02:47:50.719947+0000","last_unstale":"2024-08-17T02:47:50.721250+0000","last_undegraded":"2024-08-17T02:47:50.721250+0000","last_fullsized":"2024-08-17T02:47:50.721250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:52:56.309723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.708034+0000","last_change":"2024-08-17T02:47:49.705698+0000","last_active":"2024-08-17T02:47:49.708034+0000","last_peered":"2024-08-17T02:47:49.708034+0000","last_clean":"2024-08-17T02:47:49.708034+0000","last_became_active":"2024-08-17T02:47:49.705434+0000","last_became_peered":"2024-08-17T02:47:49.705434+0000","last_unstale":"2024-08-17T02:47:49.708034+0000","last_undegraded":"2024-08-17T02:47:49.708034+0000","last_fullsized":"2024-08-17T02:47:49.708034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:45.383147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.716804+0000","last_change":"2024-08-17T02:47:50.716804+0000","last_active":"2024-08-17T02:47:50.716804+0000","last_peered":"2024-08-17T02:47:50.716804+0000","last_clean":"2024-08-17T02:47:50.716804+0000","last_became_active":"2024-08-17T02:47:50.716560+0000","last_became_peered":"2024-08-17T02:47:50.716560+0000","last_unstale":"2024-08-17T02:47:50.716804+0000","last_undegraded":"2024-08-17T02:47:50.716804+0000","last_fullsized":"2024-08-17T02:47:50.716804+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:45.682341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.710642+0000","last_change":"2024-08-17T02:47:49.705054+0000","last_active":"2024-08-17T02:47:50.710642+0000","last_peered":"2024-08-17T02:47:50.710642+0000","last_clean":"2024-08-17T02:47:50.710642+0000","last_became_active":"2024-08-17T02:47:49.704752+0000","last_became_peered":"2024-08-17T02:47:49.704752+0000","last_unstale":"2024-08-17T02:47:50.710642+0000","last_undegraded":"2024-08-17T02:47:50.710642+0000","last_fullsized":"2024-08-17T02:47:50.710642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:34:03.272796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.722591+0000","last_change":"2024-08-17T02:47:50.722591+0000","last_active":"2024-08-17T02:47:50.722591+0000","last_peered":"2024-08-17T02:47:50.722591+0000","last_clean":"2024-08-17T02:47:50.722591+0000","last_became_active":"2024-08-17T02:47:50.722207+0000","last_became_peered":"2024-08-17T02:47:50.722207+0000","last_unstale":"2024-08-17T02:47:50.722591+0000","last_undegraded":"2024-08-17T02:47:50.722591+0000","last_fullsized":"2024-08-17T02:47:50.722591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:48.663280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.728245+0000","last_change":"2024-08-17T02:47:49.700459+0000","last_active":"2024-08-17T02:47:50.728245+0000","last_peered":"2024-08-17T02:47:50.728245+0000","last_clean":"2024-08-17T02:47:50.728245+0000","last_became_active":"2024-08-17T02:47:49.700217+0000","last_became_peered":"2024-08-17T02:47:49.700217+0000","last_unstale":"2024-08-17T02:47:50.728245+0000","last_undegraded":"2024-08-17T02:47:50.728245+0000","last_fullsized":"2024-08-17T02:47:50.728245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:45.383147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.716121+0000","last_change":"2024-08-17T02:47:50.716121+0000","last_active":"2024-08-17T02:47:50.716121+0000","last_peered":"2024-08-17T02:47:50.716121+0000","last_clean":"2024-08-17T02:47:50.716121+0000","last_became_active":"2024-08-17T02:47:50.715803+0000","last_became_peered":"2024-08-17T02:47:50.715803+0000","last_unstale":"2024-08-17T02:47:50.716121+0000","last_undegraded":"2024-08-17T02:47:50.716121+0000","last_fullsized":"2024-08-17T02:47:50.716121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:56.659610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.710946+0000","last_change":"2024-08-17T02:47:49.702009+0000","last_active":"2024-08-17T02:47:50.710946+0000","last_peered":"2024-08-17T02:47:50.710946+0000","last_clean":"2024-08-17T02:47:50.710946+0000","last_became_active":"2024-08-17T02:47:49.701705+0000","last_became_peered":"2024-08-17T02:47:49.701705+0000","last_unstale":"2024-08-17T02:47:50.710946+0000","last_undegraded":"2024-08-17T02:47:50.710946+0000","last_fullsized":"2024-08-17T02:47:50.710946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:47:22.434937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.704139+0000","last_change":"2024-08-17T02:47:50.704139+0000","last_active":"2024-08-17T02:47:50.704139+0000","last_peered":"2024-08-17T02:47:50.704139+0000","last_clean":"2024-08-17T02:47:50.704139+0000","last_became_active":"2024-08-17T02:47:50.703094+0000","last_became_peered":"2024-08-17T02:47:50.703094+0000","last_unstale":"2024-08-17T02:47:50.704139+0000","last_undegraded":"2024-08-17T02:47:50.704139+0000","last_fullsized":"2024-08-17T02:47:50.704139+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:51:33.320139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.702771+0000","last_change":"2024-08-17T02:47:49.696165+0000","last_active":"2024-08-17T02:47:49.702771+0000","last_peered":"2024-08-17T02:47:49.702771+0000","last_clean":"2024-08-17T02:47:49.702771+0000","last_became_active":"2024-08-17T02:47:49.695678+0000","last_became_peered":"2024-08-17T02:47:49.695678+0000","last_unstale":"2024-08-17T02:47:49.702771+0000","last_undegraded":"2024-08-17T02:47:49.702771+0000","last_fullsized":"2024-08-17T02:47:49.702771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:26.659030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.716341+0000","last_change":"2024-08-17T02:47:50.716341+0000","last_active":"2024-08-17T02:47:50.716341+0000","last_peered":"2024-08-17T02:47:50.716341+0000","last_clean":"2024-08-17T02:47:50.716341+0000","last_became_active":"2024-08-17T02:47:50.716067+0000","last_became_peered":"2024-08-17T02:47:50.716067+0000","last_unstale":"2024-08-17T02:47:50.716341+0000","last_undegraded":"2024-08-17T02:47:50.716341+0000","last_fullsized":"2024-08-17T02:47:50.716341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:02.038974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.710664+0000","last_change":"2024-08-17T02:47:49.710011+0000","last_active":"2024-08-17T02:47:49.710664+0000","last_peered":"2024-08-17T02:47:49.710664+0000","last_clean":"2024-08-17T02:47:49.710664+0000","last_became_active":"2024-08-17T02:47:49.709783+0000","last_became_peered":"2024-08-17T02:47:49.709783+0000","last_unstale":"2024-08-17T02:47:49.710664+0000","last_undegraded":"2024-08-17T02:47:49.710664+0000","last_fullsized":"2024-08-17T02:47:49.710664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:14.343843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.704524+0000","last_change":"2024-08-17T02:47:50.704524+0000","last_active":"2024-08-17T02:47:50.704524+0000","last_peered":"2024-08-17T02:47:50.704524+0000","last_clean":"2024-08-17T02:47:50.704524+0000","last_became_active":"2024-08-17T02:47:50.704131+0000","last_became_peered":"2024-08-17T02:47:50.704131+0000","last_unstale":"2024-08-17T02:47:50.704524+0000","last_undegraded":"2024-08-17T02:47:50.704524+0000","last_fullsized":"2024-08-17T02:47:50.704524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:10:31.116343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.718458+0000","last_change":"2024-08-17T02:47:49.706079+0000","last_active":"2024-08-17T02:47:50.718458+0000","last_peered":"2024-08-17T02:47:50.718458+0000","last_clean":"2024-08-17T02:47:50.718458+0000","last_became_active":"2024-08-17T02:47:49.704185+0000","last_became_peered":"2024-08-17T02:47:49.704185+0000","last_unstale":"2024-08-17T02:47:50.718458+0000","last_undegraded":"2024-08-17T02:47:50.718458+0000","last_fullsized":"2024-08-17T02:47:50.718458+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:00.156010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.710985+0000","last_change":"2024-08-17T02:47:50.710985+0000","last_active":"2024-08-17T02:47:50.710985+0000","last_peered":"2024-08-17T02:47:50.710985+0000","last_clean":"2024-08-17T02:47:50.710985+0000","last_became_active":"2024-08-17T02:47:50.710709+0000","last_became_peered":"2024-08-17T02:47:50.710709+0000","last_unstale":"2024-08-17T02:47:50.710985+0000","last_undegraded":"2024-08-17T02:47:50.710985+0000","last_fullsized":"2024-08-17T02:47:50.710985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:10:31.116343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.700241+0000","last_change":"2024-08-17T02:47:49.704746+0000","last_active":"2024-08-17T02:47:50.700241+0000","last_peered":"2024-08-17T02:47:50.700241+0000","last_clean":"2024-08-17T02:47:50.700241+0000","last_became_active":"2024-08-17T02:47:49.704386+0000","last_became_peered":"2024-08-17T02:47:49.704386+0000","last_unstale":"2024-08-17T02:47:50.700241+0000","last_undegraded":"2024-08-17T02:47:50.700241+0000","last_fullsized":"2024-08-17T02:47:50.700241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:00.156010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.713313+0000","last_change":"2024-08-17T02:47:50.713313+0000","last_active":"2024-08-17T02:47:50.713313+0000","last_peered":"2024-08-17T02:47:50.713313+0000","last_clean":"2024-08-17T02:47:50.713313+0000","last_became_active":"2024-08-17T02:47:50.713019+0000","last_became_peered":"2024-08-17T02:47:50.713019+0000","last_unstale":"2024-08-17T02:47:50.713313+0000","last_undegraded":"2024-08-17T02:47:50.713313+0000","last_fullsized":"2024-08-17T02:47:50.713313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:40.279894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.711122+0000","last_change":"2024-08-17T02:47:49.701083+0000","last_active":"2024-08-17T02:47:50.711122+0000","last_peered":"2024-08-17T02:47:50.711122+0000","last_clean":"2024-08-17T02:47:50.711122+0000","last_became_active":"2024-08-17T02:47:49.700133+0000","last_became_peered":"2024-08-17T02:47:49.700133+0000","last_unstale":"2024-08-17T02:47:50.711122+0000","last_undegraded":"2024-08-17T02:47:50.711122+0000","last_fullsized":"2024-08-17T02:47:50.711122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:37.523894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.720335+0000","last_change":"2024-08-17T02:47:50.720335+0000","last_active":"2024-08-17T02:47:50.720335+0000","last_peered":"2024-08-17T02:47:50.720335+0000","last_clean":"2024-08-17T02:47:50.720335+0000","last_became_active":"2024-08-17T02:47:50.719911+0000","last_became_peered":"2024-08-17T02:47:50.719911+0000","last_unstale":"2024-08-17T02:47:50.720335+0000","last_undegraded":"2024-08-17T02:47:50.720335+0000","last_fullsized":"2024-08-17T02:47:50.720335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:02.281483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.701016+0000","last_change":"2024-08-17T02:47:49.702451+0000","last_active":"2024-08-17T02:47:50.701016+0000","last_peered":"2024-08-17T02:47:50.701016+0000","last_clean":"2024-08-17T02:47:50.701016+0000","last_became_active":"2024-08-17T02:47:49.702227+0000","last_became_peered":"2024-08-17T02:47:49.702227+0000","last_unstale":"2024-08-17T02:47:50.701016+0000","last_undegraded":"2024-08-17T02:47:50.701016+0000","last_fullsized":"2024-08-17T02:47:50.701016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:52:05.470998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.708546+0000","last_change":"2024-08-17T02:47:50.708546+0000","last_active":"2024-08-17T02:47:50.708546+0000","last_peered":"2024-08-17T02:47:50.708546+0000","last_clean":"2024-08-17T02:47:50.708546+0000","last_became_active":"2024-08-17T02:47:50.708286+0000","last_became_peered":"2024-08-17T02:47:50.708286+0000","last_unstale":"2024-08-17T02:47:50.708546+0000","last_undegraded":"2024-08-17T02:47:50.708546+0000","last_fullsized":"2024-08-17T02:47:50.708546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.048586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.709772+0000","last_change":"2024-08-17T02:47:49.705710+0000","last_active":"2024-08-17T02:47:49.709772+0000","last_peered":"2024-08-17T02:47:49.709772+0000","last_clean":"2024-08-17T02:47:49.709772+0000","last_became_active":"2024-08-17T02:47:49.705027+0000","last_became_peered":"2024-08-17T02:47:49.705027+0000","last_unstale":"2024-08-17T02:47:49.709772+0000","last_undegraded":"2024-08-17T02:47:49.709772+0000","last_fullsized":"2024-08-17T02:47:49.709772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:17:28.550436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.711134+0000","last_change":"2024-08-17T02:47:50.711134+0000","last_active":"2024-08-17T02:47:50.711134+0000","last_peered":"2024-08-17T02:47:50.711134+0000","last_clean":"2024-08-17T02:47:50.711134+0000","last_became_active":"2024-08-17T02:47:50.710793+0000","last_became_peered":"2024-08-17T02:47:50.710793+0000","last_unstale":"2024-08-17T02:47:50.711134+0000","last_undegraded":"2024-08-17T02:47:50.711134+0000","last_fullsized":"2024-08-17T02:47:50.711134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:04.457635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.715803+0000","last_change":"2024-08-17T02:47:49.694775+0000","last_active":"2024-08-17T02:47:50.715803+0000","last_peered":"2024-08-17T02:47:50.715803+0000","last_clean":"2024-08-17T02:47:50.715803+0000","last_became_active":"2024-08-17T02:47:49.694512+0000","last_became_peered":"2024-08-17T02:47:49.694512+0000","last_unstale":"2024-08-17T02:47:50.715803+0000","last_undegraded":"2024-08-17T02:47:50.715803+0000","last_fullsized":"2024-08-17T02:47:50.715803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:34:03.272796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.698651+0000","last_change":"2024-08-17T02:47:50.698651+0000","last_active":"2024-08-17T02:47:50.698651+0000","last_peered":"2024-08-17T02:47:50.698651+0000","last_clean":"2024-08-17T02:47:50.698651+0000","last_became_active":"2024-08-17T02:47:50.698410+0000","last_became_peered":"2024-08-17T02:47:50.698410+0000","last_unstale":"2024-08-17T02:47:50.698651+0000","last_undegraded":"2024-08-17T02:47:50.698651+0000","last_fullsized":"2024-08-17T02:47:50.698651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:46.389493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.701130+0000","last_change":"2024-08-17T02:47:49.695055+0000","last_active":"2024-08-17T02:47:49.701130+0000","last_peered":"2024-08-17T02:47:49.701130+0000","last_clean":"2024-08-17T02:47:49.701130+0000","last_became_active":"2024-08-17T02:47:49.694744+0000","last_became_peered":"2024-08-17T02:47:49.694744+0000","last_unstale":"2024-08-17T02:47:49.701130+0000","last_undegraded":"2024-08-17T02:47:49.701130+0000","last_fullsized":"2024-08-17T02:47:49.701130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:26.659030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.698085+0000","last_change":"2024-08-17T02:47:50.698085+0000","last_active":"2024-08-17T02:47:50.698085+0000","last_peered":"2024-08-17T02:47:50.698085+0000","last_clean":"2024-08-17T02:47:50.698085+0000","last_became_active":"2024-08-17T02:47:50.697802+0000","last_became_peered":"2024-08-17T02:47:50.697802+0000","last_unstale":"2024-08-17T02:47:50.698085+0000","last_undegraded":"2024-08-17T02:47:50.698085+0000","last_fullsized":"2024-08-17T02:47:50.698085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:27.665376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.703373+0000","last_change":"2024-08-17T02:47:49.699928+0000","last_active":"2024-08-17T02:47:49.703373+0000","last_peered":"2024-08-17T02:47:49.703373+0000","last_clean":"2024-08-17T02:47:49.703373+0000","last_became_active":"2024-08-17T02:47:49.696617+0000","last_became_peered":"2024-08-17T02:47:49.696617+0000","last_unstale":"2024-08-17T02:47:49.703373+0000","last_undegraded":"2024-08-17T02:47:49.703373+0000","last_fullsized":"2024-08-17T02:47:49.703373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:03.451290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.707421+0000","last_change":"2024-08-17T02:47:50.707421+0000","last_active":"2024-08-17T02:47:50.707421+0000","last_peered":"2024-08-17T02:47:50.707421+0000","last_clean":"2024-08-17T02:47:50.707421+0000","last_became_active":"2024-08-17T02:47:50.707048+0000","last_became_peered":"2024-08-17T02:47:50.707048+0000","last_unstale":"2024-08-17T02:47:50.707421+0000","last_undegraded":"2024-08-17T02:47:50.707421+0000","last_fullsized":"2024-08-17T02:47:50.707421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:52:56.309723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.707341+0000","last_change":"2024-08-17T02:47:49.706097+0000","last_active":"2024-08-17T02:47:49.707341+0000","last_peered":"2024-08-17T02:47:49.707341+0000","last_clean":"2024-08-17T02:47:49.707341+0000","last_became_active":"2024-08-17T02:47:49.705890+0000","last_became_peered":"2024-08-17T02:47:49.705890+0000","last_unstale":"2024-08-17T02:47:49.707341+0000","last_undegraded":"2024-08-17T02:47:49.707341+0000","last_fullsized":"2024-08-17T02:47:49.707341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:45.383147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.701419+0000","last_change":"2024-08-17T02:47:50.701419+0000","last_active":"2024-08-17T02:47:50.701419+0000","last_peered":"2024-08-17T02:47:50.701419+0000","last_clean":"2024-08-17T02:47:50.701419+0000","last_became_active":"2024-08-17T02:47:50.700588+0000","last_became_peered":"2024-08-17T02:47:50.700588+0000","last_unstale":"2024-08-17T02:47:50.701419+0000","last_undegraded":"2024-08-17T02:47:50.701419+0000","last_fullsized":"2024-08-17T02:47:50.701419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:34:04.279141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.723595+0000","last_change":"2024-08-17T02:47:49.698982+0000","last_active":"2024-08-17T02:47:50.723595+0000","last_peered":"2024-08-17T02:47:50.723595+0000","last_clean":"2024-08-17T02:47:50.723595+0000","last_became_active":"2024-08-17T02:47:49.698692+0000","last_became_peered":"2024-08-17T02:47:49.698692+0000","last_unstale":"2024-08-17T02:47:50.723595+0000","last_undegraded":"2024-08-17T02:47:50.723595+0000","last_fullsized":"2024-08-17T02:47:50.723595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:37.523894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.717502+0000","last_change":"2024-08-17T02:47:50.717502+0000","last_active":"2024-08-17T02:47:50.717502+0000","last_peered":"2024-08-17T02:47:50.717502+0000","last_clean":"2024-08-17T02:47:50.717502+0000","last_became_active":"2024-08-17T02:47:50.716644+0000","last_became_peered":"2024-08-17T02:47:50.716644+0000","last_unstale":"2024-08-17T02:47:50.717502+0000","last_undegraded":"2024-08-17T02:47:50.717502+0000","last_fullsized":"2024-08-17T02:47:50.717502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:58.825259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.703567+0000","last_change":"2024-08-17T02:47:49.699795+0000","last_active":"2024-08-17T02:47:49.703567+0000","last_peered":"2024-08-17T02:47:49.703567+0000","last_clean":"2024-08-17T02:47:49.703567+0000","last_became_active":"2024-08-17T02:47:49.699527+0000","last_became_peered":"2024-08-17T02:47:49.699527+0000","last_unstale":"2024-08-17T02:47:49.703567+0000","last_undegraded":"2024-08-17T02:47:49.703567+0000","last_fullsized":"2024-08-17T02:47:49.703567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:54.538074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.722980+0000","last_change":"2024-08-17T02:47:50.722980+0000","last_active":"2024-08-17T02:47:50.722980+0000","last_peered":"2024-08-17T02:47:50.722980+0000","last_clean":"2024-08-17T02:47:50.722980+0000","last_became_active":"2024-08-17T02:47:50.722693+0000","last_became_peered":"2024-08-17T02:47:50.722693+0000","last_unstale":"2024-08-17T02:47:50.722980+0000","last_undegraded":"2024-08-17T02:47:50.722980+0000","last_fullsized":"2024-08-17T02:47:50.722980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:48.951074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.702987+0000","last_change":"2024-08-17T02:47:49.698803+0000","last_active":"2024-08-17T02:47:49.702987+0000","last_peered":"2024-08-17T02:47:49.702987+0000","last_clean":"2024-08-17T02:47:49.702987+0000","last_became_active":"2024-08-17T02:47:49.698543+0000","last_became_peered":"2024-08-17T02:47:49.698543+0000","last_unstale":"2024-08-17T02:47:49.702987+0000","last_undegraded":"2024-08-17T02:47:49.702987+0000","last_fullsized":"2024-08-17T02:47:49.702987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:03.451290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.694757+0000","last_change":"2024-08-17T02:47:50.694757+0000","last_active":"2024-08-17T02:47:50.694757+0000","last_peered":"2024-08-17T02:47:50.694757+0000","last_clean":"2024-08-17T02:47:50.694757+0000","last_became_active":"2024-08-17T02:47:50.694486+0000","last_became_peered":"2024-08-17T02:47:50.694486+0000","last_unstale":"2024-08-17T02:47:50.694757+0000","last_undegraded":"2024-08-17T02:47:50.694757+0000","last_fullsized":"2024-08-17T02:47:50.694757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:06:32.357049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.703689+0000","last_change":"2024-08-17T02:47:49.701139+0000","last_active":"2024-08-17T02:47:49.703689+0000","last_peered":"2024-08-17T02:47:49.703689+0000","last_clean":"2024-08-17T02:47:49.703689+0000","last_became_active":"2024-08-17T02:47:49.700837+0000","last_became_peered":"2024-08-17T02:47:49.700837+0000","last_unstale":"2024-08-17T02:47:49.703689+0000","last_undegraded":"2024-08-17T02:47:49.703689+0000","last_fullsized":"2024-08-17T02:47:49.703689+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:26.659030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.704434+0000","last_change":"2024-08-17T02:47:50.704434+0000","last_active":"2024-08-17T02:47:50.704434+0000","last_peered":"2024-08-17T02:47:50.704434+0000","last_clean":"2024-08-17T02:47:50.704434+0000","last_became_active":"2024-08-17T02:47:50.704198+0000","last_became_peered":"2024-08-17T02:47:50.704198+0000","last_unstale":"2024-08-17T02:47:50.704434+0000","last_undegraded":"2024-08-17T02:47:50.704434+0000","last_fullsized":"2024-08-17T02:47:50.704434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:10:31.116343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.702793+0000","last_change":"2024-08-17T02:47:49.697348+0000","last_active":"2024-08-17T02:47:49.702793+0000","last_peered":"2024-08-17T02:47:49.702793+0000","last_clean":"2024-08-17T02:47:49.702793+0000","last_became_active":"2024-08-17T02:47:49.697004+0000","last_became_peered":"2024-08-17T02:47:49.697004+0000","last_unstale":"2024-08-17T02:47:49.702793+0000","last_undegraded":"2024-08-17T02:47:49.702793+0000","last_fullsized":"2024-08-17T02:47:49.702793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:21.042241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.718314+0000","last_change":"2024-08-17T02:47:50.718314+0000","last_active":"2024-08-17T02:47:50.718314+0000","last_peered":"2024-08-17T02:47:50.718314+0000","last_clean":"2024-08-17T02:47:50.718314+0000","last_became_active":"2024-08-17T02:47:50.718010+0000","last_became_peered":"2024-08-17T02:47:50.718010+0000","last_unstale":"2024-08-17T02:47:50.718314+0000","last_undegraded":"2024-08-17T02:47:50.718314+0000","last_fullsized":"2024-08-17T02:47:50.718314+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:17.624303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.712574+0000","last_change":"2024-08-17T02:47:49.706835+0000","last_active":"2024-08-17T02:47:49.712574+0000","last_peered":"2024-08-17T02:47:49.712574+0000","last_clean":"2024-08-17T02:47:49.712574+0000","last_became_active":"2024-08-17T02:47:49.706529+0000","last_became_peered":"2024-08-17T02:47:49.706529+0000","last_unstale":"2024-08-17T02:47:49.712574+0000","last_undegraded":"2024-08-17T02:47:49.712574+0000","last_fullsized":"2024-08-17T02:47:49.712574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:01.027704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.714404+0000","last_change":"2024-08-17T02:47:50.714404+0000","last_active":"2024-08-17T02:47:50.714404+0000","last_peered":"2024-08-17T02:47:50.714404+0000","last_clean":"2024-08-17T02:47:50.714404+0000","last_became_active":"2024-08-17T02:47:50.713564+0000","last_became_peered":"2024-08-17T02:47:50.713564+0000","last_unstale":"2024-08-17T02:47:50.714404+0000","last_undegraded":"2024-08-17T02:47:50.714404+0000","last_fullsized":"2024-08-17T02:47:50.714404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:58.825259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.708966+0000","last_change":"2024-08-17T02:47:49.708023+0000","last_active":"2024-08-17T02:47:49.708966+0000","last_peered":"2024-08-17T02:47:49.708966+0000","last_clean":"2024-08-17T02:47:49.708966+0000","last_became_active":"2024-08-17T02:47:49.707785+0000","last_became_peered":"2024-08-17T02:47:49.707785+0000","last_unstale":"2024-08-17T02:47:49.708966+0000","last_undegraded":"2024-08-17T02:47:49.708966+0000","last_fullsized":"2024-08-17T02:47:49.708966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:14.739902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.698931+0000","last_change":"2024-08-17T02:47:50.698931+0000","last_active":"2024-08-17T02:47:50.698931+0000","last_peered":"2024-08-17T02:47:50.698931+0000","last_clean":"2024-08-17T02:47:50.698931+0000","last_became_active":"2024-08-17T02:47:50.698638+0000","last_became_peered":"2024-08-17T02:47:50.698638+0000","last_unstale":"2024-08-17T02:47:50.698931+0000","last_undegraded":"2024-08-17T02:47:50.698931+0000","last_fullsized":"2024-08-17T02:47:50.698931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:23.844672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.704644+0000","last_change":"2024-08-17T02:47:49.702297+0000","last_active":"2024-08-17T02:47:49.704644+0000","last_peered":"2024-08-17T02:47:49.704644+0000","last_clean":"2024-08-17T02:47:49.704644+0000","last_became_active":"2024-08-17T02:47:49.702074+0000","last_became_peered":"2024-08-17T02:47:49.702074+0000","last_unstale":"2024-08-17T02:47:49.704644+0000","last_undegraded":"2024-08-17T02:47:49.704644+0000","last_fullsized":"2024-08-17T02:47:49.704644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:45.383147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.703402+0000","last_change":"2024-08-17T02:46:48.424689+0000","last_active":"2024-08-17T02:47:49.703402+0000","last_peered":"2024-08-17T02:47:49.703402+0000","last_clean":"2024-08-17T02:47:49.703402+0000","last_became_active":"2024-08-17T02:46:48.423437+0000","last_became_peered":"2024-08-17T02:46:48.423437+0000","last_unstale":"2024-08-17T02:47:49.703402+0000","last_undegraded":"2024-08-17T02:47:49.703402+0000","last_fullsized":"2024-08-17T02:47:49.703402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.106569+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:50.533980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298276,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073564,"statfs":{"total":96636764160,"available":96331329536,"internally_reserved":0,"allocated":946176,"data_stored":724337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.77300000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.80600000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.65500000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.56799999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.626}]},{"osd":6,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":335872,"data_stored":127116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.621},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.81399999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.65700000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.68000000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.83899999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.92000000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.85699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":356352,"data_stored":134539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.62}]},{"osd":1,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.78500000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.70899999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.63100000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.73999999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.75700000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.69699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":335872,"data_stored":127116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.78200000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.54500000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.627},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.82099999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.69499999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301840,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070000,"statfs":{"total":96636764160,"available":96327680000,"internally_reserved":0,"allocated":335872,"data_stored":127116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:49 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.31},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.27000000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:47:49 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38300000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:47:49 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.47499999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:47:49 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.78100000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:47:49 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:47:49 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:47:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.81200000000000006}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301844,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069996,"statfs":{"total":96636764160,"available":96327675904,"internally_reserved":0,"allocated":335872,"data_stored":127116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.40200000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.55100000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.94799999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.86899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.93700000000000006}]},{"osd":7,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.91800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301844,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069996,"statfs":{"total":96636764160,"available":96327675904,"internally_reserved":0,"allocated":335872,"data_stored":127116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.41699999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":2.9769999999999999,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.376}]},{"osd":3,"last update":"Sat Aug 17 02:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.39100000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.3279999999999998,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.89500000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.72899999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.3820000000000001,"5min":3.3820000000000001,"15min":3.3820000000000001},"last":0.79900000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.5459999999999998,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":0.73599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302428,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069412,"statfs":{"total":96636764160,"available":96327077888,"internally_reserved":0,"allocated":929792,"data_stored":717484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.442}]},{"osd":2,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.38800000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.52900000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.85199999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.68400000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.79700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:47:54.900 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:47:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.082+0000 7f6fae000640 1 Processor -- start 2024-08-17T02:47:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.082+0000 7f6fae000640 1 -- start start 2024-08-17T02:47:55.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.083+0000 7f6fae000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6fa8158e10 0x7f6fa8068180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.083+0000 7f6fae000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6fa8068dd0 0x7f6fa80cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.083+0000 7f6fae000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa80c40a0 con 0x7f6fa81591e0 2024-08-17T02:47:55.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.083+0000 7f6fae000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa80694e0 con 0x7f6fa8068dd0 2024-08-17T02:47:55.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.083+0000 7f6fae000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa8069240 con 0x7f6fa8158e10 2024-08-17T02:47:55.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.084+0000 7f6fa7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6fa8068dd0 0x7f6fa80cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.084+0000 7f6fa7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6fa8068dd0 0x7f6fa80cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47788/0 (socket says 172.21.15.5:47788) 2024-08-17T02:47:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.084+0000 7f6fa7e00640 1 -- 172.21.15.5:0/3420103069 learned_addr learned my addr 172.21.15.5:0/3420103069 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.084+0000 7f6fa7400640 1 --2- 172.21.15.5:0/3420103069 >> v2:172.21.15.107:3300/0 conn(0x7f6fa8158e10 0x7f6fa8068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:55.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.084+0000 7f6fa7e00640 1 -- 172.21.15.5:0/3420103069 >> v2:172.21.15.107:3300/0 conn(0x7f6fa8158e10 msgr2=0x7f6fa8068180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:55.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.084+0000 7f6fa7e00640 1 --2- 172.21.15.5:0/3420103069 >> v2:172.21.15.107:3300/0 conn(0x7f6fa8158e10 0x7f6fa8068180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.084+0000 7f6fa7e00640 1 -- 172.21.15.5:0/3420103069 >> v1:172.21.15.107:6789/0 conn(0x7f6fa81591e0 legacy=0x7f6fa80686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.084+0000 7f6fa7e00640 1 -- 172.21.15.5:0/3420103069 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa80c3a50 con 0x7f6fa8068dd0 2024-08-17T02:47:55.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.085+0000 7f6fa7e00640 1 --2- 172.21.15.5:0/3420103069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa8068dd0 0x7f6fa80cbfd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6fa806a5d0 tx=0x7f6fa0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2928450f812665d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:55.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.085+0000 7f6fa6000640 1 -- 172.21.15.5:0/3420103069 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa002e050 con 0x7f6fa8068dd0 2024-08-17T02:47:55.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.085+0000 7f6fa6000640 1 -- 172.21.15.5:0/3420103069 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa0007400 con 0x7f6fa8068dd0 2024-08-17T02:47:55.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.085+0000 7f6fa6000640 1 -- 172.21.15.5:0/3420103069 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa00077e0 con 0x7f6fa8068dd0 2024-08-17T02:47:55.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.086+0000 7f6fae000640 1 -- 172.21.15.5:0/3420103069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa8068dd0 msgr2=0x7f6fa80cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.086+0000 7f6fae000640 1 --2- 172.21.15.5:0/3420103069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa8068dd0 0x7f6fa80cbfd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6fa806a5d0 tx=0x7f6fa0009840 comp rx=0 tx=0).stop 2024-08-17T02:47:55.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.086+0000 7f6fae000640 1 -- 172.21.15.5:0/3420103069 shutdown_connections 2024-08-17T02:47:55.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.086+0000 7f6fae000640 1 --2- 172.21.15.5:0/3420103069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa8068dd0 0x7f6fa80cbfd0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.086+0000 7f6fae000640 1 --2- 172.21.15.5:0/3420103069 >> v2:172.21.15.107:3300/0 conn(0x7f6fa8158e10 0x7f6fa8068180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.086+0000 7f6fae000640 1 -- 172.21.15.5:0/3420103069 >> 172.21.15.5:0/3420103069 conn(0x7f6fa80ce590 msgr2=0x7f6fa80ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:55.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.086+0000 7f6fae000640 1 -- 172.21.15.5:0/3420103069 shutdown_connections 2024-08-17T02:47:55.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.086+0000 7f6fae000640 1 -- 172.21.15.5:0/3420103069 wait complete. 2024-08-17T02:47:55.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.087+0000 7f6fae000640 1 Processor -- start 2024-08-17T02:47:55.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.088+0000 7f6fae000640 1 -- start start 2024-08-17T02:47:55.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.088+0000 7f6fae000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6fa8068dd0 0x7f6fa80afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.088+0000 7f6fae000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa8158e10 0x7f6fa8155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.088+0000 7f6fae000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa81591e0 0x7f6fa8067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.088+0000 7f6fae000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa816ae50 con 0x7f6fa8158e10 2024-08-17T02:47:55.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.088+0000 7f6fae000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa816a240 con 0x7f6fa81591e0 2024-08-17T02:47:55.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.088+0000 7f6fae000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa816a520 con 0x7f6fa8068dd0 2024-08-17T02:47:55.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.089+0000 7f6fa6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa8158e10 0x7f6fa8155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:55.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.089+0000 7f6fa6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa8158e10 0x7f6fa8155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47790/0 (socket says 172.21.15.5:47790) 2024-08-17T02:47:55.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.089+0000 7f6fa6a00640 1 -- 172.21.15.5:0/1746961734 learned_addr learned my addr 172.21.15.5:0/1746961734 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:55.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.089+0000 7f6fa7e00640 1 --2- 172.21.15.5:0/1746961734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa81591e0 0x7f6fa8067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:55.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.089+0000 7f6fa7400640 1 --2- 172.21.15.5:0/1746961734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6fa8068dd0 0x7f6fa80afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:55.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.089+0000 7f6fa6a00640 1 -- 172.21.15.5:0/1746961734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6fa8068dd0 msgr2=0x7f6fa80afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.089+0000 7f6fa6a00640 1 --2- 172.21.15.5:0/1746961734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6fa8068dd0 0x7f6fa80afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.089+0000 7f6fa6a00640 1 -- 172.21.15.5:0/1746961734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa81591e0 msgr2=0x7f6fa8067f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.089+0000 7f6fa6a00640 1 --2- 172.21.15.5:0/1746961734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa81591e0 0x7f6fa8067f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.089+0000 7f6fa6a00640 1 -- 172.21.15.5:0/1746961734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa0009ae0 con 0x7f6fa8158e10 2024-08-17T02:47:55.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.089+0000 7f6fa7e00640 1 --2- 172.21.15.5:0/1746961734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa81591e0 0x7f6fa8067f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:55.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.089+0000 7f6fa6a00640 1 --2- 172.21.15.5:0/1746961734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa8158e10 0x7f6fa8155030 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400c560 tx=0x7f6f94007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:55.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.090+0000 7f6f9ea00640 1 -- 172.21.15.5:0/1746961734 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94011590 con 0x7f6fa8158e10 2024-08-17T02:47:55.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.090+0000 7f6f9ea00640 1 -- 172.21.15.5:0/1746961734 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f940116f0 con 0x7f6fa8158e10 2024-08-17T02:47:55.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.090+0000 7f6f9ea00640 1 -- 172.21.15.5:0/1746961734 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94011ab0 con 0x7f6fa8158e10 2024-08-17T02:47:55.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.090+0000 7f6fae000640 1 -- 172.21.15.5:0/1746961734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa816a800 con 0x7f6fa8158e10 2024-08-17T02:47:55.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.090+0000 7f6fae000640 1 -- 172.21.15.5:0/1746961734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa80b00f0 con 0x7f6fa8158e10 2024-08-17T02:47:55.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.091+0000 7f6fae000640 1 -- 172.21.15.5:0/1746961734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa816b000 con 0x7f6fa8158e10 2024-08-17T02:47:55.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.092+0000 7f6f9ea00640 1 -- 172.21.15.5:0/1746961734 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6f9401b3b0 con 0x7f6fa8158e10 2024-08-17T02:47:55.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.092+0000 7f6f9ea00640 1 --2- 172.21.15.5:0/1746961734 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6f88065150 0x7f6f88067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.092+0000 7f6f9ea00640 1 -- 172.21.15.5:0/1746961734 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f94081a10 con 0x7f6fa8158e10 2024-08-17T02:47:55.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.093+0000 7f6fa7400640 1 --2- 172.21.15.5:0/1746961734 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6f88065150 0x7f6f88067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:55.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.093+0000 7f6fa7400640 1 --2- 172.21.15.5:0/1746961734 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6f88065150 0x7f6f88067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8068c10 tx=0x7f6f98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:55.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.096+0000 7f6f9ea00640 1 -- 172.21.15.5:0/1746961734 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6fa816b000 con 0x7f6fa8158e10 2024-08-17T02:47:55.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.274+0000 7f6fae000640 1 -- 172.21.15.5:0/1746961734 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6fa816a9f0 con 0x7f6f88065150 2024-08-17T02:47:55.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.282+0000 7f6f9ea00640 1 -- 172.21.15.5:0/1746961734 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289607 (secure 0 0 0) 0x7f6fa816a9f0 con 0x7f6f88065150 2024-08-17T02:47:55.286 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:55.287 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:47:55.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.286+0000 7f6fae000640 1 -- 172.21.15.5:0/1746961734 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6f88065150 msgr2=0x7f6f88067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.286+0000 7f6fae000640 1 --2- 172.21.15.5:0/1746961734 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6f88065150 0x7f6f88067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8068c10 tx=0x7f6f98008040 comp rx=0 tx=0).stop 2024-08-17T02:47:55.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.286+0000 7f6fae000640 1 -- 172.21.15.5:0/1746961734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa8158e10 msgr2=0x7f6fa8155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.286+0000 7f6fae000640 1 --2- 172.21.15.5:0/1746961734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa8158e10 0x7f6fa8155030 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400c560 tx=0x7f6f94007e90 comp rx=0 tx=0).stop 2024-08-17T02:47:55.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.286+0000 7f6fae000640 1 -- 172.21.15.5:0/1746961734 shutdown_connections 2024-08-17T02:47:55.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.286+0000 7f6fae000640 1 --2- 172.21.15.5:0/1746961734 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6f88065150 0x7f6f88067600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.286+0000 7f6fae000640 1 --2- 172.21.15.5:0/1746961734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa81591e0 0x7f6fa8067f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.286+0000 7f6fae000640 1 --2- 172.21.15.5:0/1746961734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fa8158e10 0x7f6fa8155030 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.286+0000 7f6fae000640 1 --2- 172.21.15.5:0/1746961734 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6fa8068dd0 0x7f6fa80afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.286+0000 7f6fae000640 1 -- 172.21.15.5:0/1746961734 >> 172.21.15.5:0/1746961734 conn(0x7f6fa80ce590 msgr2=0x7f6fa806d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:55.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.286+0000 7f6fae000640 1 -- 172.21.15.5:0/1746961734 shutdown_connections 2024-08-17T02:47:55.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.286+0000 7f6fae000640 1 -- 172.21.15.5:0/1746961734 wait complete. 2024-08-17T02:47:55.302 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-08-17T02:47:55.064040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399308,"kb_used_data":3820,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575412,"statfs":{"total":773094113280,"available":770637221888,"internally_reserved":0,"allocated":3911680,"data_stored":2211940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000891"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.698676+0000","last_change":"2024-08-17T02:47:50.698676+0000","last_active":"2024-08-17T02:47:50.698676+0000","last_peered":"2024-08-17T02:47:50.698676+0000","last_clean":"2024-08-17T02:47:50.698676+0000","last_became_active":"2024-08-17T02:47:50.698411+0000","last_became_peered":"2024-08-17T02:47:50.698411+0000","last_unstale":"2024-08-17T02:47:50.698676+0000","last_undegraded":"2024-08-17T02:47:50.698676+0000","last_fullsized":"2024-08-17T02:47:50.698676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:02.038974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.713600+0000","last_change":"2024-08-17T02:47:50.713600+0000","last_active":"2024-08-17T02:47:50.713600+0000","last_peered":"2024-08-17T02:47:50.713600+0000","last_clean":"2024-08-17T02:47:50.713600+0000","last_became_active":"2024-08-17T02:47:50.713277+0000","last_became_peered":"2024-08-17T02:47:50.713277+0000","last_unstale":"2024-08-17T02:47:50.713600+0000","last_undegraded":"2024-08-17T02:47:50.713600+0000","last_fullsized":"2024-08-17T02:47:50.713600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:23.844672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.722447+0000","last_change":"2024-08-17T02:47:50.722447+0000","last_active":"2024-08-17T02:47:50.722447+0000","last_peered":"2024-08-17T02:47:50.722447+0000","last_clean":"2024-08-17T02:47:50.722447+0000","last_became_active":"2024-08-17T02:47:50.722161+0000","last_became_peered":"2024-08-17T02:47:50.722161+0000","last_unstale":"2024-08-17T02:47:50.722447+0000","last_undegraded":"2024-08-17T02:47:50.722447+0000","last_fullsized":"2024-08-17T02:47:50.722447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:17.624303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.720497+0000","last_change":"2024-08-17T02:47:50.720497+0000","last_active":"2024-08-17T02:47:50.720497+0000","last_peered":"2024-08-17T02:47:50.720497+0000","last_clean":"2024-08-17T02:47:50.720497+0000","last_became_active":"2024-08-17T02:47:50.720089+0000","last_became_peered":"2024-08-17T02:47:50.720089+0000","last_unstale":"2024-08-17T02:47:50.720497+0000","last_undegraded":"2024-08-17T02:47:50.720497+0000","last_fullsized":"2024-08-17T02:47:50.720497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:32.996250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.713724+0000","last_change":"2024-08-17T02:47:50.713724+0000","last_active":"2024-08-17T02:47:50.713724+0000","last_peered":"2024-08-17T02:47:50.713724+0000","last_clean":"2024-08-17T02:47:50.713724+0000","last_became_active":"2024-08-17T02:47:50.713440+0000","last_became_peered":"2024-08-17T02:47:50.713440+0000","last_unstale":"2024-08-17T02:47:50.713724+0000","last_undegraded":"2024-08-17T02:47:50.713724+0000","last_fullsized":"2024-08-17T02:47:50.713724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:55.544419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.713818+0000","last_change":"2024-08-17T02:47:50.713818+0000","last_active":"2024-08-17T02:47:50.713818+0000","last_peered":"2024-08-17T02:47:50.713818+0000","last_clean":"2024-08-17T02:47:50.713818+0000","last_became_active":"2024-08-17T02:47:50.712510+0000","last_became_peered":"2024-08-17T02:47:50.712510+0000","last_unstale":"2024-08-17T02:47:50.713818+0000","last_undegraded":"2024-08-17T02:47:50.713818+0000","last_fullsized":"2024-08-17T02:47:50.713818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:40.650168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.706705+0000","last_change":"2024-08-17T02:47:50.706705+0000","last_active":"2024-08-17T02:47:50.706705+0000","last_peered":"2024-08-17T02:47:50.706705+0000","last_clean":"2024-08-17T02:47:50.706705+0000","last_became_active":"2024-08-17T02:47:50.706445+0000","last_became_peered":"2024-08-17T02:47:50.706445+0000","last_unstale":"2024-08-17T02:47:50.706705+0000","last_undegraded":"2024-08-17T02:47:50.706705+0000","last_fullsized":"2024-08-17T02:47:50.706705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:56.659610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.700524+0000","last_change":"2024-08-17T02:47:50.700524+0000","last_active":"2024-08-17T02:47:50.700524+0000","last_peered":"2024-08-17T02:47:50.700524+0000","last_clean":"2024-08-17T02:47:50.700524+0000","last_became_active":"2024-08-17T02:47:50.700240+0000","last_became_peered":"2024-08-17T02:47:50.700240+0000","last_unstale":"2024-08-17T02:47:50.700524+0000","last_undegraded":"2024-08-17T02:47:50.700524+0000","last_fullsized":"2024-08-17T02:47:50.700524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:43.959759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.721340+0000","last_change":"2024-08-17T02:47:50.721340+0000","last_active":"2024-08-17T02:47:50.721340+0000","last_peered":"2024-08-17T02:47:50.721340+0000","last_clean":"2024-08-17T02:47:50.721340+0000","last_became_active":"2024-08-17T02:47:50.721067+0000","last_became_peered":"2024-08-17T02:47:50.721067+0000","last_unstale":"2024-08-17T02:47:50.721340+0000","last_undegraded":"2024-08-17T02:47:50.721340+0000","last_fullsized":"2024-08-17T02:47:50.721340+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:48.951074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.719191+0000","last_change":"2024-08-17T02:47:50.719191+0000","last_active":"2024-08-17T02:47:50.719191+0000","last_peered":"2024-08-17T02:47:50.719191+0000","last_clean":"2024-08-17T02:47:50.719191+0000","last_became_active":"2024-08-17T02:47:50.718943+0000","last_became_peered":"2024-08-17T02:47:50.718943+0000","last_unstale":"2024-08-17T02:47:50.719191+0000","last_undegraded":"2024-08-17T02:47:50.719191+0000","last_fullsized":"2024-08-17T02:47:50.719191+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:16:44.316358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.723562+0000","last_change":"2024-08-17T02:47:50.723562+0000","last_active":"2024-08-17T02:47:50.723562+0000","last_peered":"2024-08-17T02:47:50.723562+0000","last_clean":"2024-08-17T02:47:50.723562+0000","last_became_active":"2024-08-17T02:47:50.723303+0000","last_became_peered":"2024-08-17T02:47:50.723303+0000","last_unstale":"2024-08-17T02:47:50.723562+0000","last_undegraded":"2024-08-17T02:47:50.723562+0000","last_fullsized":"2024-08-17T02:47:50.723562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:16:44.316358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.713957+0000","last_change":"2024-08-17T02:47:50.713957+0000","last_active":"2024-08-17T02:47:50.713957+0000","last_peered":"2024-08-17T02:47:50.713957+0000","last_clean":"2024-08-17T02:47:50.713957+0000","last_became_active":"2024-08-17T02:47:50.713571+0000","last_became_peered":"2024-08-17T02:47:50.713571+0000","last_unstale":"2024-08-17T02:47:50.713957+0000","last_undegraded":"2024-08-17T02:47:50.713957+0000","last_fullsized":"2024-08-17T02:47:50.713957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:52:56.309723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.721159+0000","last_change":"2024-08-17T02:47:50.721159+0000","last_active":"2024-08-17T02:47:50.721159+0000","last_peered":"2024-08-17T02:47:50.721159+0000","last_clean":"2024-08-17T02:47:50.721159+0000","last_became_active":"2024-08-17T02:47:50.720856+0000","last_became_peered":"2024-08-17T02:47:50.720856+0000","last_unstale":"2024-08-17T02:47:50.721159+0000","last_undegraded":"2024-08-17T02:47:50.721159+0000","last_fullsized":"2024-08-17T02:47:50.721159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:38.530239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.714179+0000","last_change":"2024-08-17T02:47:50.714179+0000","last_active":"2024-08-17T02:47:50.714179+0000","last_peered":"2024-08-17T02:47:50.714179+0000","last_clean":"2024-08-17T02:47:50.714179+0000","last_became_active":"2024-08-17T02:47:50.713917+0000","last_became_peered":"2024-08-17T02:47:50.713917+0000","last_unstale":"2024-08-17T02:47:50.714179+0000","last_undegraded":"2024-08-17T02:47:50.714179+0000","last_fullsized":"2024-08-17T02:47:50.714179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:37.218481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.698869+0000","last_change":"2024-08-17T02:47:50.698869+0000","last_active":"2024-08-17T02:47:50.698869+0000","last_peered":"2024-08-17T02:47:50.698869+0000","last_clean":"2024-08-17T02:47:50.698869+0000","last_became_active":"2024-08-17T02:47:50.698589+0000","last_became_peered":"2024-08-17T02:47:50.698589+0000","last_unstale":"2024-08-17T02:47:50.698869+0000","last_undegraded":"2024-08-17T02:47:50.698869+0000","last_fullsized":"2024-08-17T02:47:50.698869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:56.659610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.704032+0000","last_change":"2024-08-17T02:47:50.704032+0000","last_active":"2024-08-17T02:47:50.704032+0000","last_peered":"2024-08-17T02:47:50.704032+0000","last_clean":"2024-08-17T02:47:50.704032+0000","last_became_active":"2024-08-17T02:47:50.703777+0000","last_became_peered":"2024-08-17T02:47:50.703777+0000","last_unstale":"2024-08-17T02:47:50.704032+0000","last_undegraded":"2024-08-17T02:47:50.704032+0000","last_fullsized":"2024-08-17T02:47:50.704032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:48.951074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.711131+0000","last_change":"2024-08-17T02:47:50.711131+0000","last_active":"2024-08-17T02:47:50.711131+0000","last_peered":"2024-08-17T02:47:50.711131+0000","last_clean":"2024-08-17T02:47:50.711131+0000","last_became_active":"2024-08-17T02:47:50.710858+0000","last_became_peered":"2024-08-17T02:47:50.710858+0000","last_unstale":"2024-08-17T02:47:50.711131+0000","last_undegraded":"2024-08-17T02:47:50.711131+0000","last_fullsized":"2024-08-17T02:47:50.711131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:48.663280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.725940+0000","last_change":"2024-08-17T02:47:50.725940+0000","last_active":"2024-08-17T02:47:50.725940+0000","last_peered":"2024-08-17T02:47:50.725940+0000","last_clean":"2024-08-17T02:47:50.725940+0000","last_became_active":"2024-08-17T02:47:50.725649+0000","last_became_peered":"2024-08-17T02:47:50.725649+0000","last_unstale":"2024-08-17T02:47:50.725940+0000","last_undegraded":"2024-08-17T02:47:50.725940+0000","last_fullsized":"2024-08-17T02:47:50.725940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:22.432694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.725878+0000","last_change":"2024-08-17T02:47:50.725878+0000","last_active":"2024-08-17T02:47:50.725878+0000","last_peered":"2024-08-17T02:47:50.725878+0000","last_clean":"2024-08-17T02:47:50.725878+0000","last_became_active":"2024-08-17T02:47:50.725507+0000","last_became_peered":"2024-08-17T02:47:50.725507+0000","last_unstale":"2024-08-17T02:47:50.725878+0000","last_undegraded":"2024-08-17T02:47:50.725878+0000","last_fullsized":"2024-08-17T02:47:50.725878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:43.959759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.699330+0000","last_change":"2024-08-17T02:47:50.699330+0000","last_active":"2024-08-17T02:47:50.699330+0000","last_peered":"2024-08-17T02:47:50.699330+0000","last_clean":"2024-08-17T02:47:50.699330+0000","last_became_active":"2024-08-17T02:47:50.699153+0000","last_became_peered":"2024-08-17T02:47:50.699153+0000","last_unstale":"2024-08-17T02:47:50.699330+0000","last_undegraded":"2024-08-17T02:47:50.699330+0000","last_fullsized":"2024-08-17T02:47:50.699330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:01.162355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.718164+0000","last_change":"2024-08-17T02:47:50.718164+0000","last_active":"2024-08-17T02:47:50.718164+0000","last_peered":"2024-08-17T02:47:50.718164+0000","last_clean":"2024-08-17T02:47:50.718164+0000","last_became_active":"2024-08-17T02:47:50.717903+0000","last_became_peered":"2024-08-17T02:47:50.717903+0000","last_unstale":"2024-08-17T02:47:50.718164+0000","last_undegraded":"2024-08-17T02:47:50.718164+0000","last_fullsized":"2024-08-17T02:47:50.718164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:27.269328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.713966+0000","last_change":"2024-08-17T02:47:50.713966+0000","last_active":"2024-08-17T02:47:50.713966+0000","last_peered":"2024-08-17T02:47:50.713966+0000","last_clean":"2024-08-17T02:47:50.713966+0000","last_became_active":"2024-08-17T02:47:50.713689+0000","last_became_peered":"2024-08-17T02:47:50.713689+0000","last_unstale":"2024-08-17T02:47:50.713966+0000","last_undegraded":"2024-08-17T02:47:50.713966+0000","last_fullsized":"2024-08-17T02:47:50.713966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:02.281483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.708813+0000","last_change":"2024-08-17T02:47:50.708813+0000","last_active":"2024-08-17T02:47:50.708813+0000","last_peered":"2024-08-17T02:47:50.708813+0000","last_clean":"2024-08-17T02:47:50.708813+0000","last_became_active":"2024-08-17T02:47:50.708570+0000","last_became_peered":"2024-08-17T02:47:50.708570+0000","last_unstale":"2024-08-17T02:47:50.708813+0000","last_undegraded":"2024-08-17T02:47:50.708813+0000","last_fullsized":"2024-08-17T02:47:50.708813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:32.996250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.692501+0000","last_change":"2024-08-17T02:47:50.692501+0000","last_active":"2024-08-17T02:47:50.692501+0000","last_peered":"2024-08-17T02:47:50.692501+0000","last_clean":"2024-08-17T02:47:50.692501+0000","last_became_active":"2024-08-17T02:47:50.692218+0000","last_became_peered":"2024-08-17T02:47:50.692218+0000","last_unstale":"2024-08-17T02:47:50.692501+0000","last_undegraded":"2024-08-17T02:47:50.692501+0000","last_fullsized":"2024-08-17T02:47:50.692501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:16:44.316358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.716072+0000","last_change":"2024-08-17T02:47:50.716072+0000","last_active":"2024-08-17T02:47:50.716072+0000","last_peered":"2024-08-17T02:47:50.716072+0000","last_clean":"2024-08-17T02:47:50.716072+0000","last_became_active":"2024-08-17T02:47:50.715748+0000","last_became_peered":"2024-08-17T02:47:50.715748+0000","last_unstale":"2024-08-17T02:47:50.716072+0000","last_undegraded":"2024-08-17T02:47:50.716072+0000","last_fullsized":"2024-08-17T02:47:50.716072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:52:56.309723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.715816+0000","last_change":"2024-08-17T02:47:50.715816+0000","last_active":"2024-08-17T02:47:50.715816+0000","last_peered":"2024-08-17T02:47:50.715816+0000","last_clean":"2024-08-17T02:47:50.715816+0000","last_became_active":"2024-08-17T02:47:50.715531+0000","last_became_peered":"2024-08-17T02:47:50.715531+0000","last_unstale":"2024-08-17T02:47:50.715816+0000","last_undegraded":"2024-08-17T02:47:50.715816+0000","last_fullsized":"2024-08-17T02:47:50.715816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:48.663280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.724924+0000","last_change":"2024-08-17T02:47:50.724924+0000","last_active":"2024-08-17T02:47:50.724924+0000","last_peered":"2024-08-17T02:47:50.724924+0000","last_clean":"2024-08-17T02:47:50.724924+0000","last_became_active":"2024-08-17T02:47:50.724656+0000","last_became_peered":"2024-08-17T02:47:50.724656+0000","last_unstale":"2024-08-17T02:47:50.724924+0000","last_undegraded":"2024-08-17T02:47:50.724924+0000","last_fullsized":"2024-08-17T02:47:50.724924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:02.038974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.696106+0000","last_change":"2024-08-17T02:47:50.696106+0000","last_active":"2024-08-17T02:47:50.696106+0000","last_peered":"2024-08-17T02:47:50.696106+0000","last_clean":"2024-08-17T02:47:50.696106+0000","last_became_active":"2024-08-17T02:47:50.695861+0000","last_became_peered":"2024-08-17T02:47:50.695861+0000","last_unstale":"2024-08-17T02:47:50.696106+0000","last_undegraded":"2024-08-17T02:47:50.696106+0000","last_fullsized":"2024-08-17T02:47:50.696106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:23.844672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.715626+0000","last_change":"2024-08-17T02:47:50.715626+0000","last_active":"2024-08-17T02:47:50.715626+0000","last_peered":"2024-08-17T02:47:50.715626+0000","last_clean":"2024-08-17T02:47:50.715626+0000","last_became_active":"2024-08-17T02:47:50.714773+0000","last_became_peered":"2024-08-17T02:47:50.714773+0000","last_unstale":"2024-08-17T02:47:50.715626+0000","last_undegraded":"2024-08-17T02:47:50.715626+0000","last_fullsized":"2024-08-17T02:47:50.715626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:02.038974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.706611+0000","last_change":"2024-08-17T02:47:50.706611+0000","last_active":"2024-08-17T02:47:50.706611+0000","last_peered":"2024-08-17T02:47:50.706611+0000","last_clean":"2024-08-17T02:47:50.706611+0000","last_became_active":"2024-08-17T02:47:50.706129+0000","last_became_peered":"2024-08-17T02:47:50.706129+0000","last_unstale":"2024-08-17T02:47:50.706611+0000","last_undegraded":"2024-08-17T02:47:50.706611+0000","last_fullsized":"2024-08-17T02:47:50.706611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:17.624303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.691416+0000","last_change":"2024-08-17T02:47:50.691416+0000","last_active":"2024-08-17T02:47:50.691416+0000","last_peered":"2024-08-17T02:47:50.691416+0000","last_clean":"2024-08-17T02:47:50.691416+0000","last_became_active":"2024-08-17T02:47:50.691153+0000","last_became_peered":"2024-08-17T02:47:50.691153+0000","last_unstale":"2024-08-17T02:47:50.691416+0000","last_undegraded":"2024-08-17T02:47:50.691416+0000","last_fullsized":"2024-08-17T02:47:50.691416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:02.281483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.706332+0000","last_change":"2024-08-17T02:47:50.706332+0000","last_active":"2024-08-17T02:47:50.706332+0000","last_peered":"2024-08-17T02:47:50.706332+0000","last_clean":"2024-08-17T02:47:50.706332+0000","last_became_active":"2024-08-17T02:47:50.706038+0000","last_became_peered":"2024-08-17T02:47:50.706038+0000","last_unstale":"2024-08-17T02:47:50.706332+0000","last_undegraded":"2024-08-17T02:47:50.706332+0000","last_fullsized":"2024-08-17T02:47:50.706332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:32.996250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.707154+0000","last_change":"2024-08-17T02:47:50.707154+0000","last_active":"2024-08-17T02:47:50.707154+0000","last_peered":"2024-08-17T02:47:50.707154+0000","last_clean":"2024-08-17T02:47:50.707154+0000","last_became_active":"2024-08-17T02:47:50.706954+0000","last_became_peered":"2024-08-17T02:47:50.706954+0000","last_unstale":"2024-08-17T02:47:50.707154+0000","last_undegraded":"2024-08-17T02:47:50.707154+0000","last_fullsized":"2024-08-17T02:47:50.707154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:02.038974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.715255+0000","last_change":"2024-08-17T02:47:49.701911+0000","last_active":"2024-08-17T02:47:50.715255+0000","last_peered":"2024-08-17T02:47:50.715255+0000","last_clean":"2024-08-17T02:47:50.715255+0000","last_became_active":"2024-08-17T02:47:49.701579+0000","last_became_peered":"2024-08-17T02:47:49.701579+0000","last_unstale":"2024-08-17T02:47:50.715255+0000","last_undegraded":"2024-08-17T02:47:50.715255+0000","last_fullsized":"2024-08-17T02:47:50.715255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:00.156010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.714295+0000","last_change":"2024-08-17T02:47:50.714295+0000","last_active":"2024-08-17T02:47:50.714295+0000","last_peered":"2024-08-17T02:47:50.714295+0000","last_clean":"2024-08-17T02:47:50.714295+0000","last_became_active":"2024-08-17T02:47:50.714002+0000","last_became_peered":"2024-08-17T02:47:50.714002+0000","last_unstale":"2024-08-17T02:47:50.714295+0000","last_undegraded":"2024-08-17T02:47:50.714295+0000","last_fullsized":"2024-08-17T02:47:50.714295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:48.951074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.694880+0000","last_change":"2024-08-17T02:47:49.706188+0000","last_active":"2024-08-17T02:47:50.694880+0000","last_peered":"2024-08-17T02:47:50.694880+0000","last_clean":"2024-08-17T02:47:50.694880+0000","last_became_active":"2024-08-17T02:47:49.705937+0000","last_became_peered":"2024-08-17T02:47:49.705937+0000","last_unstale":"2024-08-17T02:47:50.694880+0000","last_undegraded":"2024-08-17T02:47:50.694880+0000","last_fullsized":"2024-08-17T02:47:50.694880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:14.739902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.716845+0000","last_change":"2024-08-17T02:47:50.716845+0000","last_active":"2024-08-17T02:47:50.716845+0000","last_peered":"2024-08-17T02:47:50.716845+0000","last_clean":"2024-08-17T02:47:50.716845+0000","last_became_active":"2024-08-17T02:47:50.716540+0000","last_became_peered":"2024-08-17T02:47:50.716540+0000","last_unstale":"2024-08-17T02:47:50.716845+0000","last_undegraded":"2024-08-17T02:47:50.716845+0000","last_fullsized":"2024-08-17T02:47:50.716845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:32.996250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.725736+0000","last_change":"2024-08-17T02:47:49.704890+0000","last_active":"2024-08-17T02:47:50.725736+0000","last_peered":"2024-08-17T02:47:50.725736+0000","last_clean":"2024-08-17T02:47:50.725736+0000","last_became_active":"2024-08-17T02:47:49.704621+0000","last_became_peered":"2024-08-17T02:47:49.704621+0000","last_unstale":"2024-08-17T02:47:50.725736+0000","last_undegraded":"2024-08-17T02:47:50.725736+0000","last_fullsized":"2024-08-17T02:47:50.725736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:34:03.272796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.719015+0000","last_change":"2024-08-17T02:47:50.719015+0000","last_active":"2024-08-17T02:47:50.719015+0000","last_peered":"2024-08-17T02:47:50.719015+0000","last_clean":"2024-08-17T02:47:50.719015+0000","last_became_active":"2024-08-17T02:47:50.718747+0000","last_became_peered":"2024-08-17T02:47:50.718747+0000","last_unstale":"2024-08-17T02:47:50.719015+0000","last_undegraded":"2024-08-17T02:47:50.719015+0000","last_fullsized":"2024-08-17T02:47:50.719015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:10:31.116343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.727536+0000","last_change":"2024-08-17T02:47:49.703598+0000","last_active":"2024-08-17T02:47:50.727536+0000","last_peered":"2024-08-17T02:47:50.727536+0000","last_clean":"2024-08-17T02:47:50.727536+0000","last_became_active":"2024-08-17T02:47:49.703329+0000","last_became_peered":"2024-08-17T02:47:49.703329+0000","last_unstale":"2024-08-17T02:47:50.727536+0000","last_undegraded":"2024-08-17T02:47:50.727536+0000","last_fullsized":"2024-08-17T02:47:50.727536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:05:46.149986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.717225+0000","last_change":"2024-08-17T02:47:50.717225+0000","last_active":"2024-08-17T02:47:50.717225+0000","last_peered":"2024-08-17T02:47:50.717225+0000","last_clean":"2024-08-17T02:47:50.717225+0000","last_became_active":"2024-08-17T02:47:50.710854+0000","last_became_peered":"2024-08-17T02:47:50.710854+0000","last_unstale":"2024-08-17T02:47:50.717225+0000","last_undegraded":"2024-08-17T02:47:50.717225+0000","last_fullsized":"2024-08-17T02:47:50.717225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:40.279894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.697645+0000","last_change":"2024-08-17T02:47:49.705213+0000","last_active":"2024-08-17T02:47:50.697645+0000","last_peered":"2024-08-17T02:47:50.697645+0000","last_clean":"2024-08-17T02:47:50.697645+0000","last_became_active":"2024-08-17T02:47:49.704929+0000","last_became_peered":"2024-08-17T02:47:49.704929+0000","last_unstale":"2024-08-17T02:47:50.697645+0000","last_undegraded":"2024-08-17T02:47:50.697645+0000","last_fullsized":"2024-08-17T02:47:50.697645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:04.361359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.697533+0000","last_change":"2024-08-17T02:47:50.697533+0000","last_active":"2024-08-17T02:47:50.697533+0000","last_peered":"2024-08-17T02:47:50.697533+0000","last_clean":"2024-08-17T02:47:50.697533+0000","last_became_active":"2024-08-17T02:47:50.697266+0000","last_became_peered":"2024-08-17T02:47:50.697266+0000","last_unstale":"2024-08-17T02:47:50.697533+0000","last_undegraded":"2024-08-17T02:47:50.697533+0000","last_fullsized":"2024-08-17T02:47:50.697533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:43.959759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.697426+0000","last_change":"2024-08-17T02:47:49.705473+0000","last_active":"2024-08-17T02:47:50.697426+0000","last_peered":"2024-08-17T02:47:50.697426+0000","last_clean":"2024-08-17T02:47:50.697426+0000","last_became_active":"2024-08-17T02:47:49.705058+0000","last_became_peered":"2024-08-17T02:47:49.705058+0000","last_unstale":"2024-08-17T02:47:50.697426+0000","last_undegraded":"2024-08-17T02:47:50.697426+0000","last_fullsized":"2024-08-17T02:47:50.697426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:09.980062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.707595+0000","last_change":"2024-08-17T02:47:50.707595+0000","last_active":"2024-08-17T02:47:50.707595+0000","last_peered":"2024-08-17T02:47:50.707595+0000","last_clean":"2024-08-17T02:47:50.707595+0000","last_became_active":"2024-08-17T02:47:50.707013+0000","last_became_peered":"2024-08-17T02:47:50.707013+0000","last_unstale":"2024-08-17T02:47:50.707595+0000","last_undegraded":"2024-08-17T02:47:50.707595+0000","last_fullsized":"2024-08-17T02:47:50.707595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:06:32.357049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.708628+0000","last_change":"2024-08-17T02:47:49.705191+0000","last_active":"2024-08-17T02:47:49.708628+0000","last_peered":"2024-08-17T02:47:49.708628+0000","last_clean":"2024-08-17T02:47:49.708628+0000","last_became_active":"2024-08-17T02:47:49.704944+0000","last_became_peered":"2024-08-17T02:47:49.704944+0000","last_unstale":"2024-08-17T02:47:49.708628+0000","last_undegraded":"2024-08-17T02:47:49.708628+0000","last_fullsized":"2024-08-17T02:47:49.708628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:26.659030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.712148+0000","last_change":"2024-08-17T02:47:50.712148+0000","last_active":"2024-08-17T02:47:50.712148+0000","last_peered":"2024-08-17T02:47:50.712148+0000","last_clean":"2024-08-17T02:47:50.712148+0000","last_became_active":"2024-08-17T02:47:50.707608+0000","last_became_peered":"2024-08-17T02:47:50.707608+0000","last_unstale":"2024-08-17T02:47:50.712148+0000","last_undegraded":"2024-08-17T02:47:50.712148+0000","last_fullsized":"2024-08-17T02:47:50.712148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:58.825259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.703411+0000","last_change":"2024-08-17T02:47:49.699435+0000","last_active":"2024-08-17T02:47:49.703411+0000","last_peered":"2024-08-17T02:47:49.703411+0000","last_clean":"2024-08-17T02:47:49.703411+0000","last_became_active":"2024-08-17T02:47:49.699036+0000","last_became_peered":"2024-08-17T02:47:49.699036+0000","last_unstale":"2024-08-17T02:47:49.703411+0000","last_undegraded":"2024-08-17T02:47:49.703411+0000","last_fullsized":"2024-08-17T02:47:49.703411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:32.285788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.713576+0000","last_change":"2024-08-17T02:47:50.713576+0000","last_active":"2024-08-17T02:47:50.713576+0000","last_peered":"2024-08-17T02:47:50.713576+0000","last_clean":"2024-08-17T02:47:50.713576+0000","last_became_active":"2024-08-17T02:47:50.713324+0000","last_became_peered":"2024-08-17T02:47:50.713324+0000","last_unstale":"2024-08-17T02:47:50.713576+0000","last_undegraded":"2024-08-17T02:47:50.713576+0000","last_fullsized":"2024-08-17T02:47:50.713576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:51:33.320139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.709438+0000","last_change":"2024-08-17T02:47:49.708177+0000","last_active":"2024-08-17T02:47:49.709438+0000","last_peered":"2024-08-17T02:47:49.709438+0000","last_clean":"2024-08-17T02:47:49.709438+0000","last_became_active":"2024-08-17T02:47:49.707795+0000","last_became_peered":"2024-08-17T02:47:49.707795+0000","last_unstale":"2024-08-17T02:47:49.709438+0000","last_undegraded":"2024-08-17T02:47:49.709438+0000","last_fullsized":"2024-08-17T02:47:49.709438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:54.538074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.721250+0000","last_change":"2024-08-17T02:47:50.721250+0000","last_active":"2024-08-17T02:47:50.721250+0000","last_peered":"2024-08-17T02:47:50.721250+0000","last_clean":"2024-08-17T02:47:50.721250+0000","last_became_active":"2024-08-17T02:47:50.719947+0000","last_became_peered":"2024-08-17T02:47:50.719947+0000","last_unstale":"2024-08-17T02:47:50.721250+0000","last_undegraded":"2024-08-17T02:47:50.721250+0000","last_fullsized":"2024-08-17T02:47:50.721250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:52:56.309723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.708034+0000","last_change":"2024-08-17T02:47:49.705698+0000","last_active":"2024-08-17T02:47:49.708034+0000","last_peered":"2024-08-17T02:47:49.708034+0000","last_clean":"2024-08-17T02:47:49.708034+0000","last_became_active":"2024-08-17T02:47:49.705434+0000","last_became_peered":"2024-08-17T02:47:49.705434+0000","last_unstale":"2024-08-17T02:47:49.708034+0000","last_undegraded":"2024-08-17T02:47:49.708034+0000","last_fullsized":"2024-08-17T02:47:49.708034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:45.383147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.716804+0000","last_change":"2024-08-17T02:47:50.716804+0000","last_active":"2024-08-17T02:47:50.716804+0000","last_peered":"2024-08-17T02:47:50.716804+0000","last_clean":"2024-08-17T02:47:50.716804+0000","last_became_active":"2024-08-17T02:47:50.716560+0000","last_became_peered":"2024-08-17T02:47:50.716560+0000","last_unstale":"2024-08-17T02:47:50.716804+0000","last_undegraded":"2024-08-17T02:47:50.716804+0000","last_fullsized":"2024-08-17T02:47:50.716804+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:45.682341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.710642+0000","last_change":"2024-08-17T02:47:49.705054+0000","last_active":"2024-08-17T02:47:50.710642+0000","last_peered":"2024-08-17T02:47:50.710642+0000","last_clean":"2024-08-17T02:47:50.710642+0000","last_became_active":"2024-08-17T02:47:49.704752+0000","last_became_peered":"2024-08-17T02:47:49.704752+0000","last_unstale":"2024-08-17T02:47:50.710642+0000","last_undegraded":"2024-08-17T02:47:50.710642+0000","last_fullsized":"2024-08-17T02:47:50.710642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:34:03.272796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.722591+0000","last_change":"2024-08-17T02:47:50.722591+0000","last_active":"2024-08-17T02:47:50.722591+0000","last_peered":"2024-08-17T02:47:50.722591+0000","last_clean":"2024-08-17T02:47:50.722591+0000","last_became_active":"2024-08-17T02:47:50.722207+0000","last_became_peered":"2024-08-17T02:47:50.722207+0000","last_unstale":"2024-08-17T02:47:50.722591+0000","last_undegraded":"2024-08-17T02:47:50.722591+0000","last_fullsized":"2024-08-17T02:47:50.722591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:48.663280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.728245+0000","last_change":"2024-08-17T02:47:49.700459+0000","last_active":"2024-08-17T02:47:50.728245+0000","last_peered":"2024-08-17T02:47:50.728245+0000","last_clean":"2024-08-17T02:47:50.728245+0000","last_became_active":"2024-08-17T02:47:49.700217+0000","last_became_peered":"2024-08-17T02:47:49.700217+0000","last_unstale":"2024-08-17T02:47:50.728245+0000","last_undegraded":"2024-08-17T02:47:50.728245+0000","last_fullsized":"2024-08-17T02:47:50.728245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:45.383147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.716121+0000","last_change":"2024-08-17T02:47:50.716121+0000","last_active":"2024-08-17T02:47:50.716121+0000","last_peered":"2024-08-17T02:47:50.716121+0000","last_clean":"2024-08-17T02:47:50.716121+0000","last_became_active":"2024-08-17T02:47:50.715803+0000","last_became_peered":"2024-08-17T02:47:50.715803+0000","last_unstale":"2024-08-17T02:47:50.716121+0000","last_undegraded":"2024-08-17T02:47:50.716121+0000","last_fullsized":"2024-08-17T02:47:50.716121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:56.659610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.710946+0000","last_change":"2024-08-17T02:47:49.702009+0000","last_active":"2024-08-17T02:47:50.710946+0000","last_peered":"2024-08-17T02:47:50.710946+0000","last_clean":"2024-08-17T02:47:50.710946+0000","last_became_active":"2024-08-17T02:47:49.701705+0000","last_became_peered":"2024-08-17T02:47:49.701705+0000","last_unstale":"2024-08-17T02:47:50.710946+0000","last_undegraded":"2024-08-17T02:47:50.710946+0000","last_fullsized":"2024-08-17T02:47:50.710946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:47:22.434937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.704139+0000","last_change":"2024-08-17T02:47:50.704139+0000","last_active":"2024-08-17T02:47:50.704139+0000","last_peered":"2024-08-17T02:47:50.704139+0000","last_clean":"2024-08-17T02:47:50.704139+0000","last_became_active":"2024-08-17T02:47:50.703094+0000","last_became_peered":"2024-08-17T02:47:50.703094+0000","last_unstale":"2024-08-17T02:47:50.704139+0000","last_undegraded":"2024-08-17T02:47:50.704139+0000","last_fullsized":"2024-08-17T02:47:50.704139+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:51:33.320139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.702771+0000","last_change":"2024-08-17T02:47:49.696165+0000","last_active":"2024-08-17T02:47:49.702771+0000","last_peered":"2024-08-17T02:47:49.702771+0000","last_clean":"2024-08-17T02:47:49.702771+0000","last_became_active":"2024-08-17T02:47:49.695678+0000","last_became_peered":"2024-08-17T02:47:49.695678+0000","last_unstale":"2024-08-17T02:47:49.702771+0000","last_undegraded":"2024-08-17T02:47:49.702771+0000","last_fullsized":"2024-08-17T02:47:49.702771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:26.659030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.716341+0000","last_change":"2024-08-17T02:47:50.716341+0000","last_active":"2024-08-17T02:47:50.716341+0000","last_peered":"2024-08-17T02:47:50.716341+0000","last_clean":"2024-08-17T02:47:50.716341+0000","last_became_active":"2024-08-17T02:47:50.716067+0000","last_became_peered":"2024-08-17T02:47:50.716067+0000","last_unstale":"2024-08-17T02:47:50.716341+0000","last_undegraded":"2024-08-17T02:47:50.716341+0000","last_fullsized":"2024-08-17T02:47:50.716341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:02.038974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.710664+0000","last_change":"2024-08-17T02:47:49.710011+0000","last_active":"2024-08-17T02:47:49.710664+0000","last_peered":"2024-08-17T02:47:49.710664+0000","last_clean":"2024-08-17T02:47:49.710664+0000","last_became_active":"2024-08-17T02:47:49.709783+0000","last_became_peered":"2024-08-17T02:47:49.709783+0000","last_unstale":"2024-08-17T02:47:49.710664+0000","last_undegraded":"2024-08-17T02:47:49.710664+0000","last_fullsized":"2024-08-17T02:47:49.710664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:14.343843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.704524+0000","last_change":"2024-08-17T02:47:50.704524+0000","last_active":"2024-08-17T02:47:50.704524+0000","last_peered":"2024-08-17T02:47:50.704524+0000","last_clean":"2024-08-17T02:47:50.704524+0000","last_became_active":"2024-08-17T02:47:50.704131+0000","last_became_peered":"2024-08-17T02:47:50.704131+0000","last_unstale":"2024-08-17T02:47:50.704524+0000","last_undegraded":"2024-08-17T02:47:50.704524+0000","last_fullsized":"2024-08-17T02:47:50.704524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:10:31.116343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.718458+0000","last_change":"2024-08-17T02:47:49.706079+0000","last_active":"2024-08-17T02:47:50.718458+0000","last_peered":"2024-08-17T02:47:50.718458+0000","last_clean":"2024-08-17T02:47:50.718458+0000","last_became_active":"2024-08-17T02:47:49.704185+0000","last_became_peered":"2024-08-17T02:47:49.704185+0000","last_unstale":"2024-08-17T02:47:50.718458+0000","last_undegraded":"2024-08-17T02:47:50.718458+0000","last_fullsized":"2024-08-17T02:47:50.718458+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:00.156010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.710985+0000","last_change":"2024-08-17T02:47:50.710985+0000","last_active":"2024-08-17T02:47:50.710985+0000","last_peered":"2024-08-17T02:47:50.710985+0000","last_clean":"2024-08-17T02:47:50.710985+0000","last_became_active":"2024-08-17T02:47:50.710709+0000","last_became_peered":"2024-08-17T02:47:50.710709+0000","last_unstale":"2024-08-17T02:47:50.710985+0000","last_undegraded":"2024-08-17T02:47:50.710985+0000","last_fullsized":"2024-08-17T02:47:50.710985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:10:31.116343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.700241+0000","last_change":"2024-08-17T02:47:49.704746+0000","last_active":"2024-08-17T02:47:50.700241+0000","last_peered":"2024-08-17T02:47:50.700241+0000","last_clean":"2024-08-17T02:47:50.700241+0000","last_became_active":"2024-08-17T02:47:49.704386+0000","last_became_peered":"2024-08-17T02:47:49.704386+0000","last_unstale":"2024-08-17T02:47:50.700241+0000","last_undegraded":"2024-08-17T02:47:50.700241+0000","last_fullsized":"2024-08-17T02:47:50.700241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:00.156010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.713313+0000","last_change":"2024-08-17T02:47:50.713313+0000","last_active":"2024-08-17T02:47:50.713313+0000","last_peered":"2024-08-17T02:47:50.713313+0000","last_clean":"2024-08-17T02:47:50.713313+0000","last_became_active":"2024-08-17T02:47:50.713019+0000","last_became_peered":"2024-08-17T02:47:50.713019+0000","last_unstale":"2024-08-17T02:47:50.713313+0000","last_undegraded":"2024-08-17T02:47:50.713313+0000","last_fullsized":"2024-08-17T02:47:50.713313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:40.279894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.711122+0000","last_change":"2024-08-17T02:47:49.701083+0000","last_active":"2024-08-17T02:47:50.711122+0000","last_peered":"2024-08-17T02:47:50.711122+0000","last_clean":"2024-08-17T02:47:50.711122+0000","last_became_active":"2024-08-17T02:47:49.700133+0000","last_became_peered":"2024-08-17T02:47:49.700133+0000","last_unstale":"2024-08-17T02:47:50.711122+0000","last_undegraded":"2024-08-17T02:47:50.711122+0000","last_fullsized":"2024-08-17T02:47:50.711122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:37.523894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.720335+0000","last_change":"2024-08-17T02:47:50.720335+0000","last_active":"2024-08-17T02:47:50.720335+0000","last_peered":"2024-08-17T02:47:50.720335+0000","last_clean":"2024-08-17T02:47:50.720335+0000","last_became_active":"2024-08-17T02:47:50.719911+0000","last_became_peered":"2024-08-17T02:47:50.719911+0000","last_unstale":"2024-08-17T02:47:50.720335+0000","last_undegraded":"2024-08-17T02:47:50.720335+0000","last_fullsized":"2024-08-17T02:47:50.720335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:02.281483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.701016+0000","last_change":"2024-08-17T02:47:49.702451+0000","last_active":"2024-08-17T02:47:50.701016+0000","last_peered":"2024-08-17T02:47:50.701016+0000","last_clean":"2024-08-17T02:47:50.701016+0000","last_became_active":"2024-08-17T02:47:49.702227+0000","last_became_peered":"2024-08-17T02:47:49.702227+0000","last_unstale":"2024-08-17T02:47:50.701016+0000","last_undegraded":"2024-08-17T02:47:50.701016+0000","last_fullsized":"2024-08-17T02:47:50.701016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:52:05.470998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.708546+0000","last_change":"2024-08-17T02:47:50.708546+0000","last_active":"2024-08-17T02:47:50.708546+0000","last_peered":"2024-08-17T02:47:50.708546+0000","last_clean":"2024-08-17T02:47:50.708546+0000","last_became_active":"2024-08-17T02:47:50.708286+0000","last_became_peered":"2024-08-17T02:47:50.708286+0000","last_unstale":"2024-08-17T02:47:50.708546+0000","last_undegraded":"2024-08-17T02:47:50.708546+0000","last_fullsized":"2024-08-17T02:47:50.708546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.048586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.709772+0000","last_change":"2024-08-17T02:47:49.705710+0000","last_active":"2024-08-17T02:47:49.709772+0000","last_peered":"2024-08-17T02:47:49.709772+0000","last_clean":"2024-08-17T02:47:49.709772+0000","last_became_active":"2024-08-17T02:47:49.705027+0000","last_became_peered":"2024-08-17T02:47:49.705027+0000","last_unstale":"2024-08-17T02:47:49.709772+0000","last_undegraded":"2024-08-17T02:47:49.709772+0000","last_fullsized":"2024-08-17T02:47:49.709772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:17:28.550436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.711134+0000","last_change":"2024-08-17T02:47:50.711134+0000","last_active":"2024-08-17T02:47:50.711134+0000","last_peered":"2024-08-17T02:47:50.711134+0000","last_clean":"2024-08-17T02:47:50.711134+0000","last_became_active":"2024-08-17T02:47:50.710793+0000","last_became_peered":"2024-08-17T02:47:50.710793+0000","last_unstale":"2024-08-17T02:47:50.711134+0000","last_undegraded":"2024-08-17T02:47:50.711134+0000","last_fullsized":"2024-08-17T02:47:50.711134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:04.457635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.715803+0000","last_change":"2024-08-17T02:47:49.694775+0000","last_active":"2024-08-17T02:47:50.715803+0000","last_peered":"2024-08-17T02:47:50.715803+0000","last_clean":"2024-08-17T02:47:50.715803+0000","last_became_active":"2024-08-17T02:47:49.694512+0000","last_became_peered":"2024-08-17T02:47:49.694512+0000","last_unstale":"2024-08-17T02:47:50.715803+0000","last_undegraded":"2024-08-17T02:47:50.715803+0000","last_fullsized":"2024-08-17T02:47:50.715803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:34:03.272796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.698651+0000","last_change":"2024-08-17T02:47:50.698651+0000","last_active":"2024-08-17T02:47:50.698651+0000","last_peered":"2024-08-17T02:47:50.698651+0000","last_clean":"2024-08-17T02:47:50.698651+0000","last_became_active":"2024-08-17T02:47:50.698410+0000","last_became_peered":"2024-08-17T02:47:50.698410+0000","last_unstale":"2024-08-17T02:47:50.698651+0000","last_undegraded":"2024-08-17T02:47:50.698651+0000","last_fullsized":"2024-08-17T02:47:50.698651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:46.389493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.701130+0000","last_change":"2024-08-17T02:47:49.695055+0000","last_active":"2024-08-17T02:47:49.701130+0000","last_peered":"2024-08-17T02:47:49.701130+0000","last_clean":"2024-08-17T02:47:49.701130+0000","last_became_active":"2024-08-17T02:47:49.694744+0000","last_became_peered":"2024-08-17T02:47:49.694744+0000","last_unstale":"2024-08-17T02:47:49.701130+0000","last_undegraded":"2024-08-17T02:47:49.701130+0000","last_fullsized":"2024-08-17T02:47:49.701130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:26.659030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.698085+0000","last_change":"2024-08-17T02:47:50.698085+0000","last_active":"2024-08-17T02:47:50.698085+0000","last_peered":"2024-08-17T02:47:50.698085+0000","last_clean":"2024-08-17T02:47:50.698085+0000","last_became_active":"2024-08-17T02:47:50.697802+0000","last_became_peered":"2024-08-17T02:47:50.697802+0000","last_unstale":"2024-08-17T02:47:50.698085+0000","last_undegraded":"2024-08-17T02:47:50.698085+0000","last_fullsized":"2024-08-17T02:47:50.698085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:27.665376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.703373+0000","last_change":"2024-08-17T02:47:49.699928+0000","last_active":"2024-08-17T02:47:49.703373+0000","last_peered":"2024-08-17T02:47:49.703373+0000","last_clean":"2024-08-17T02:47:49.703373+0000","last_became_active":"2024-08-17T02:47:49.696617+0000","last_became_peered":"2024-08-17T02:47:49.696617+0000","last_unstale":"2024-08-17T02:47:49.703373+0000","last_undegraded":"2024-08-17T02:47:49.703373+0000","last_fullsized":"2024-08-17T02:47:49.703373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:03.451290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.707421+0000","last_change":"2024-08-17T02:47:50.707421+0000","last_active":"2024-08-17T02:47:50.707421+0000","last_peered":"2024-08-17T02:47:50.707421+0000","last_clean":"2024-08-17T02:47:50.707421+0000","last_became_active":"2024-08-17T02:47:50.707048+0000","last_became_peered":"2024-08-17T02:47:50.707048+0000","last_unstale":"2024-08-17T02:47:50.707421+0000","last_undegraded":"2024-08-17T02:47:50.707421+0000","last_fullsized":"2024-08-17T02:47:50.707421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:52:56.309723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.707341+0000","last_change":"2024-08-17T02:47:49.706097+0000","last_active":"2024-08-17T02:47:49.707341+0000","last_peered":"2024-08-17T02:47:49.707341+0000","last_clean":"2024-08-17T02:47:49.707341+0000","last_became_active":"2024-08-17T02:47:49.705890+0000","last_became_peered":"2024-08-17T02:47:49.705890+0000","last_unstale":"2024-08-17T02:47:49.707341+0000","last_undegraded":"2024-08-17T02:47:49.707341+0000","last_fullsized":"2024-08-17T02:47:49.707341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:45.383147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.701419+0000","last_change":"2024-08-17T02:47:50.701419+0000","last_active":"2024-08-17T02:47:50.701419+0000","last_peered":"2024-08-17T02:47:50.701419+0000","last_clean":"2024-08-17T02:47:50.701419+0000","last_became_active":"2024-08-17T02:47:50.700588+0000","last_became_peered":"2024-08-17T02:47:50.700588+0000","last_unstale":"2024-08-17T02:47:50.701419+0000","last_undegraded":"2024-08-17T02:47:50.701419+0000","last_fullsized":"2024-08-17T02:47:50.701419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:34:04.279141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.723595+0000","last_change":"2024-08-17T02:47:49.698982+0000","last_active":"2024-08-17T02:47:50.723595+0000","last_peered":"2024-08-17T02:47:50.723595+0000","last_clean":"2024-08-17T02:47:50.723595+0000","last_became_active":"2024-08-17T02:47:49.698692+0000","last_became_peered":"2024-08-17T02:47:49.698692+0000","last_unstale":"2024-08-17T02:47:50.723595+0000","last_undegraded":"2024-08-17T02:47:50.723595+0000","last_fullsized":"2024-08-17T02:47:50.723595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:37.523894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.717502+0000","last_change":"2024-08-17T02:47:50.717502+0000","last_active":"2024-08-17T02:47:50.717502+0000","last_peered":"2024-08-17T02:47:50.717502+0000","last_clean":"2024-08-17T02:47:50.717502+0000","last_became_active":"2024-08-17T02:47:50.716644+0000","last_became_peered":"2024-08-17T02:47:50.716644+0000","last_unstale":"2024-08-17T02:47:50.717502+0000","last_undegraded":"2024-08-17T02:47:50.717502+0000","last_fullsized":"2024-08-17T02:47:50.717502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:58.825259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.703567+0000","last_change":"2024-08-17T02:47:49.699795+0000","last_active":"2024-08-17T02:47:49.703567+0000","last_peered":"2024-08-17T02:47:49.703567+0000","last_clean":"2024-08-17T02:47:49.703567+0000","last_became_active":"2024-08-17T02:47:49.699527+0000","last_became_peered":"2024-08-17T02:47:49.699527+0000","last_unstale":"2024-08-17T02:47:49.703567+0000","last_undegraded":"2024-08-17T02:47:49.703567+0000","last_fullsized":"2024-08-17T02:47:49.703567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:54.538074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.722980+0000","last_change":"2024-08-17T02:47:50.722980+0000","last_active":"2024-08-17T02:47:50.722980+0000","last_peered":"2024-08-17T02:47:50.722980+0000","last_clean":"2024-08-17T02:47:50.722980+0000","last_became_active":"2024-08-17T02:47:50.722693+0000","last_became_peered":"2024-08-17T02:47:50.722693+0000","last_unstale":"2024-08-17T02:47:50.722980+0000","last_undegraded":"2024-08-17T02:47:50.722980+0000","last_fullsized":"2024-08-17T02:47:50.722980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:48.951074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.702987+0000","last_change":"2024-08-17T02:47:49.698803+0000","last_active":"2024-08-17T02:47:49.702987+0000","last_peered":"2024-08-17T02:47:49.702987+0000","last_clean":"2024-08-17T02:47:49.702987+0000","last_became_active":"2024-08-17T02:47:49.698543+0000","last_became_peered":"2024-08-17T02:47:49.698543+0000","last_unstale":"2024-08-17T02:47:49.702987+0000","last_undegraded":"2024-08-17T02:47:49.702987+0000","last_fullsized":"2024-08-17T02:47:49.702987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:03.451290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.694757+0000","last_change":"2024-08-17T02:47:50.694757+0000","last_active":"2024-08-17T02:47:50.694757+0000","last_peered":"2024-08-17T02:47:50.694757+0000","last_clean":"2024-08-17T02:47:50.694757+0000","last_became_active":"2024-08-17T02:47:50.694486+0000","last_became_peered":"2024-08-17T02:47:50.694486+0000","last_unstale":"2024-08-17T02:47:50.694757+0000","last_undegraded":"2024-08-17T02:47:50.694757+0000","last_fullsized":"2024-08-17T02:47:50.694757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:06:32.357049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.703689+0000","last_change":"2024-08-17T02:47:49.701139+0000","last_active":"2024-08-17T02:47:49.703689+0000","last_peered":"2024-08-17T02:47:49.703689+0000","last_clean":"2024-08-17T02:47:49.703689+0000","last_became_active":"2024-08-17T02:47:49.700837+0000","last_became_peered":"2024-08-17T02:47:49.700837+0000","last_unstale":"2024-08-17T02:47:49.703689+0000","last_undegraded":"2024-08-17T02:47:49.703689+0000","last_fullsized":"2024-08-17T02:47:49.703689+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:26.659030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.704434+0000","last_change":"2024-08-17T02:47:50.704434+0000","last_active":"2024-08-17T02:47:50.704434+0000","last_peered":"2024-08-17T02:47:50.704434+0000","last_clean":"2024-08-17T02:47:50.704434+0000","last_became_active":"2024-08-17T02:47:50.704198+0000","last_became_peered":"2024-08-17T02:47:50.704198+0000","last_unstale":"2024-08-17T02:47:50.704434+0000","last_undegraded":"2024-08-17T02:47:50.704434+0000","last_fullsized":"2024-08-17T02:47:50.704434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:10:31.116343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.702793+0000","last_change":"2024-08-17T02:47:49.697348+0000","last_active":"2024-08-17T02:47:49.702793+0000","last_peered":"2024-08-17T02:47:49.702793+0000","last_clean":"2024-08-17T02:47:49.702793+0000","last_became_active":"2024-08-17T02:47:49.697004+0000","last_became_peered":"2024-08-17T02:47:49.697004+0000","last_unstale":"2024-08-17T02:47:49.702793+0000","last_undegraded":"2024-08-17T02:47:49.702793+0000","last_fullsized":"2024-08-17T02:47:49.702793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:21.042241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.718314+0000","last_change":"2024-08-17T02:47:50.718314+0000","last_active":"2024-08-17T02:47:50.718314+0000","last_peered":"2024-08-17T02:47:50.718314+0000","last_clean":"2024-08-17T02:47:50.718314+0000","last_became_active":"2024-08-17T02:47:50.718010+0000","last_became_peered":"2024-08-17T02:47:50.718010+0000","last_unstale":"2024-08-17T02:47:50.718314+0000","last_undegraded":"2024-08-17T02:47:50.718314+0000","last_fullsized":"2024-08-17T02:47:50.718314+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:17.624303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.712574+0000","last_change":"2024-08-17T02:47:49.706835+0000","last_active":"2024-08-17T02:47:49.712574+0000","last_peered":"2024-08-17T02:47:49.712574+0000","last_clean":"2024-08-17T02:47:49.712574+0000","last_became_active":"2024-08-17T02:47:49.706529+0000","last_became_peered":"2024-08-17T02:47:49.706529+0000","last_unstale":"2024-08-17T02:47:49.712574+0000","last_undegraded":"2024-08-17T02:47:49.712574+0000","last_fullsized":"2024-08-17T02:47:49.712574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:01.027704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.714404+0000","last_change":"2024-08-17T02:47:50.714404+0000","last_active":"2024-08-17T02:47:50.714404+0000","last_peered":"2024-08-17T02:47:50.714404+0000","last_clean":"2024-08-17T02:47:50.714404+0000","last_became_active":"2024-08-17T02:47:50.713564+0000","last_became_peered":"2024-08-17T02:47:50.713564+0000","last_unstale":"2024-08-17T02:47:50.714404+0000","last_undegraded":"2024-08-17T02:47:50.714404+0000","last_fullsized":"2024-08-17T02:47:50.714404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:58.825259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.708966+0000","last_change":"2024-08-17T02:47:49.708023+0000","last_active":"2024-08-17T02:47:49.708966+0000","last_peered":"2024-08-17T02:47:49.708966+0000","last_clean":"2024-08-17T02:47:49.708966+0000","last_became_active":"2024-08-17T02:47:49.707785+0000","last_became_peered":"2024-08-17T02:47:49.707785+0000","last_unstale":"2024-08-17T02:47:49.708966+0000","last_undegraded":"2024-08-17T02:47:49.708966+0000","last_fullsized":"2024-08-17T02:47:49.708966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:14.739902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:50.698931+0000","last_change":"2024-08-17T02:47:50.698931+0000","last_active":"2024-08-17T02:47:50.698931+0000","last_peered":"2024-08-17T02:47:50.698931+0000","last_clean":"2024-08-17T02:47:50.698931+0000","last_became_active":"2024-08-17T02:47:50.698638+0000","last_became_peered":"2024-08-17T02:47:50.698638+0000","last_unstale":"2024-08-17T02:47:50.698931+0000","last_undegraded":"2024-08-17T02:47:50.698931+0000","last_fullsized":"2024-08-17T02:47:50.698931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:49.671848+0000","last_clean_scrub_stamp":"2024-08-17T02:47:49.671848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:08:23.844672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.704644+0000","last_change":"2024-08-17T02:47:49.702297+0000","last_active":"2024-08-17T02:47:49.704644+0000","last_peered":"2024-08-17T02:47:49.704644+0000","last_clean":"2024-08-17T02:47:49.704644+0000","last_became_active":"2024-08-17T02:47:49.702074+0000","last_became_peered":"2024-08-17T02:47:49.702074+0000","last_unstale":"2024-08-17T02:47:49.704644+0000","last_undegraded":"2024-08-17T02:47:49.704644+0000","last_fullsized":"2024-08-17T02:47:49.704644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:48.665503+0000","last_clean_scrub_stamp":"2024-08-17T02:47:48.665503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:45.383147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:47:49.703402+0000","last_change":"2024-08-17T02:46:48.424689+0000","last_active":"2024-08-17T02:47:49.703402+0000","last_peered":"2024-08-17T02:47:49.703402+0000","last_clean":"2024-08-17T02:47:49.703402+0000","last_became_active":"2024-08-17T02:46:48.423437+0000","last_became_peered":"2024-08-17T02:46:48.423437+0000","last_unstale":"2024-08-17T02:47:49.703402+0000","last_undegraded":"2024-08-17T02:47:49.703402+0000","last_fullsized":"2024-08-17T02:47:49.703402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.106569+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:50.533980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298276,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073564,"statfs":{"total":96636764160,"available":96331329536,"internally_reserved":0,"allocated":946176,"data_stored":724337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.77300000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.80600000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.65500000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.56799999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.626}]},{"osd":6,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":335872,"data_stored":127116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.621},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.81399999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.65700000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.68000000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.83899999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.92000000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.85699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":356352,"data_stored":134539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.62}]},{"osd":1,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.78500000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.70899999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.63100000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.73999999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.75700000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.69699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":335872,"data_stored":127116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.78200000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.54500000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.627},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.82099999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.69499999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301840,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070000,"statfs":{"total":96636764160,"available":96327680000,"internally_reserved":0,"allocated":335872,"data_stored":127116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:49 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.31},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.27000000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:47:49 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38300000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:47:49 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.47499999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:47:49 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.78100000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:47:49 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:47:49 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:47:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.81200000000000006}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301844,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069996,"statfs":{"total":96636764160,"available":96327675904,"internally_reserved":0,"allocated":335872,"data_stored":127116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.40200000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.55100000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.94799999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.86899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.93700000000000006}]},{"osd":7,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.91800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301844,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069996,"statfs":{"total":96636764160,"available":96327675904,"internally_reserved":0,"allocated":335872,"data_stored":127116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.41699999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":2.9769999999999999,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.376}]},{"osd":3,"last update":"Sat Aug 17 02:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.39100000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.3279999999999998,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.89500000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.72899999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.3820000000000001,"5min":3.3820000000000001,"15min":3.3820000000000001},"last":0.79900000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:47:50 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.5459999999999998,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":0.73599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302428,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069412,"statfs":{"total":96636764160,"available":96327077888,"internally_reserved":0,"allocated":929792,"data_stored":717484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.442}]},{"osd":2,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.38800000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.52900000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.85199999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.68400000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.79700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:47:55.308 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:47:55.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:47:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.499+0000 7f028d800640 1 Processor -- start 2024-08-17T02:47:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.499+0000 7f028d800640 1 -- start start 2024-08-17T02:47:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.500+0000 7f028d800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f02880add30 0x7f0288156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.500+0000 7f028d800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02880cb160 con 0x7f02880ad960 2024-08-17T02:47:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.500+0000 7f028d800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02880b0d10 con 0x7f02880ca050 2024-08-17T02:47:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.500+0000 7f028d800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02880ca550 con 0x7f02880add30 2024-08-17T02:47:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.500+0000 7f0286a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f02880ad960 0x7f0288156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58950/0 (socket says 172.21.15.5:58950) 2024-08-17T02:47:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.500+0000 7f0286a00640 1 -- 172.21.15.5:0/1183009658 learned_addr learned my addr 172.21.15.5:0/1183009658 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.500+0000 7f0287400640 1 --2- 172.21.15.5:0/1183009658 >> v2:172.21.15.107:3300/0 conn(0x7f02880add30 0x7f0288156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.501+0000 7f0286000640 1 -- 172.21.15.5:0/1183009658 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 934979195 0 0) 0x7f02880cb160 con 0x7f02880ad960 2024-08-17T02:47:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.501+0000 7f0286000640 1 -- 172.21.15.5:0/1183009658 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f026c0034e0 con 0x7f02880ad960 2024-08-17T02:47:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.501+0000 7f0287400640 1 -- 172.21.15.5:0/1183009658 >> v1:172.21.15.107:6789/0 conn(0x7f02880ca050 legacy=0x7f02880aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.501+0000 7f0286000640 1 -- 172.21.15.5:0/1183009658 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636378565 0 0) 0x7f02880b0d10 con 0x7f02880ca050 2024-08-17T02:47:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.501+0000 7f0287400640 1 -- 172.21.15.5:0/1183009658 >> v1:172.21.15.5:6789/0 conn(0x7f02880ad960 legacy=0x7f0288156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.501+0000 7f0287400640 1 -- 172.21.15.5:0/1183009658 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02880ca830 con 0x7f02880add30 2024-08-17T02:47:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.502+0000 7f0287400640 1 --2- 172.21.15.5:0/1183009658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02880add30 0x7f0288156b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0280009e60 tx=0x7f0280009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=438ecce09a1f664a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.502+0000 7f0286000640 1 -- 172.21.15.5:0/1183009658 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0280030550 con 0x7f02880add30 2024-08-17T02:47:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.502+0000 7f0286000640 1 -- 172.21.15.5:0/1183009658 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02800306b0 con 0x7f02880add30 2024-08-17T02:47:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.502+0000 7f0286000640 1 -- 172.21.15.5:0/1183009658 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0280030a50 con 0x7f02880add30 2024-08-17T02:47:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.503+0000 7f028d800640 1 -- 172.21.15.5:0/1183009658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02880add30 msgr2=0x7f0288156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.503+0000 7f028d800640 1 --2- 172.21.15.5:0/1183009658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02880add30 0x7f0288156b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0280009e60 tx=0x7f0280009780 comp rx=0 tx=0).stop 2024-08-17T02:47:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.503+0000 7f028d800640 1 -- 172.21.15.5:0/1183009658 shutdown_connections 2024-08-17T02:47:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.503+0000 7f028d800640 1 --2- 172.21.15.5:0/1183009658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02880add30 0x7f0288156b30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.503+0000 7f028d800640 1 -- 172.21.15.5:0/1183009658 >> 172.21.15.5:0/1183009658 conn(0x7f0288066e60 msgr2=0x7f0288067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:55.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.503+0000 7f028d800640 1 -- 172.21.15.5:0/1183009658 shutdown_connections 2024-08-17T02:47:55.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.503+0000 7f028d800640 1 -- 172.21.15.5:0/1183009658 wait complete. 2024-08-17T02:47:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.504+0000 7f028d800640 1 Processor -- start 2024-08-17T02:47:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.504+0000 7f028d800640 1 -- start start 2024-08-17T02:47:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.505+0000 7f028d800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02880ad960 0x7f0288144420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.505+0000 7f028d800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02880add30 0x7f0288158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.505+0000 7f028d800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02880ca050 0x7f0288151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.505+0000 7f028d800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0288144960 con 0x7f02880add30 2024-08-17T02:47:55.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.505+0000 7f028d800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02881576d0 con 0x7f02880ad960 2024-08-17T02:47:55.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.505+0000 7f028d800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02881579b0 con 0x7f02880ca050 2024-08-17T02:47:55.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.505+0000 7f027fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02880add30 0x7f0288158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:55.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.506+0000 7f027fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02880add30 0x7f0288158770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47798/0 (socket says 172.21.15.5:47798) 2024-08-17T02:47:55.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.506+0000 7f027fe00640 1 -- 172.21.15.5:0/3132848446 learned_addr learned my addr 172.21.15.5:0/3132848446 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:55.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.506+0000 7f0286a00640 1 --2- 172.21.15.5:0/3132848446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02880ad960 0x7f0288144420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:55.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.506+0000 7f0287400640 1 --2- 172.21.15.5:0/3132848446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02880ca050 0x7f0288151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:55.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.506+0000 7f027fe00640 1 -- 172.21.15.5:0/3132848446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02880ca050 msgr2=0x7f0288151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.506+0000 7f027fe00640 1 --2- 172.21.15.5:0/3132848446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02880ca050 0x7f0288151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.506+0000 7f027fe00640 1 -- 172.21.15.5:0/3132848446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02880ad960 msgr2=0x7f0288144420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.506+0000 7f027fe00640 1 --2- 172.21.15.5:0/3132848446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02880ad960 0x7f0288144420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.506+0000 7f027fe00640 1 -- 172.21.15.5:0/3132848446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0280009a20 con 0x7f02880add30 2024-08-17T02:47:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.506+0000 7f027fe00640 1 --2- 172.21.15.5:0/3132848446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02880add30 0x7f0288158770 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f027000c4e0 tx=0x7f0270007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.506+0000 7f027e000640 1 -- 172.21.15.5:0/3132848446 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270011590 con 0x7f02880add30 2024-08-17T02:47:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.507+0000 7f027e000640 1 -- 172.21.15.5:0/3132848446 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02700116f0 con 0x7f02880add30 2024-08-17T02:47:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.507+0000 7f027e000640 1 -- 172.21.15.5:0/3132848446 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270011ab0 con 0x7f02880add30 2024-08-17T02:47:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.507+0000 7f028d800640 1 -- 172.21.15.5:0/3132848446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0288157c90 con 0x7f02880add30 2024-08-17T02:47:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.507+0000 7f028d800640 1 -- 172.21.15.5:0/3132848446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0288158250 con 0x7f02880add30 2024-08-17T02:47:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.508+0000 7f028d800640 1 -- 172.21.15.5:0/3132848446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02881584a0 con 0x7f02880add30 2024-08-17T02:47:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.508+0000 7f027e000640 1 -- 172.21.15.5:0/3132848446 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f027001b3b0 con 0x7f02880add30 2024-08-17T02:47:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.509+0000 7f027e000640 1 --2- 172.21.15.5:0/3132848446 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0264065150 0x7f0264067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.509+0000 7f027e000640 1 -- 172.21.15.5:0/3132848446 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0270081980 con 0x7f02880add30 2024-08-17T02:47:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.510+0000 7f0286a00640 1 --2- 172.21.15.5:0/3132848446 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0264065150 0x7f0264067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.510+0000 7f0286a00640 1 --2- 172.21.15.5:0/3132848446 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0264065150 0x7f0264067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0288159020 tx=0x7f0278009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.513+0000 7f027e000640 1 -- 172.21.15.5:0/3132848446 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f027004fa40 con 0x7f02880add30 2024-08-17T02:47:55.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.763+0000 7f028d800640 1 -- 172.21.15.5:0/3132848446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0288063fb0 con 0x7f02880add30 2024-08-17T02:47:55.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.767+0000 7f027e000640 1 -- 172.21.15.5:0/3132848446 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f0270017070 con 0x7f02880add30 2024-08-17T02:47:55.767 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-08-17T02:47:55.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.769+0000 7f028d800640 1 -- 172.21.15.5:0/3132848446 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0264065150 msgr2=0x7f0264067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.769+0000 7f028d800640 1 --2- 172.21.15.5:0/3132848446 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0264065150 0x7f0264067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0288159020 tx=0x7f0278009040 comp rx=0 tx=0).stop 2024-08-17T02:47:55.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.769+0000 7f028d800640 1 -- 172.21.15.5:0/3132848446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02880add30 msgr2=0x7f0288158770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.769+0000 7f028d800640 1 --2- 172.21.15.5:0/3132848446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02880add30 0x7f0288158770 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f027000c4e0 tx=0x7f0270007ef0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.769+0000 7f028d800640 1 -- 172.21.15.5:0/3132848446 shutdown_connections 2024-08-17T02:47:55.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.769+0000 7f028d800640 1 --2- 172.21.15.5:0/3132848446 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0264065150 0x7f0264067600 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.769+0000 7f028d800640 1 --2- 172.21.15.5:0/3132848446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f02880ca050 0x7f0288151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.769+0000 7f028d800640 1 --2- 172.21.15.5:0/3132848446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02880add30 0x7f0288158770 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.769+0000 7f028d800640 1 --2- 172.21.15.5:0/3132848446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02880ad960 0x7f0288144420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.769+0000 7f028d800640 1 -- 172.21.15.5:0/3132848446 >> 172.21.15.5:0/3132848446 conn(0x7f0288066e60 msgr2=0x7f0288152700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:55.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.769+0000 7f028d800640 1 -- 172.21.15.5:0/3132848446 shutdown_connections 2024-08-17T02:47:55.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.770+0000 7f028d800640 1 -- 172.21.15.5:0/3132848446 wait complete. 2024-08-17T02:47:55.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:55.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.936+0000 7fe4e7e00640 1 Processor -- start 2024-08-17T02:47:55.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.936+0000 7fe4e7e00640 1 -- start start 2024-08-17T02:47:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.937+0000 7fe4e7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4e80cd550 0x7fe4e815ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.937+0000 7fe4e7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe4e8159cd0 0x7fe4e815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.937+0000 7fe4e7e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e815c9d0 con 0x7fe4e8069840 2024-08-17T02:47:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.937+0000 7fe4e7e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e815a200 con 0x7fe4e8159cd0 2024-08-17T02:47:55.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.937+0000 7fe4e7e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e80cbfe0 con 0x7fe4e80cd550 2024-08-17T02:47:55.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.937+0000 7fe4e6a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe4e8069840 0x7fe4e80cb8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46562/0 (socket says 172.21.15.5:46562) 2024-08-17T02:47:55.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.937+0000 7fe4e6a00640 1 -- 172.21.15.5:0/888674547 learned_addr learned my addr 172.21.15.5:0/888674547 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:55.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.937+0000 7fe4e7400640 1 --2- 172.21.15.5:0/888674547 >> v2:172.21.15.5:3300/0 conn(0x7fe4e8159cd0 0x7fe4e815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.938+0000 7fe4de000640 1 --2- 172.21.15.5:0/888674547 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4e80cd550 0x7fe4e815ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.938+0000 7fe4e7400640 1 -- 172.21.15.5:0/888674547 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4e80cd550 msgr2=0x7fe4e815ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.938+0000 7fe4e7400640 1 --2- 172.21.15.5:0/888674547 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4e80cd550 0x7fe4e815ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.938+0000 7fe4e7400640 1 -- 172.21.15.5:0/888674547 >> v1:172.21.15.5:6789/0 conn(0x7fe4e8069840 legacy=0x7fe4e80cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.938+0000 7fe4e6000640 1 -- 172.21.15.5:0/888674547 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614908941 0 0) 0x7fe4e815c9d0 con 0x7fe4e8069840 2024-08-17T02:47:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.938+0000 7fe4e7400640 1 -- 172.21.15.5:0/888674547 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e80b0830 con 0x7fe4e8159cd0 2024-08-17T02:47:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.939+0000 7fe4e7400640 1 --2- 172.21.15.5:0/888674547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4e8159cd0 0x7fe4e815d3a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009e60 tx=0x7fe4e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a34423db102f795 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.939+0000 7fe4e6000640 1 -- 172.21.15.5:0/888674547 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0007550 con 0x7fe4e8159cd0 2024-08-17T02:47:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.939+0000 7fe4e6000640 1 -- 172.21.15.5:0/888674547 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e002d050 con 0x7fe4e8159cd0 2024-08-17T02:47:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.939+0000 7fe4e6000640 1 -- 172.21.15.5:0/888674547 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e00078e0 con 0x7fe4e8159cd0 2024-08-17T02:47:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.939+0000 7fe4e7e00640 1 -- 172.21.15.5:0/888674547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4e8159cd0 msgr2=0x7fe4e815d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.939+0000 7fe4e7e00640 1 --2- 172.21.15.5:0/888674547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4e8159cd0 0x7fe4e815d3a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009e60 tx=0x7fe4e0009780 comp rx=0 tx=0).stop 2024-08-17T02:47:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.940+0000 7fe4e7e00640 1 -- 172.21.15.5:0/888674547 shutdown_connections 2024-08-17T02:47:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.940+0000 7fe4e7e00640 1 --2- 172.21.15.5:0/888674547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4e8159cd0 0x7fe4e815d3a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.940+0000 7fe4e7e00640 1 --2- 172.21.15.5:0/888674547 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4e80cd550 0x7fe4e815ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.940+0000 7fe4e7e00640 1 -- 172.21.15.5:0/888674547 >> 172.21.15.5:0/888674547 conn(0x7fe4e8066e60 msgr2=0x7fe4e8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.940+0000 7fe4e7e00640 1 -- 172.21.15.5:0/888674547 shutdown_connections 2024-08-17T02:47:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.940+0000 7fe4e7e00640 1 -- 172.21.15.5:0/888674547 wait complete. 2024-08-17T02:47:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.941+0000 7fe4e7e00640 1 Processor -- start 2024-08-17T02:47:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.941+0000 7fe4e7e00640 1 -- start start 2024-08-17T02:47:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.942+0000 7fe4e7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4e8069840 0x7fe4e80c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.942+0000 7fe4e7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4e8159cd0 0x7fe4e815b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.942+0000 7fe4e7e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4e80c93c0 0x7fe4e815b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.942+0000 7fe4e7e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e80acb80 con 0x7fe4e8159cd0 2024-08-17T02:47:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.942+0000 7fe4e7e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e816cce0 con 0x7fe4e8069840 2024-08-17T02:47:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.942+0000 7fe4e7e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e80ac530 con 0x7fe4e80c93c0 2024-08-17T02:47:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.942+0000 7fe4de000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4e8159cd0 0x7fe4e815b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.942+0000 7fe4de000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4e8159cd0 0x7fe4e815b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42346/0 (socket says 172.21.15.5:42346) 2024-08-17T02:47:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.942+0000 7fe4de000640 1 -- 172.21.15.5:0/1935418690 learned_addr learned my addr 172.21.15.5:0/1935418690 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.943+0000 7fe4de000640 1 -- 172.21.15.5:0/1935418690 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4e80c93c0 msgr2=0x7fe4e815b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.943+0000 7fe4de000640 1 --2- 172.21.15.5:0/1935418690 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4e80c93c0 0x7fe4e815b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.943+0000 7fe4de000640 1 -- 172.21.15.5:0/1935418690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4e8069840 msgr2=0x7fe4e80c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.943+0000 7fe4de000640 1 --2- 172.21.15.5:0/1935418690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4e8069840 0x7fe4e80c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.943+0000 7fe4de000640 1 -- 172.21.15.5:0/1935418690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e0009a20 con 0x7fe4e8159cd0 2024-08-17T02:47:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.943+0000 7fe4de000640 1 --2- 172.21.15.5:0/1935418690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4e8159cd0 0x7fe4e815b3a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000d890 tx=0x7fe4d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.943+0000 7fe4dea00640 1 -- 172.21.15.5:0/1935418690 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d000de20 con 0x7fe4e8159cd0 2024-08-17T02:47:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.943+0000 7fe4dea00640 1 -- 172.21.15.5:0/1935418690 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d000b8d0 con 0x7fe4e8159cd0 2024-08-17T02:47:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.943+0000 7fe4dea00640 1 -- 172.21.15.5:0/1935418690 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d000bc70 con 0x7fe4e8159cd0 2024-08-17T02:47:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.943+0000 7fe4e7e00640 1 -- 172.21.15.5:0/1935418690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e80ac810 con 0x7fe4e8159cd0 2024-08-17T02:47:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.943+0000 7fe4e7e00640 1 -- 172.21.15.5:0/1935418690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e816c280 con 0x7fe4e8159cd0 2024-08-17T02:47:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.944+0000 7fe4e7e00640 1 -- 172.21.15.5:0/1935418690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e80ac390 con 0x7fe4e8159cd0 2024-08-17T02:47:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.945+0000 7fe4dea00640 1 -- 172.21.15.5:0/1935418690 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe4d0014640 con 0x7fe4e8159cd0 2024-08-17T02:47:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.946+0000 7fe4dea00640 1 --2- 172.21.15.5:0/1935418690 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe4c4065150 0x7fe4c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.946+0000 7fe4dea00640 1 -- 172.21.15.5:0/1935418690 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe4d0082b40 con 0x7fe4e8159cd0 2024-08-17T02:47:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.946+0000 7fe4e6a00640 1 --2- 172.21.15.5:0/1935418690 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe4c4065150 0x7fe4c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.947+0000 7fe4e6a00640 1 --2- 172.21.15.5:0/1935418690 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe4c4065150 0x7fe4c4067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80011e0 tx=0x7fe4d8007940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:55.950+0000 7fe4dea00640 1 -- 172.21.15.5:0/1935418690 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe4e80ac390 con 0x7fe4e8159cd0 2024-08-17T02:47:56.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.169+0000 7fe4e7e00640 1 -- 172.21.15.5:0/1935418690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4e80ac390 con 0x7fe4e8159cd0 2024-08-17T02:47:56.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.170+0000 7fe4dea00640 1 -- 172.21.15.5:0/1935418690 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fe4e80ac390 con 0x7fe4e8159cd0 2024-08-17T02:47:56.170 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:47:56.171 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2464391944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2464391944},{"type":"v1","addr":"172.21.15.107:6835","nonce":2464391944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2049823505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2049823505},{"type":"v1","addr":"172.21.15.107:6834","nonce":2049823505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1768626934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1768626934},{"type":"v1","addr":"172.21.15.5:6837","nonce":1768626934}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:50.110026+0000","modified":"2024-08-17T02:47:53.706251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/723455700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":723455700},{"type":"v1","addr":"172.21.15.5:6836","nonce":723455700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:47:56.171 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2024-08-17T02:47:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.172+0000 7fe4e7e00640 1 -- 172.21.15.5:0/1935418690 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe4c4065150 msgr2=0x7fe4c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.172+0000 7fe4e7e00640 1 --2- 172.21.15.5:0/1935418690 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe4c4065150 0x7fe4c4067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80011e0 tx=0x7fe4d8007940 comp rx=0 tx=0).stop 2024-08-17T02:47:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.172+0000 7fe4e7e00640 1 -- 172.21.15.5:0/1935418690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4e8159cd0 msgr2=0x7fe4e815b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.172+0000 7fe4e7e00640 1 --2- 172.21.15.5:0/1935418690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4e8159cd0 0x7fe4e815b3a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000d890 tx=0x7fe4d0008040 comp rx=0 tx=0).stop 2024-08-17T02:47:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.172+0000 7fe4e7e00640 1 -- 172.21.15.5:0/1935418690 shutdown_connections 2024-08-17T02:47:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.172+0000 7fe4e7e00640 1 --2- 172.21.15.5:0/1935418690 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe4c4065150 0x7fe4c4067600 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.172+0000 7fe4e7e00640 1 --2- 172.21.15.5:0/1935418690 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe4e80c93c0 0x7fe4e815b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.172+0000 7fe4e7e00640 1 --2- 172.21.15.5:0/1935418690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4e8159cd0 0x7fe4e815b3a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.172+0000 7fe4e7e00640 1 --2- 172.21.15.5:0/1935418690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4e8069840 0x7fe4e80c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.172+0000 7fe4e7e00640 1 -- 172.21.15.5:0/1935418690 >> 172.21.15.5:0/1935418690 conn(0x7fe4e8066e60 msgr2=0x7fe4e8068120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.172+0000 7fe4e7e00640 1 -- 172.21.15.5:0/1935418690 shutdown_connections 2024-08-17T02:47:56.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.172+0000 7fe4e7e00640 1 -- 172.21.15.5:0/1935418690 wait complete. 2024-08-17T02:47:56.591 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:47:50.110026+0000', 'modified': '2024-08-17T02:47:53.706251+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4917}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4917': {'gid': 4917, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6836/723455700', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 723455700}, {'type': 'v1', 'addr': '172.21.15.5:6836', 'nonce': 723455700}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:47:56.591 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:47:56.591 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-17T02:47:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.745+0000 7fefaf200640 1 Processor -- start 2024-08-17T02:47:56.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.745+0000 7fefaf200640 1 -- start start 2024-08-17T02:47:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.746+0000 7fefaf200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fefa81591e0 0x7fefa8068890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.746+0000 7fefaf200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa8068dd0 0x7fefa80cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.746+0000 7fefaf200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa80c40a0 con 0x7fefa8158e10 2024-08-17T02:47:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.746+0000 7fefaf200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa80694e0 con 0x7fefa81591e0 2024-08-17T02:47:56.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.746+0000 7fefaf200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8069240 con 0x7fefa8068dd0 2024-08-17T02:47:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.747+0000 7fefa7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fefa81591e0 0x7fefa8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.747+0000 7fefa7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fefa81591e0 0x7fefa8068890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42360/0 (socket says 172.21.15.5:42360) 2024-08-17T02:47:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.747+0000 7fefa7400640 1 -- 172.21.15.5:0/4171529307 learned_addr learned my addr 172.21.15.5:0/4171529307 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.747+0000 7fefad200640 1 --2- 172.21.15.5:0/4171529307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa8068dd0 0x7fefa80cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.747+0000 7fefa7400640 1 -- 172.21.15.5:0/4171529307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa8068dd0 msgr2=0x7fefa80cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.747+0000 7fefa7400640 1 --2- 172.21.15.5:0/4171529307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa8068dd0 0x7fefa80cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.747+0000 7fefa7400640 1 -- 172.21.15.5:0/4171529307 >> v1:172.21.15.107:6789/0 conn(0x7fefa8158e10 legacy=0x7fefa8068180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:56.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.747+0000 7fefa7400640 1 -- 172.21.15.5:0/4171529307 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa80c3a50 con 0x7fefa81591e0 2024-08-17T02:47:56.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.748+0000 7fefa7400640 1 --2- 172.21.15.5:0/4171529307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa81591e0 0x7fefa8068890 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fef94009910 tx=0x7fef940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5b296ed88f2c6b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:56.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.748+0000 7fefa6a00640 1 -- 172.21.15.5:0/4171529307 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9402ae40 con 0x7fefa81591e0 2024-08-17T02:47:56.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.748+0000 7fefa6a00640 1 -- 172.21.15.5:0/4171529307 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef94032440 con 0x7fefa81591e0 2024-08-17T02:47:56.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.748+0000 7fefa6a00640 1 -- 172.21.15.5:0/4171529307 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94032820 con 0x7fefa81591e0 2024-08-17T02:47:56.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.749+0000 7fefaf200640 1 -- 172.21.15.5:0/4171529307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa81591e0 msgr2=0x7fefa8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:56.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.749+0000 7fefaf200640 1 --2- 172.21.15.5:0/4171529307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa81591e0 0x7fefa8068890 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fef94009910 tx=0x7fef940091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.749+0000 7fefaf200640 1 -- 172.21.15.5:0/4171529307 shutdown_connections 2024-08-17T02:47:56.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.749+0000 7fefaf200640 1 --2- 172.21.15.5:0/4171529307 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa8068dd0 0x7fefa80cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.749+0000 7fefaf200640 1 --2- 172.21.15.5:0/4171529307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa81591e0 0x7fefa8068890 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.749+0000 7fefaf200640 1 -- 172.21.15.5:0/4171529307 >> 172.21.15.5:0/4171529307 conn(0x7fefa80ce590 msgr2=0x7fefa80ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:56.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.749+0000 7fefaf200640 1 -- 172.21.15.5:0/4171529307 shutdown_connections 2024-08-17T02:47:56.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.749+0000 7fefaf200640 1 -- 172.21.15.5:0/4171529307 wait complete. 2024-08-17T02:47:56.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.750+0000 7fefaf200640 1 Processor -- start 2024-08-17T02:47:56.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.751+0000 7fefaf200640 1 -- start start 2024-08-17T02:47:56.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.751+0000 7fefaf200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa8068dd0 0x7fefa8154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.751+0000 7fefaf200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8158e10 0x7fefa81535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.751+0000 7fefaf200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefa81591e0 0x7fefa806d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.751+0000 7fefaf200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8169480 con 0x7fefa8158e10 2024-08-17T02:47:56.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.751+0000 7fefaf200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8169740 con 0x7fefa81591e0 2024-08-17T02:47:56.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.751+0000 7fefaf200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8169a20 con 0x7fefa8068dd0 2024-08-17T02:47:56.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.752+0000 7fefa7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8158e10 0x7fefa81535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.752+0000 7fefa7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8158e10 0x7fefa81535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42372/0 (socket says 172.21.15.5:42372) 2024-08-17T02:47:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.752+0000 7fefa7400640 1 -- 172.21.15.5:0/1747731996 learned_addr learned my addr 172.21.15.5:0/1747731996 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.752+0000 7fefa7e00640 1 --2- 172.21.15.5:0/1747731996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa8068dd0 0x7fefa8154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.752+0000 7fefa7400640 1 -- 172.21.15.5:0/1747731996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa8068dd0 msgr2=0x7fefa8154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.752+0000 7fefad200640 1 --2- 172.21.15.5:0/1747731996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefa81591e0 0x7fefa806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.752+0000 7fefa7400640 1 --2- 172.21.15.5:0/1747731996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa8068dd0 0x7fefa8154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.752+0000 7fefa7400640 1 -- 172.21.15.5:0/1747731996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefa81591e0 msgr2=0x7fefa806d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.752+0000 7fefa7400640 1 --2- 172.21.15.5:0/1747731996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefa81591e0 0x7fefa806d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.752+0000 7fefa7400640 1 -- 172.21.15.5:0/1747731996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef94009450 con 0x7fefa8158e10 2024-08-17T02:47:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.752+0000 7fefa7e00640 1 --2- 172.21.15.5:0/1747731996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa8068dd0 0x7fefa8154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.752+0000 7fefad200640 1 --2- 172.21.15.5:0/1747731996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefa81591e0 0x7fefa806d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.752+0000 7fefa7400640 1 --2- 172.21.15.5:0/1747731996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8158e10 0x7fefa81535c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fef94035040 tx=0x7fef94032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:56.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.753+0000 7fef9f400640 1 -- 172.21.15.5:0/1747731996 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94031bb0 con 0x7fefa8158e10 2024-08-17T02:47:56.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.753+0000 7fef9f400640 1 -- 172.21.15.5:0/1747731996 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef94031d70 con 0x7fefa8158e10 2024-08-17T02:47:56.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.753+0000 7fef9f400640 1 -- 172.21.15.5:0/1747731996 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9403d670 con 0x7fefa8158e10 2024-08-17T02:47:56.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.753+0000 7fefaf200640 1 -- 172.21.15.5:0/1747731996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa8169d00 con 0x7fefa8158e10 2024-08-17T02:47:56.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.753+0000 7fefaf200640 1 -- 172.21.15.5:0/1747731996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa806d5b0 con 0x7fefa8158e10 2024-08-17T02:47:56.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.755+0000 7fef9f400640 1 -- 172.21.15.5:0/1747731996 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fef94039040 con 0x7fefa8158e10 2024-08-17T02:47:56.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.756+0000 7fef9f400640 1 --2- 172.21.15.5:0/1747731996 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fef88065150 0x7fef88067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.756+0000 7fef9f400640 1 -- 172.21.15.5:0/1747731996 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef9402ae40 con 0x7fefa8158e10 2024-08-17T02:47:56.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.756+0000 7fefa7e00640 1 --2- 172.21.15.5:0/1747731996 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fef88065150 0x7fef88067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.757+0000 7fefb1843740 1 Processor -- start 2024-08-17T02:47:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.757+0000 7fefa7e00640 1 --2- 172.21.15.5:0/1747731996 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fef88065150 0x7fef88067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fef980017a0 tx=0x7fef98009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.757+0000 7fefb1843740 1 -- start start 2024-08-17T02:47:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.758+0000 7fefb1843740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f93ca30 0x56142f93ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.758+0000 7fefb1843740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f9180a0 0x56142f95a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.758+0000 7fefb1843740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f95ab10 0x56142f911900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.758+0000 7fefb1843740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56142f8d2380 con 0x56142f9180a0 2024-08-17T02:47:56.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.758+0000 7fefb1843740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56142f87b9e0 con 0x56142f93ca30 2024-08-17T02:47:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.758+0000 7fefb1843740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x56142f879170 con 0x56142f95ab10 2024-08-17T02:47:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.758+0000 7fefa7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f9180a0 0x56142f95a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.758+0000 7fefa7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f9180a0 0x56142f95a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42388/0 (socket says 172.21.15.5:42388) 2024-08-17T02:47:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.758+0000 7fefa7400640 1 -- 172.21.15.5:0/3131992083 learned_addr learned my addr 172.21.15.5:0/3131992083 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.758+0000 7fefad200640 1 --2- 172.21.15.5:0/3131992083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f95ab10 0x56142f911900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.758+0000 7fefa7e00640 1 --2- 172.21.15.5:0/3131992083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f93ca30 0x56142f93ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.758+0000 7fefa7400640 1 -- 172.21.15.5:0/3131992083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f95ab10 msgr2=0x56142f911900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.758+0000 7fefa7400640 1 --2- 172.21.15.5:0/3131992083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f95ab10 0x56142f911900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.758+0000 7fefa7400640 1 -- 172.21.15.5:0/3131992083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f93ca30 msgr2=0x56142f93ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.758+0000 7fefa7400640 1 --2- 172.21.15.5:0/3131992083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f93ca30 0x56142f93ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.758+0000 7fefa7400640 1 -- 172.21.15.5:0/3131992083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56142f828820 con 0x56142f9180a0 2024-08-17T02:47:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.759+0000 7fefa7400640 1 --2- 172.21.15.5:0/3131992083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f9180a0 0x56142f95a5d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fef94070550 tx=0x7fef94079040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae68e8ba196e3a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:56.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.759+0000 7fef93e00640 1 -- 172.21.15.5:0/3131992083 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef940739b0 con 0x56142f9180a0 2024-08-17T02:47:56.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.759+0000 7fef93e00640 1 -- 172.21.15.5:0/3131992083 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef94074750 con 0x56142f9180a0 2024-08-17T02:47:56.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.759+0000 7fef93e00640 1 -- 172.21.15.5:0/3131992083 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94074050 con 0x56142f9180a0 2024-08-17T02:47:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.759+0000 7fefb1843740 1 -- 172.21.15.5:0/3131992083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f9180a0 msgr2=0x56142f95a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.759+0000 7fefb1843740 1 --2- 172.21.15.5:0/3131992083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f9180a0 0x56142f95a5d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fef94070550 tx=0x7fef94079040 comp rx=0 tx=0).stop 2024-08-17T02:47:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.760+0000 7fefb1843740 1 -- 172.21.15.5:0/3131992083 shutdown_connections 2024-08-17T02:47:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.760+0000 7fefb1843740 1 --2- 172.21.15.5:0/3131992083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f95ab10 0x56142f911900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.760+0000 7fefb1843740 1 --2- 172.21.15.5:0/3131992083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f9180a0 0x56142f95a5d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.760+0000 7fefb1843740 1 --2- 172.21.15.5:0/3131992083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f93ca30 0x56142f93ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.760+0000 7fefb1843740 1 -- 172.21.15.5:0/3131992083 >> 172.21.15.5:0/3131992083 conn(0x56142f8b0030 msgr2=0x56142f95ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.760+0000 7fefb1843740 1 -- 172.21.15.5:0/3131992083 shutdown_connections 2024-08-17T02:47:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.760+0000 7fefb1843740 1 -- 172.21.15.5:0/3131992083 wait complete. 2024-08-17T02:47:56.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.760+0000 7fefb1843740 1 -- start start 2024-08-17T02:47:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.760+0000 7fefb1843740 1 Processor -- start 2024-08-17T02:47:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.761+0000 7fefb1843740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f9180a0 0x56142f96b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.761+0000 7fefb1843740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f93ca30 0x56142f95cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.761+0000 7fefb1843740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f95ab10 0x56142f95d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.761+0000 7fefb1843740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56142f874f60 con 0x56142f95ab10 2024-08-17T02:47:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.761+0000 7fefb1843740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56142f81d690 con 0x56142f93ca30 2024-08-17T02:47:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.761+0000 7fefb1843740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x56142f81d330 con 0x56142f9180a0 2024-08-17T02:47:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.761+0000 7fefb1843740 10 client.0 _ll_register_callbacks cb 0x56142f8172b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:47:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.762+0000 7fefad200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f95ab10 0x56142f95d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.762+0000 7fefad200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f95ab10 0x56142f95d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42394/0 (socket says 172.21.15.5:42394) 2024-08-17T02:47:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.762+0000 7fefad200640 1 -- 172.21.15.5:0/4219992125 learned_addr learned my addr 172.21.15.5:0/4219992125 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.762+0000 7fefa7400640 1 --2- 172.21.15.5:0/4219992125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f93ca30 0x56142f95cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.762+0000 7fefa7e00640 1 --2- 172.21.15.5:0/4219992125 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f9180a0 0x56142f96b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.762+0000 7fefad200640 1 -- 172.21.15.5:0/4219992125 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f9180a0 msgr2=0x56142f96b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.762+0000 7fefad200640 1 --2- 172.21.15.5:0/4219992125 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f9180a0 0x56142f96b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.762+0000 7fefad200640 1 -- 172.21.15.5:0/4219992125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f93ca30 msgr2=0x56142f95cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.762+0000 7fefad200640 1 --2- 172.21.15.5:0/4219992125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f93ca30 0x56142f95cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.762+0000 7fefad200640 1 -- 172.21.15.5:0/4219992125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa806d5b0 con 0x56142f95ab10 2024-08-17T02:47:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.762+0000 7fefa7400640 1 --2- 172.21.15.5:0/4219992125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f93ca30 0x56142f95cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.763+0000 7fefad200640 1 --2- 172.21.15.5:0/4219992125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f95ab10 0x56142f95d4c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fefa0007da0 tx=0x7fefa000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30170d413272cc6a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.763+0000 7fef90c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-17T02:47:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.763+0000 7fef90c00640 1 -- 172.21.15.5:0/4219992125 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0009dc0 con 0x56142f95ab10 2024-08-17T02:47:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.763+0000 7fefb1843740 1 -- 172.21.15.5:0/4219992125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56142f8a8d20 con 0x56142f95ab10 2024-08-17T02:47:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.763+0000 7fef90c00640 1 -- 172.21.15.5:0/4219992125 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fefa0011e50 con 0x56142f95ab10 2024-08-17T02:47:56.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.763+0000 7fef90c00640 1 -- 172.21.15.5:0/4219992125 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefa0016660 con 0x56142f95ab10 2024-08-17T02:47:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.763+0000 7fefb1843740 10 client.5085 fetch_fsmap learned FSMap version 16 2024-08-17T02:47:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.763+0000 7fefb1843740 1 -- 172.21.15.5:0/4219992125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56142f83eab0 con 0x56142f95ab10 2024-08-17T02:47:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.763+0000 7fef90c00640 1 -- 172.21.15.5:0/4219992125 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56142f8a8d20 con 0x56142f95ab10 2024-08-17T02:47:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.763+0000 7fef90c00640 1 -- 172.21.15.5:0/4219992125 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fefa0014070 con 0x56142f95ab10 2024-08-17T02:47:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.763+0000 7fefb1843740 10 client.5085 fetch_fsmap finished waiting for FSMap version 16 2024-08-17T02:47:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.763+0000 7fefb1843740 10 client.5085 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:47:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.763+0000 7fefb1843740 20 client.5085 populate_metadata read hostname 'smithi005' 2024-08-17T02:47:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.763+0000 7fefb1843740 1 --2- 172.21.15.5:0/4219992125 >> [v2:172.21.15.5:6834/723455700,v1:172.21.15.5:6836/723455700] conn(0x56142f95cb50 0x56142f9588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.763+0000 7fefb1843740 4 client.5085 mds_command: new command op to 4917 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:47:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.763+0000 7fefb1843740 1 -- 172.21.15.5:0/4219992125 --> [v2:172.21.15.5:6834/723455700,v1:172.21.15.5:6836/723455700] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56142f57c3c0 con 0x56142f95cb50 2024-08-17T02:47:56.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.764+0000 7fefa7e00640 1 --2- 172.21.15.5:0/4219992125 >> [v2:172.21.15.5:6834/723455700,v1:172.21.15.5:6836/723455700] conn(0x56142f95cb50 0x56142f9588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.764+0000 7fefa7e00640 1 --2- 172.21.15.5:0/4219992125 >> [v2:172.21.15.5:6834/723455700,v1:172.21.15.5:6836/723455700] conn(0x56142f95cb50 0x56142f9588e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0be9a3b2007888a server_cookie=d124623292c7a11d in_seq=0 out_seq=0 2024-08-17T02:47:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.764+0000 7fef90c00640 10 client.5085 ms_handle_connect on v2:172.21.15.5:6834/723455700 2024-08-17T02:47:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.765+0000 7fef90c00640 1 -- 172.21.15.5:0/4219992125 <== mds.0 v2:172.21.15.5:6834/723455700 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x56142f57c3c0 con 0x56142f95cb50 2024-08-17T02:47:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.765+0000 7fef90c00640 10 client.5085 handle_command_reply: tid=0 2024-08-17T02:47:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.765+0000 7fefb1843740 1 client.5085 shutdown 2024-08-17T02:47:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.765+0000 7fefb1843740 1 -- 172.21.15.5:0/4219992125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f95ab10 msgr2=0x56142f95d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.765+0000 7fefb1843740 1 --2- 172.21.15.5:0/4219992125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f95ab10 0x56142f95d4c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fefa0007da0 tx=0x7fefa000b040 comp rx=0 tx=0).stop 2024-08-17T02:47:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.765+0000 7fefb1843740 1 -- 172.21.15.5:0/4219992125 shutdown_connections 2024-08-17T02:47:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.765+0000 7fefb1843740 1 --2- 172.21.15.5:0/4219992125 >> [v2:172.21.15.5:6834/723455700,v1:172.21.15.5:6836/723455700] conn(0x56142f95cb50 0x56142f9588e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.765+0000 7fefb1843740 1 --2- 172.21.15.5:0/4219992125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f95ab10 0x56142f95d4c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.765+0000 7fefb1843740 1 --2- 172.21.15.5:0/4219992125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f93ca30 0x56142f95cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.765+0000 7fefb1843740 1 --2- 172.21.15.5:0/4219992125 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f9180a0 0x56142f96b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.765+0000 7fef90c00640 0 client.5085 ms_handle_reset on v2:172.21.15.5:6834/723455700 2024-08-17T02:47:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.765+0000 7fefb1843740 1 -- 172.21.15.5:0/4219992125 >> 172.21.15.5:0/4219992125 conn(0x56142f8b0030 msgr2=0x56142f95ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.765+0000 7fefb1843740 1 -- 172.21.15.5:0/4219992125 shutdown_connections 2024-08-17T02:47:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.766+0000 7fefb1843740 1 -- 172.21.15.5:0/4219992125 wait complete. 2024-08-17T02:47:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.766+0000 7fefb1843740 20 client.5085 trim_cache size 0 max 16384 2024-08-17T02:47:56.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.781+0000 7fefb1843740 1 Processor -- start 2024-08-17T02:47:56.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.782+0000 7fefb1843740 1 -- start start 2024-08-17T02:47:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.782+0000 7fefb1843740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f9180a0 0x56142f9387d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.782+0000 7fefb1843740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f93ca30 0x56142f95d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.782+0000 7fefb1843740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f95ab10 0x56142f95d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.782+0000 7fefb1843740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56142f5eff20 con 0x56142f93ca30 2024-08-17T02:47:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.782+0000 7fefb1843740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56142f8387e0 con 0x56142f9180a0 2024-08-17T02:47:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.782+0000 7fefb1843740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x56142f95db50 con 0x56142f95ab10 2024-08-17T02:47:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.783+0000 7fefa7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f93ca30 0x56142f95d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.783+0000 7fefa7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f93ca30 0x56142f95d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42396/0 (socket says 172.21.15.5:42396) 2024-08-17T02:47:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.783+0000 7fefa7400640 1 -- 172.21.15.5:0/437794762 learned_addr learned my addr 172.21.15.5:0/437794762 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.783+0000 7fefa7e00640 1 --2- 172.21.15.5:0/437794762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f9180a0 0x56142f9387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.783+0000 7fefad200640 1 --2- 172.21.15.5:0/437794762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f95ab10 0x56142f95d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.783+0000 7fefa7400640 1 -- 172.21.15.5:0/437794762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f95ab10 msgr2=0x56142f95d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:56.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.783+0000 7fefa7400640 1 --2- 172.21.15.5:0/437794762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f95ab10 0x56142f95d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.783+0000 7fefa7400640 1 -- 172.21.15.5:0/437794762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f9180a0 msgr2=0x56142f9387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:56.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.783+0000 7fefa7400640 1 --2- 172.21.15.5:0/437794762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f9180a0 0x56142f9387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.783+0000 7fefa7400640 1 -- 172.21.15.5:0/437794762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56142f842490 con 0x56142f93ca30 2024-08-17T02:47:56.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.783+0000 7fefa7e00640 1 --2- 172.21.15.5:0/437794762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f9180a0 0x56142f9387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:56.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.783+0000 7fefad200640 1 --2- 172.21.15.5:0/437794762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f95ab10 0x56142f95d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:56.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.783+0000 7fefa7400640 1 --2- 172.21.15.5:0/437794762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f93ca30 0x56142f95d0d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fef94073fe0 tx=0x7fef9403e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbdf24d6be76bb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:56.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.783+0000 7fef9cc00640 1 -- 172.21.15.5:0/437794762 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef940770d0 con 0x56142f93ca30 2024-08-17T02:47:56.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.783+0000 7fef9cc00640 1 -- 172.21.15.5:0/437794762 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef940739b0 con 0x56142f93ca30 2024-08-17T02:47:56.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.784+0000 7fef9cc00640 1 -- 172.21.15.5:0/437794762 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef940772a0 con 0x56142f93ca30 2024-08-17T02:47:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.784+0000 7fefb1843740 1 -- 172.21.15.5:0/437794762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f93ca30 msgr2=0x56142f95d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.784+0000 7fefb1843740 1 --2- 172.21.15.5:0/437794762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f93ca30 0x56142f95d0d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fef94073fe0 tx=0x7fef9403e000 comp rx=0 tx=0).stop 2024-08-17T02:47:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.784+0000 7fefb1843740 1 -- 172.21.15.5:0/437794762 shutdown_connections 2024-08-17T02:47:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.784+0000 7fefb1843740 1 --2- 172.21.15.5:0/437794762 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f95ab10 0x56142f95d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.784+0000 7fefb1843740 1 --2- 172.21.15.5:0/437794762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f93ca30 0x56142f95d0d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.784+0000 7fefb1843740 1 --2- 172.21.15.5:0/437794762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f9180a0 0x56142f9387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.784+0000 7fefb1843740 1 -- 172.21.15.5:0/437794762 >> 172.21.15.5:0/437794762 conn(0x56142f8b0030 msgr2=0x56142f95df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.784+0000 7fefb1843740 1 -- 172.21.15.5:0/437794762 shutdown_connections 2024-08-17T02:47:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.784+0000 7fefb1843740 1 -- 172.21.15.5:0/437794762 wait complete. 2024-08-17T02:47:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.785+0000 7fefb1843740 1 -- start start 2024-08-17T02:47:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.785+0000 7fefb1843740 1 Processor -- start 2024-08-17T02:47:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.786+0000 7fefb1843740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f9180a0 0x56142f9161b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.786+0000 7fefb1843740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f93ca30 0x56142f96c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.786+0000 7fefb1843740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f95ab10 0x56142f957470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.786+0000 7fefb1843740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56142f96cfa0 con 0x56142f95ab10 2024-08-17T02:47:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.786+0000 7fefb1843740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56142f958ae0 con 0x56142f9180a0 2024-08-17T02:47:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.786+0000 7fefb1843740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x56142f969c90 con 0x56142f93ca30 2024-08-17T02:47:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.786+0000 7fefb1843740 10 client.0 _ll_register_callbacks cb 0x7fefa0009c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:47:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.786+0000 7fefad200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f95ab10 0x56142f957470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.786+0000 7fefa7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f9180a0 0x56142f9161b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.786+0000 7fefa7e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f9180a0 0x56142f9161b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:54588/0 (socket says 172.21.15.5:54588) 2024-08-17T02:47:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.786+0000 7fefa7e00640 1 -- 172.21.15.5:0/2100848967 learned_addr learned my addr 172.21.15.5:0/2100848967 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.786+0000 7fefa7400640 1 --2- 172.21.15.5:0/2100848967 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f93ca30 0x56142f96c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.787+0000 7fefa7e00640 1 -- 172.21.15.5:0/2100848967 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f93ca30 msgr2=0x56142f96c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.787+0000 7fefa7e00640 1 --2- 172.21.15.5:0/2100848967 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f93ca30 0x56142f96c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.787+0000 7fefa7e00640 1 -- 172.21.15.5:0/2100848967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f95ab10 msgr2=0x56142f957470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.787+0000 7fefa7e00640 1 --2- 172.21.15.5:0/2100848967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f95ab10 0x56142f957470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.787+0000 7fefa7e00640 1 -- 172.21.15.5:0/2100848967 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56142f828820 con 0x56142f9180a0 2024-08-17T02:47:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.787+0000 7fefa7400640 1 --2- 172.21.15.5:0/2100848967 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f93ca30 0x56142f96c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.787+0000 7fefa7e00640 1 --2- 172.21.15.5:0/2100848967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f9180a0 0x56142f9161b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fef9800d520 tx=0x7fef98014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c6f4ff98e1c2637 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.787+0000 7fef90c00640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-08-17T02:47:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.787+0000 7fef90c00640 1 -- 172.21.15.5:0/2100848967 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef980262f0 con 0x56142f9180a0 2024-08-17T02:47:56.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.787+0000 7fef90c00640 1 -- 172.21.15.5:0/2100848967 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef98023ad0 con 0x56142f9180a0 2024-08-17T02:47:56.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.787+0000 7fefb1843740 1 -- 172.21.15.5:0/2100848967 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef94074750 con 0x56142f9180a0 2024-08-17T02:47:56.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.788+0000 7fef90c00640 1 -- 172.21.15.5:0/2100848967 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef98023ea0 con 0x56142f9180a0 2024-08-17T02:47:56.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.788+0000 7fefb1843740 10 client.5086 fetch_fsmap learned FSMap version 16 2024-08-17T02:47:56.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.788+0000 7fefb1843740 1 -- 172.21.15.5:0/2100848967 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56142f8421e0 con 0x56142f9180a0 2024-08-17T02:47:56.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.788+0000 7fef90c00640 1 -- 172.21.15.5:0/2100848967 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef98034070 con 0x56142f9180a0 2024-08-17T02:47:56.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.788+0000 7fef90c00640 1 -- 172.21.15.5:0/2100848967 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fef98026a70 con 0x56142f9180a0 2024-08-17T02:47:56.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.788+0000 7fefb1843740 10 client.5086 fetch_fsmap finished waiting for FSMap version 16 2024-08-17T02:47:56.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.788+0000 7fefb1843740 10 client.5086 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:47:56.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.788+0000 7fefb1843740 20 client.5086 populate_metadata read hostname 'smithi005' 2024-08-17T02:47:56.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.788+0000 7fefb1843740 1 --2- 172.21.15.5:0/2100848967 >> [v2:172.21.15.5:6834/723455700,v1:172.21.15.5:6836/723455700] conn(0x56142f9c1c80 0x56142f9c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.788+0000 7fefb1843740 4 client.5086 mds_command: new command op to 4917 tid=0[{"prefix": "status"}] 2024-08-17T02:47:56.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.788+0000 7fefb1843740 1 -- 172.21.15.5:0/2100848967 --> [v2:172.21.15.5:6834/723455700,v1:172.21.15.5:6836/723455700] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56142f58d6c0 con 0x56142f9c1c80 2024-08-17T02:47:56.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.788+0000 7fefa7400640 1 --2- 172.21.15.5:0/2100848967 >> [v2:172.21.15.5:6834/723455700,v1:172.21.15.5:6836/723455700] conn(0x56142f9c1c80 0x56142f9c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.789+0000 7fefa7400640 1 --2- 172.21.15.5:0/2100848967 >> [v2:172.21.15.5:6834/723455700,v1:172.21.15.5:6836/723455700] conn(0x56142f9c1c80 0x56142f9c2050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c0b388f19318f77 server_cookie=5d8871235b57454d in_seq=0 out_seq=0 2024-08-17T02:47:56.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.789+0000 7fef90c00640 10 client.5086 ms_handle_connect on v2:172.21.15.5:6834/723455700 2024-08-17T02:47:56.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.789+0000 7fef90c00640 1 -- 172.21.15.5:0/2100848967 <== mds.0 v2:172.21.15.5:6834/723455700 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56142f58d6c0 con 0x56142f9c1c80 2024-08-17T02:47:56.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.789+0000 7fef90c00640 10 client.5086 handle_command_reply: tid=0 2024-08-17T02:47:56.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.789+0000 7fefb1843740 1 client.5086 shutdown 2024-08-17T02:47:56.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.789+0000 7fefb1843740 1 -- 172.21.15.5:0/2100848967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f9180a0 msgr2=0x56142f9161b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:56.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.789+0000 7fefb1843740 1 --2- 172.21.15.5:0/2100848967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f9180a0 0x56142f9161b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fef9800d520 tx=0x7fef98014000 comp rx=0 tx=0).stop 2024-08-17T02:47:56.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.789+0000 7fefb1843740 1 -- 172.21.15.5:0/2100848967 shutdown_connections 2024-08-17T02:47:56.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.789+0000 7fefb1843740 1 --2- 172.21.15.5:0/2100848967 >> [v2:172.21.15.5:6834/723455700,v1:172.21.15.5:6836/723455700] conn(0x56142f9c1c80 0x56142f9c2050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.789+0000 7fefb1843740 1 --2- 172.21.15.5:0/2100848967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56142f95ab10 0x56142f957470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.789+0000 7fefb1843740 1 --2- 172.21.15.5:0/2100848967 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x56142f93ca30 0x56142f96c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.789+0000 7fefb1843740 1 --2- 172.21.15.5:0/2100848967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56142f9180a0 0x56142f9161b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.789+0000 7fef90c00640 0 client.5086 ms_handle_reset on v2:172.21.15.5:6834/723455700 2024-08-17T02:47:56.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.789+0000 7fefb1843740 1 -- 172.21.15.5:0/2100848967 >> 172.21.15.5:0/2100848967 conn(0x56142f8b0030 msgr2=0x56142f938640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:56.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.789+0000 7fefb1843740 1 -- 172.21.15.5:0/2100848967 shutdown_connections 2024-08-17T02:47:56.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.789+0000 7fefb1843740 1 -- 172.21.15.5:0/2100848967 wait complete. 2024-08-17T02:47:56.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.790+0000 7fefb1843740 20 client.5086 trim_cache size 0 max 16384 2024-08-17T02:47:56.795 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:47:56.795 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3", 2024-08-17T02:47:56.795 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-17T02:47:56.795 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4917, 2024-08-17T02:47:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-17T02:47:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-17T02:47:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-17T02:47:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 6.1069190290000002, 2024-08-17T02:47:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 16, 2024-08-17T02:47:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 32, 2024-08-17T02:47:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 32, 2024-08-17T02:47:56.796 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 13.985665759 2024-08-17T02:47:56.796 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:47:56.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.790+0000 7fefaf200640 1 -- 172.21.15.5:0/1747731996 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fef88065150 msgr2=0x7fef88067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:56.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.790+0000 7fefaf200640 1 --2- 172.21.15.5:0/1747731996 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fef88065150 0x7fef88067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fef980017a0 tx=0x7fef98009040 comp rx=0 tx=0).stop 2024-08-17T02:47:56.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.790+0000 7fefaf200640 1 -- 172.21.15.5:0/1747731996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8158e10 msgr2=0x7fefa81535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:56.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.790+0000 7fefaf200640 1 --2- 172.21.15.5:0/1747731996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8158e10 0x7fefa81535c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fef94035040 tx=0x7fef94032000 comp rx=0 tx=0).stop 2024-08-17T02:47:56.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.790+0000 7fefaf200640 1 -- 172.21.15.5:0/1747731996 shutdown_connections 2024-08-17T02:47:56.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.790+0000 7fefaf200640 1 --2- 172.21.15.5:0/1747731996 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fef88065150 0x7fef88067600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.790+0000 7fefaf200640 1 --2- 172.21.15.5:0/1747731996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefa81591e0 0x7fefa806d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.790+0000 7fefaf200640 1 --2- 172.21.15.5:0/1747731996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefa8158e10 0x7fefa81535c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.790+0000 7fefaf200640 1 --2- 172.21.15.5:0/1747731996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fefa8068dd0 0x7fefa8154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.790+0000 7fefaf200640 1 -- 172.21.15.5:0/1747731996 >> 172.21.15.5:0/1747731996 conn(0x7fefa80ce590 msgr2=0x7fefa80cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:56.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.790+0000 7fefaf200640 1 -- 172.21.15.5:0/1747731996 shutdown_connections 2024-08-17T02:47:56.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.790+0000 7fefaf200640 1 -- 172.21.15.5:0/1747731996 wait complete. 2024-08-17T02:47:56.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:47:56.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.955+0000 7efdedc00640 1 Processor -- start 2024-08-17T02:47:56.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.955+0000 7efdedc00640 1 -- start start 2024-08-17T02:47:56.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.956+0000 7efdedc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde80ad960 0x7efde815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.956+0000 7efdedc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efde80ca050 0x7efde8156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.957+0000 7efdedc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde815b5e0 con 0x7efde80add30 2024-08-17T02:47:56.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.957+0000 7efdedc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde80cb160 con 0x7efde80ca050 2024-08-17T02:47:56.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.957+0000 7efdedc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde80b0d10 con 0x7efde80ad960 2024-08-17T02:47:56.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.957+0000 7efddfe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efde80ca050 0x7efde8156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.957+0000 7efde6a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde80ad960 0x7efde815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.957+0000 7efddfe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efde80ca050 0x7efde8156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:54604/0 (socket says 172.21.15.5:54604) 2024-08-17T02:47:56.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.957+0000 7efde6a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde80ad960 0x7efde815b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:35032/0 (socket says 172.21.15.5:35032) 2024-08-17T02:47:56.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.957+0000 7efddfe00640 1 -- 172.21.15.5:0/3707231925 learned_addr learned my addr 172.21.15.5:0/3707231925 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:56.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.958+0000 7efddfe00640 1 -- 172.21.15.5:0/3707231925 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde80ad960 msgr2=0x7efde815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:56.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.958+0000 7efddfe00640 1 --2- 172.21.15.5:0/3707231925 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde80ad960 0x7efde815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.958+0000 7efddfe00640 1 -- 172.21.15.5:0/3707231925 >> v1:172.21.15.107:6789/0 conn(0x7efde80add30 legacy=0x7efde8156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.958+0000 7efddfe00640 1 -- 172.21.15.5:0/3707231925 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde80ca550 con 0x7efde80ca050 2024-08-17T02:47:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.958+0000 7efde6a00640 1 --2- 172.21.15.5:0/3707231925 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde80ad960 0x7efde815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.959+0000 7efddfe00640 1 --2- 172.21.15.5:0/3707231925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efde80ca050 0x7efde8156420 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009910 tx=0x7efdd00091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b04b06b55a3b798 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.959+0000 7efde6000640 1 -- 172.21.15.5:0/3707231925 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0032440 con 0x7efde80ca050 2024-08-17T02:47:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.959+0000 7efde6000640 1 -- 172.21.15.5:0/3707231925 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd00325a0 con 0x7efde80ca050 2024-08-17T02:47:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.959+0000 7efde6000640 1 -- 172.21.15.5:0/3707231925 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0032980 con 0x7efde80ca050 2024-08-17T02:47:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.959+0000 7efdedc00640 1 -- 172.21.15.5:0/3707231925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efde80ca050 msgr2=0x7efde8156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.959+0000 7efdedc00640 1 --2- 172.21.15.5:0/3707231925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efde80ca050 0x7efde8156420 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009910 tx=0x7efdd00091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.960+0000 7efdedc00640 1 -- 172.21.15.5:0/3707231925 shutdown_connections 2024-08-17T02:47:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.960+0000 7efdedc00640 1 --2- 172.21.15.5:0/3707231925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efde80ca050 0x7efde8156420 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.960+0000 7efdedc00640 1 --2- 172.21.15.5:0/3707231925 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde80ad960 0x7efde815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.960+0000 7efdedc00640 1 -- 172.21.15.5:0/3707231925 >> 172.21.15.5:0/3707231925 conn(0x7efde8066e60 msgr2=0x7efde8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.960+0000 7efdedc00640 1 -- 172.21.15.5:0/3707231925 shutdown_connections 2024-08-17T02:47:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.960+0000 7efdedc00640 1 -- 172.21.15.5:0/3707231925 wait complete. 2024-08-17T02:47:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.961+0000 7efdedc00640 1 Processor -- start 2024-08-17T02:47:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.961+0000 7efdedc00640 1 -- start start 2024-08-17T02:47:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.962+0000 7efdedc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde80ad960 0x7efde8150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.962+0000 7efdedc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efde80add30 0x7efde80c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.962+0000 7efdedc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde80ca050 0x7efde8169280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.962+0000 7efdedc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde8150dc0 con 0x7efde80ca050 2024-08-17T02:47:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.962+0000 7efdedc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde80ac670 con 0x7efde80add30 2024-08-17T02:47:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.962+0000 7efdedc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde80c8900 con 0x7efde80ad960 2024-08-17T02:47:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.962+0000 7efde7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde80ca050 0x7efde8169280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.962+0000 7efde7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde80ca050 0x7efde8169280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42410/0 (socket says 172.21.15.5:42410) 2024-08-17T02:47:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.962+0000 7efde7400640 1 -- 172.21.15.5:0/255372249 learned_addr learned my addr 172.21.15.5:0/255372249 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.963+0000 7efddfe00640 1 --2- 172.21.15.5:0/255372249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efde80add30 0x7efde80c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.963+0000 7efde6a00640 1 --2- 172.21.15.5:0/255372249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde80ad960 0x7efde8150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.963+0000 7efde7400640 1 -- 172.21.15.5:0/255372249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde80ad960 msgr2=0x7efde8150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.963+0000 7efde7400640 1 --2- 172.21.15.5:0/255372249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde80ad960 0x7efde8150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.963+0000 7efde7400640 1 -- 172.21.15.5:0/255372249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efde80add30 msgr2=0x7efde80c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.963+0000 7efde7400640 1 --2- 172.21.15.5:0/255372249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efde80add30 0x7efde80c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.963+0000 7efde7400640 1 -- 172.21.15.5:0/255372249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd8009390 con 0x7efde80ca050 2024-08-17T02:47:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.963+0000 7efde6a00640 1 --2- 172.21.15.5:0/255372249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde80ad960 0x7efde8150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.963+0000 7efde7400640 1 --2- 172.21.15.5:0/255372249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde80ca050 0x7efde8169280 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efde000c890 tx=0x7efde0001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.963+0000 7efdde000640 1 -- 172.21.15.5:0/255372249 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde000ce80 con 0x7efde80ca050 2024-08-17T02:47:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.963+0000 7efdde000640 1 -- 172.21.15.5:0/255372249 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde000a850 con 0x7efde80ca050 2024-08-17T02:47:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.963+0000 7efdedc00640 1 -- 172.21.15.5:0/255372249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd0009450 con 0x7efde80ca050 2024-08-17T02:47:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.963+0000 7efdde000640 1 -- 172.21.15.5:0/255372249 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde000abf0 con 0x7efde80ca050 2024-08-17T02:47:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.964+0000 7efdedc00640 1 -- 172.21.15.5:0/255372249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde80abd40 con 0x7efde80ca050 2024-08-17T02:47:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.964+0000 7efdedc00640 1 -- 172.21.15.5:0/255372249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde8063fb0 con 0x7efde80ca050 2024-08-17T02:47:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.965+0000 7efdde000640 1 -- 172.21.15.5:0/255372249 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efde0012420 con 0x7efde80ca050 2024-08-17T02:47:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.966+0000 7efdde000640 1 --2- 172.21.15.5:0/255372249 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efdc4065150 0x7efdc4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.966+0000 7efdde000640 1 -- 172.21.15.5:0/255372249 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efde0082630 con 0x7efde80ca050 2024-08-17T02:47:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.966+0000 7efde6a00640 1 --2- 172.21.15.5:0/255372249 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efdc4065150 0x7efdc4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.967+0000 7efde6a00640 1 --2- 172.21.15.5:0/255372249 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efdc4065150 0x7efdc4067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009360 tx=0x7efdd8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:56.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:56.970+0000 7efdde000640 1 -- 172.21.15.5:0/255372249 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efde0050650 con 0x7efde80ca050 2024-08-17T02:47:57.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:57.190+0000 7efdedc00640 1 -- 172.21.15.5:0/255372249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efde815b5e0 con 0x7efde80ca050 2024-08-17T02:47:57.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:57.190+0000 7efdde000640 1 -- 172.21.15.5:0/255372249 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7efde815b5e0 con 0x7efde80ca050 2024-08-17T02:47:57.264 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:47:57.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:57.192+0000 7efdedc00640 1 -- 172.21.15.5:0/255372249 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efdc4065150 msgr2=0x7efdc4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:57.192+0000 7efdedc00640 1 --2- 172.21.15.5:0/255372249 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efdc4065150 0x7efdc4067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009360 tx=0x7efdd8008040 comp rx=0 tx=0).stop 2024-08-17T02:47:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:57.192+0000 7efdedc00640 1 -- 172.21.15.5:0/255372249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde80ca050 msgr2=0x7efde8169280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:57.192+0000 7efdedc00640 1 --2- 172.21.15.5:0/255372249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde80ca050 0x7efde8169280 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efde000c890 tx=0x7efde0001690 comp rx=0 tx=0).stop 2024-08-17T02:47:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:57.192+0000 7efdedc00640 1 -- 172.21.15.5:0/255372249 shutdown_connections 2024-08-17T02:47:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:57.192+0000 7efdedc00640 1 --2- 172.21.15.5:0/255372249 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efdc4065150 0x7efdc4067600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:57.192+0000 7efdedc00640 1 --2- 172.21.15.5:0/255372249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde80ca050 0x7efde8169280 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:57.192+0000 7efdedc00640 1 --2- 172.21.15.5:0/255372249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efde80add30 0x7efde80c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:57.192+0000 7efdedc00640 1 --2- 172.21.15.5:0/255372249 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde80ad960 0x7efde8150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:57.192+0000 7efdedc00640 1 -- 172.21.15.5:0/255372249 >> 172.21.15.5:0/255372249 conn(0x7efde8066e60 msgr2=0x7efde806e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:57.192+0000 7efdedc00640 1 -- 172.21.15.5:0/255372249 shutdown_connections 2024-08-17T02:47:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:57.193+0000 7efdedc00640 1 -- 172.21.15.5:0/255372249 wait complete. 2024-08-17T02:47:57.267 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:47:57.267 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:47:57.267 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-17T02:47:57.267 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:47:57.267 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:57.267 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:47:57.267 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:47:57.267 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:47:57.267 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:47:57.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:57.268 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-17T02:47:57.303 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:57.304 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:57.304 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:57.304 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:57.304 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:57.304 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:57.304 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:57.304 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:57.304 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-17T02:47:57.304 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:57.304 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:57.304 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-17T02:47:57.305 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:47:57.305 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:57.305 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-17T02:47:57.305 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:47:57.305 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42634sec preferred_lft 42634sec 2024-08-17T02:47:57.305 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-08-17T02:47:57.305 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:57.305 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:57.305 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:57.305 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-17T02:47:57.305 INFO:teuthology.orchestra.run.smithi005.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:57.305 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0a:0f:c0:23:0b:c0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:57.305 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:47:57.306 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:57.306 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::4874:feff:febd:3c70/64 scope link 2024-08-17T02:47:57.306 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:57.306 INFO:teuthology.orchestra.run.smithi005.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:47:57.306 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 6e:4d:a5:1f:ec:1a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:47:57.306 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::6c4d:a5ff:fe1f:ec1a/64 scope link 2024-08-17T02:47:57.306 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:57.306 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:47:57.306 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0a:0f:c0:23:0b:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:47:57.306 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::80f:c0ff:fe23:bc0/64 scope link 2024-08-17T02:47:57.306 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:57.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:57.307 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:47:57.398 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-17T02:47:57.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:57.401 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-17T02:47:57.436 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-17T02:47:57.436 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:47:57.436 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:47:57.436 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:47:57.437 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:47:57.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:57.437 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-08-17T02:47:57.437 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-17T02:47:57.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:47:57.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:47:57.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:47:57.438 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-17T02:47:57.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:47:57.561 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:47:57.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:57.583 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-17T02:47:57.659 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:47:57.659 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:47:57.660 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:47:57.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:57.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-17T02:47:57.763 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:57.763 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:57.798 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:47:57.798 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:57.798 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:57.873 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:47:57.873 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:47:57.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:57.995 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:57.995 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:58.022 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:58.022 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:58.022 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-08-17T02:47:58.022 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3.cephfs=/ 2024-08-17T02:47:58.022 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.107:3300/172.21.15.107:3301" will pass to kernel 2024-08-17T02:47:58.022 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:47:58.023 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:47:58.023 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:47:58.023 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:47:58.023 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:47:58.025 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:47:58.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:58.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:58.082 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:47:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.232+0000 7f7655e00640 1 Processor -- start 2024-08-17T02:47:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.233+0000 7f7655e00640 1 -- start start 2024-08-17T02:47:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.234+0000 7f7655e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7650158af0 0x7f76500ae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.234+0000 7f7655e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76500c8290 0x7f76500ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.234+0000 7f7655e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76500aa5a0 con 0x7f76500aca30 2024-08-17T02:47:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.234+0000 7f7655e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76500abde0 con 0x7f7650158af0 2024-08-17T02:47:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.234+0000 7f7655e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76500ace50 con 0x7f76500c8290 2024-08-17T02:47:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.234+0000 7f7654a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7650158af0 0x7f76500ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.234+0000 7f7655400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f76500aca30 0x7f765015c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46564/0 (socket says 172.21.15.5:46564) 2024-08-17T02:47:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.234+0000 7f7655400640 1 -- 172.21.15.5:0/1841423097 learned_addr learned my addr 172.21.15.5:0/1841423097 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:47:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.234+0000 7f764fe00640 1 --2- 172.21.15.5:0/1841423097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76500c8290 0x7f76500ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.235+0000 7f7654a00640 1 -- 172.21.15.5:0/1841423097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76500c8290 msgr2=0x7f76500ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.235+0000 7f7654a00640 1 --2- 172.21.15.5:0/1841423097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76500c8290 0x7f76500ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.235+0000 7f7654a00640 1 -- 172.21.15.5:0/1841423097 >> v1:172.21.15.5:6789/0 conn(0x7f76500aca30 legacy=0x7f765015c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.235+0000 7f7654a00640 1 -- 172.21.15.5:0/1841423097 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500a9c70 con 0x7f7650158af0 2024-08-17T02:47:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.236+0000 7f7654a00640 1 --2- 172.21.15.5:0/1841423097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650158af0 0x7f76500ae530 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7644009850 tx=0x7f76440090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf434ddbba4ee6f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.236+0000 7f764f400640 1 -- 172.21.15.5:0/1841423097 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764402ad00 con 0x7f7650158af0 2024-08-17T02:47:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.236+0000 7f764f400640 1 -- 172.21.15.5:0/1841423097 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764402ae60 con 0x7f7650158af0 2024-08-17T02:47:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.236+0000 7f764f400640 1 -- 172.21.15.5:0/1841423097 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644032670 con 0x7f7650158af0 2024-08-17T02:47:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.237+0000 7f7655e00640 1 -- 172.21.15.5:0/1841423097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650158af0 msgr2=0x7f76500ae530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.237+0000 7f7655e00640 1 --2- 172.21.15.5:0/1841423097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650158af0 0x7f76500ae530 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7644009850 tx=0x7f76440090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.237+0000 7f7655e00640 1 -- 172.21.15.5:0/1841423097 shutdown_connections 2024-08-17T02:47:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.237+0000 7f7655e00640 1 --2- 172.21.15.5:0/1841423097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76500c8290 0x7f76500ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.237+0000 7f7655e00640 1 --2- 172.21.15.5:0/1841423097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650158af0 0x7f76500ae530 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.237+0000 7f7655e00640 1 -- 172.21.15.5:0/1841423097 >> 172.21.15.5:0/1841423097 conn(0x7f76500cc060 msgr2=0x7f76500cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.237+0000 7f7655e00640 1 -- 172.21.15.5:0/1841423097 shutdown_connections 2024-08-17T02:47:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.237+0000 7f7655e00640 1 -- 172.21.15.5:0/1841423097 wait complete. 2024-08-17T02:47:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.238+0000 7f7655e00640 1 Processor -- start 2024-08-17T02:47:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.238+0000 7f7655e00640 1 -- start start 2024-08-17T02:47:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.239+0000 7f7655e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76500aca30 0x7f7650153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.239+0000 7f7655e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76500c8290 0x7f76500c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.239+0000 7f7655e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650158af0 0x7f765014bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.239+0000 7f7655e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76500c1f80 con 0x7f7650158af0 2024-08-17T02:47:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.239+0000 7f7655e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7650155510 con 0x7f76500c8290 2024-08-17T02:47:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.239+0000 7f7655e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7650153cb0 con 0x7f76500aca30 2024-08-17T02:47:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.239+0000 7f7655400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650158af0 0x7f765014bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.240+0000 7f7655400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650158af0 0x7f765014bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42418/0 (socket says 172.21.15.5:42418) 2024-08-17T02:47:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.240+0000 7f7655400640 1 -- 172.21.15.5:0/4226201735 learned_addr learned my addr 172.21.15.5:0/4226201735 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.240+0000 7f7654a00640 1 --2- 172.21.15.5:0/4226201735 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76500aca30 0x7f7650153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.240+0000 7f764fe00640 1 --2- 172.21.15.5:0/4226201735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76500c8290 0x7f76500c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.240+0000 7f7655400640 1 -- 172.21.15.5:0/4226201735 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76500aca30 msgr2=0x7f7650153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.240+0000 7f7655400640 1 --2- 172.21.15.5:0/4226201735 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76500aca30 0x7f7650153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.240+0000 7f7655400640 1 -- 172.21.15.5:0/4226201735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76500c8290 msgr2=0x7f76500c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.240+0000 7f7655400640 1 --2- 172.21.15.5:0/4226201735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76500c8290 0x7f76500c1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.240+0000 7f7655400640 1 -- 172.21.15.5:0/4226201735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7644009390 con 0x7f7650158af0 2024-08-17T02:47:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.240+0000 7f7655400640 1 --2- 172.21.15.5:0/4226201735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650158af0 0x7f765014bae0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f764800cc40 tx=0x7f7648001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.240+0000 7f7643e00640 1 -- 172.21.15.5:0/4226201735 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764800ce60 con 0x7f7650158af0 2024-08-17T02:47:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.240+0000 7f7643e00640 1 -- 172.21.15.5:0/4226201735 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764800a850 con 0x7f7650158af0 2024-08-17T02:47:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.240+0000 7f7643e00640 1 -- 172.21.15.5:0/4226201735 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764800ac10 con 0x7f7650158af0 2024-08-17T02:47:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.241+0000 7f7655e00640 1 -- 172.21.15.5:0/4226201735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7650154c20 con 0x7f7650158af0 2024-08-17T02:47:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.241+0000 7f7655e00640 1 -- 172.21.15.5:0/4226201735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76501551a0 con 0x7f7650158af0 2024-08-17T02:47:58.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.242+0000 7f7655e00640 1 -- 172.21.15.5:0/4226201735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76501556a0 con 0x7f7650158af0 2024-08-17T02:47:58.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.243+0000 7f7643e00640 1 -- 172.21.15.5:0/4226201735 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7648007300 con 0x7f7650158af0 2024-08-17T02:47:58.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.243+0000 7f7643e00640 1 --2- 172.21.15.5:0/4226201735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7630065150 0x7f7630067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:58.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.243+0000 7f7643e00640 1 -- 172.21.15.5:0/4226201735 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7648082420 con 0x7f7650158af0 2024-08-17T02:47:58.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.244+0000 7f7654a00640 1 --2- 172.21.15.5:0/4226201735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7630065150 0x7f7630067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:58.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.244+0000 7f7654a00640 1 --2- 172.21.15.5:0/4226201735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7630065150 0x7f7630067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7644034000 tx=0x7f7644032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.247+0000 7f7643e00640 1 -- 172.21.15.5:0/4226201735 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7648050610 con 0x7f7650158af0 2024-08-17T02:47:58.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.468+0000 7f7655e00640 1 -- 172.21.15.5:0/4226201735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7650070720 con 0x7f7650158af0 2024-08-17T02:47:58.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.468+0000 7f7643e00640 1 -- 172.21.15.5:0/4226201735 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7648053c30 con 0x7f7650158af0 2024-08-17T02:47:58.469 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:47:58.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.470+0000 7f7655e00640 1 -- 172.21.15.5:0/4226201735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7630065150 msgr2=0x7f7630067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:58.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.470+0000 7f7655e00640 1 --2- 172.21.15.5:0/4226201735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7630065150 0x7f7630067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7644034000 tx=0x7f7644032000 comp rx=0 tx=0).stop 2024-08-17T02:47:58.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.470+0000 7f7655e00640 1 -- 172.21.15.5:0/4226201735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650158af0 msgr2=0x7f765014bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:58.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.470+0000 7f7655e00640 1 --2- 172.21.15.5:0/4226201735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650158af0 0x7f765014bae0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f764800cc40 tx=0x7f7648001a50 comp rx=0 tx=0).stop 2024-08-17T02:47:58.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.470+0000 7f7655e00640 1 -- 172.21.15.5:0/4226201735 shutdown_connections 2024-08-17T02:47:58.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.470+0000 7f7655e00640 1 --2- 172.21.15.5:0/4226201735 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7630065150 0x7f7630067600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:58.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.470+0000 7f7655e00640 1 --2- 172.21.15.5:0/4226201735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650158af0 0x7f765014bae0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:58.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.470+0000 7f7655e00640 1 --2- 172.21.15.5:0/4226201735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76500c8290 0x7f76500c1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.470+0000 7f7655e00640 1 --2- 172.21.15.5:0/4226201735 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76500aca30 0x7f7650153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.470+0000 7f7655e00640 1 -- 172.21.15.5:0/4226201735 >> 172.21.15.5:0/4226201735 conn(0x7f76500cc060 msgr2=0x7f76500af050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.471+0000 7f7655e00640 1 -- 172.21.15.5:0/4226201735 shutdown_connections 2024-08-17T02:47:58.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:58.471+0000 7f7655e00640 1 -- 172.21.15.5:0/4226201735 wait complete. 2024-08-17T02:47:58.487 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:47:58.487 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:47:58.487 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-08-17T02:47:58.487 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:47:58.487 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:58.487 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:47:58.487 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:47:58.488 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:47:58.488 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:47:58.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:58.488 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-08-17T02:47:58.524 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:58.524 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:58.524 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:58.524 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:58.525 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:58.525 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:58.525 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:58.525 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:58.525 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2024-08-17T02:47:58.525 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:58.525 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:58.525 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2024-08-17T02:47:58.525 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:58.525 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:58.525 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:47:58.525 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:58.525 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:47:58.525 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42634sec preferred_lft 42634sec 2024-08-17T02:47:58.526 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link 2024-08-17T02:47:58.526 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:58.526 INFO:teuthology.orchestra.run.smithi107.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:58.526 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 3a:4a:5d:80:52:c3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:58.526 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:47:58.526 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:58.526 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::30e2:8fff:fe84:782/64 scope link 2024-08-17T02:47:58.526 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:58.526 INFO:teuthology.orchestra.run.smithi107.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:47:58.526 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 3a:4a:5d:80:52:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:47:58.526 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::384a:5dff:fe80:52c3/64 scope link 2024-08-17T02:47:58.526 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:58.527 INFO:teuthology.orchestra.run.smithi107.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:47:58.527 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether e2:92:73:b2:de:7e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:47:58.527 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::e092:73ff:feb2:de7e/64 scope link 2024-08-17T02:47:58.527 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:58.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:58.527 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:47:58.619 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-08-17T02:47:58.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:58.623 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-08-17T02:47:58.662 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-08-17T02:47:58.662 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:47:58.662 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:47:58.662 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:47:58.662 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:47:58.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:58.663 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-08-17T02:47:58.663 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-08-17T02:47:58.663 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:47:58.663 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:47:58.663 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:47:58.663 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-08-17T02:47:58.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:58.815 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-08-17T02:47:58.853 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:47:58.854 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:47:58.854 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:47:58.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:58.854 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.0 up 2024-08-17T02:47:58.950 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:58.951 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:58.985 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:47:58.986 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:58.986 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:59.060 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:47:59.060 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:47:59.060 DEBUG:teuthology.orchestra.run.smithi107:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:59.185 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:59.185 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:59.211 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:59.212 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:59.212 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-08-17T02:47:59.212 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: trying mount with new device syntax: 1@c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3.cephfs=/ 2024-08-17T02:47:59.212 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.107:3300/172.21.15.107:3301" will pass to kernel 2024-08-17T02:47:59.213 INFO:teuthology.orchestra.run.smithi107.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:47:59.213 INFO:teuthology.orchestra.run.smithi107.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:47:59.213 INFO:teuthology.orchestra.run.smithi107.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:47:59.213 INFO:teuthology.orchestra.run.smithi107.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:47:59.213 INFO:teuthology.orchestra.run.smithi107.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:47:59.216 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:47:59.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:59.217 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:59.274 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:47:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.429+0000 7f6a4aa00640 1 Processor -- start 2024-08-17T02:47:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.429+0000 7f6a4aa00640 1 -- start start 2024-08-17T02:47:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.430+0000 7f6a4aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a44156a90 0x7f6a440ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.431+0000 7f6a4aa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a440adba0 0x7f6a440ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.431+0000 7f6a4aa00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a441582b0 con 0x7f6a440aed30 2024-08-17T02:47:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.431+0000 7f6a4aa00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a440c9f80 con 0x7f6a44156a90 2024-08-17T02:47:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.431+0000 7f6a4aa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440ca110 con 0x7f6a440adba0 2024-08-17T02:47:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.431+0000 7f6a43e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a44156a90 0x7f6a440ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.431+0000 7f6a43e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a44156a90 0x7f6a440ad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42432/0 (socket says 172.21.15.5:42432) 2024-08-17T02:47:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.431+0000 7f6a43e00640 1 -- 172.21.15.5:0/3352694636 learned_addr learned my addr 172.21.15.5:0/3352694636 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.431+0000 7f6a3b400640 1 --2- 172.21.15.5:0/3352694636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a440adba0 0x7f6a440ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.431+0000 7f6a43e00640 1 -- 172.21.15.5:0/3352694636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a440adba0 msgr2=0x7f6a440ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.431+0000 7f6a43e00640 1 --2- 172.21.15.5:0/3352694636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a440adba0 0x7f6a440ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.431+0000 7f6a43e00640 1 -- 172.21.15.5:0/3352694636 >> v1:172.21.15.107:6789/0 conn(0x7f6a440aed30 legacy=0x7f6a4406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.431+0000 7f6a43e00640 1 -- 172.21.15.5:0/3352694636 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a440adff0 con 0x7f6a44156a90 2024-08-17T02:47:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.432+0000 7f6a43e00640 1 --2- 172.21.15.5:0/3352694636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a44156a90 0x7f6a440ad660 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009f20 tx=0x7f6a34009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83afbd227e97a618 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.433+0000 7f6a43400640 1 -- 172.21.15.5:0/3352694636 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34033410 con 0x7f6a44156a90 2024-08-17T02:47:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.433+0000 7f6a43400640 1 -- 172.21.15.5:0/3352694636 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a34033570 con 0x7f6a44156a90 2024-08-17T02:47:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.433+0000 7f6a43400640 1 -- 172.21.15.5:0/3352694636 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34033950 con 0x7f6a44156a90 2024-08-17T02:47:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.433+0000 7f6a4aa00640 1 -- 172.21.15.5:0/3352694636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a44156a90 msgr2=0x7f6a440ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.433+0000 7f6a4aa00640 1 --2- 172.21.15.5:0/3352694636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a44156a90 0x7f6a440ad660 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009f20 tx=0x7f6a34009840 comp rx=0 tx=0).stop 2024-08-17T02:47:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.433+0000 7f6a4aa00640 1 -- 172.21.15.5:0/3352694636 shutdown_connections 2024-08-17T02:47:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.433+0000 7f6a4aa00640 1 --2- 172.21.15.5:0/3352694636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a440adba0 0x7f6a440ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.433+0000 7f6a4aa00640 1 --2- 172.21.15.5:0/3352694636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a44156a90 0x7f6a440ad660 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.433+0000 7f6a4aa00640 1 -- 172.21.15.5:0/3352694636 >> 172.21.15.5:0/3352694636 conn(0x7f6a44066e60 msgr2=0x7f6a44067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.434+0000 7f6a4aa00640 1 -- 172.21.15.5:0/3352694636 shutdown_connections 2024-08-17T02:47:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.434+0000 7f6a4aa00640 1 -- 172.21.15.5:0/3352694636 wait complete. 2024-08-17T02:47:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.435+0000 7f6a4aa00640 1 Processor -- start 2024-08-17T02:47:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.435+0000 7f6a4aa00640 1 -- start start 2024-08-17T02:47:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.436+0000 7f6a4aa00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a440adba0 0x7f6a44152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.436+0000 7f6a4aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a440aed30 0x7f6a4415b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.436+0000 7f6a4aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a44156a90 0x7f6a4416c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.436+0000 7f6a4aa00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a44154190 con 0x7f6a440aed30 2024-08-17T02:47:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.436+0000 7f6a4aa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a441535c0 con 0x7f6a44156a90 2024-08-17T02:47:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.436+0000 7f6a4aa00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a44152bd0 con 0x7f6a440adba0 2024-08-17T02:47:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.436+0000 7f6a3b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a440aed30 0x7f6a4415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.436+0000 7f6a3b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a440aed30 0x7f6a4415b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42444/0 (socket says 172.21.15.5:42444) 2024-08-17T02:47:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.436+0000 7f6a3b400640 1 -- 172.21.15.5:0/2362847110 learned_addr learned my addr 172.21.15.5:0/2362847110 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.436+0000 7f6a43e00640 1 --2- 172.21.15.5:0/2362847110 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a440adba0 0x7f6a44152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.437+0000 7f6a48a00640 1 --2- 172.21.15.5:0/2362847110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a44156a90 0x7f6a4416c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.437+0000 7f6a3b400640 1 -- 172.21.15.5:0/2362847110 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a440adba0 msgr2=0x7f6a44152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.437+0000 7f6a3b400640 1 --2- 172.21.15.5:0/2362847110 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a440adba0 0x7f6a44152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.437+0000 7f6a3b400640 1 -- 172.21.15.5:0/2362847110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a44156a90 msgr2=0x7f6a4416c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.437+0000 7f6a3b400640 1 --2- 172.21.15.5:0/2362847110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a44156a90 0x7f6a4416c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.437+0000 7f6a3b400640 1 -- 172.21.15.5:0/2362847110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34009ae0 con 0x7f6a440aed30 2024-08-17T02:47:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.437+0000 7f6a3b400640 1 --2- 172.21.15.5:0/2362847110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a440aed30 0x7f6a4415b530 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00d890 tx=0x7f6a2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.437+0000 7f6a3be00640 1 -- 172.21.15.5:0/2362847110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00de20 con 0x7f6a440aed30 2024-08-17T02:47:59.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.438+0000 7f6a3be00640 1 -- 172.21.15.5:0/2362847110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c00b8d0 con 0x7f6a440aed30 2024-08-17T02:47:59.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.438+0000 7f6a3be00640 1 -- 172.21.15.5:0/2362847110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00bc70 con 0x7f6a440aed30 2024-08-17T02:47:59.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.438+0000 7f6a4aa00640 1 -- 172.21.15.5:0/2362847110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a44153860 con 0x7f6a440aed30 2024-08-17T02:47:59.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.438+0000 7f6a4aa00640 1 -- 172.21.15.5:0/2362847110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a44153e20 con 0x7f6a440aed30 2024-08-17T02:47:59.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.439+0000 7f6a4aa00640 1 -- 172.21.15.5:0/2362847110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a44154340 con 0x7f6a440aed30 2024-08-17T02:47:59.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.440+0000 7f6a3be00640 1 -- 172.21.15.5:0/2362847110 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6a2c014640 con 0x7f6a440aed30 2024-08-17T02:47:59.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.440+0000 7f6a3be00640 1 --2- 172.21.15.5:0/2362847110 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6a20065150 0x7f6a20067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:59.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.441+0000 7f6a3be00640 1 -- 172.21.15.5:0/2362847110 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a2c082a00 con 0x7f6a440aed30 2024-08-17T02:47:59.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.441+0000 7f6a43e00640 1 --2- 172.21.15.5:0/2362847110 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6a20065150 0x7f6a20067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:59.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.442+0000 7f6a43e00640 1 --2- 172.21.15.5:0/2362847110 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6a20065150 0x7f6a20067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6a34034000 tx=0x7f6a34037000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.445+0000 7f6a3be00640 1 -- 172.21.15.5:0/2362847110 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6a44154340 con 0x7f6a440aed30 2024-08-17T02:47:59.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.665+0000 7f6a4aa00640 1 -- 172.21.15.5:0/2362847110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6a44063fb0 con 0x7f6a440aed30 2024-08-17T02:47:59.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.731+0000 7f6a3be00640 1 -- 172.21.15.5:0/2362847110 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 136+0+0 (secure 0 0 0) 0x7f6a2c050b90 con 0x7f6a440aed30 2024-08-17T02:47:59.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.734+0000 7f6a4aa00640 1 -- 172.21.15.5:0/2362847110 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6a20065150 msgr2=0x7f6a20067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:59.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.734+0000 7f6a4aa00640 1 --2- 172.21.15.5:0/2362847110 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6a20065150 0x7f6a20067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6a34034000 tx=0x7f6a34037000 comp rx=0 tx=0).stop 2024-08-17T02:47:59.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.734+0000 7f6a4aa00640 1 -- 172.21.15.5:0/2362847110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a440aed30 msgr2=0x7f6a4415b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:59.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.734+0000 7f6a4aa00640 1 --2- 172.21.15.5:0/2362847110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a440aed30 0x7f6a4415b530 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00d890 tx=0x7f6a2c008040 comp rx=0 tx=0).stop 2024-08-17T02:47:59.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.734+0000 7f6a4aa00640 1 -- 172.21.15.5:0/2362847110 shutdown_connections 2024-08-17T02:47:59.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.734+0000 7f6a4aa00640 1 --2- 172.21.15.5:0/2362847110 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6a20065150 0x7f6a20067600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:59.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.734+0000 7f6a4aa00640 1 --2- 172.21.15.5:0/2362847110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a44156a90 0x7f6a4416c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:59.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.734+0000 7f6a4aa00640 1 --2- 172.21.15.5:0/2362847110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a440aed30 0x7f6a4415b530 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:59.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.734+0000 7f6a4aa00640 1 --2- 172.21.15.5:0/2362847110 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a440adba0 0x7f6a44152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:59.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.734+0000 7f6a4aa00640 1 -- 172.21.15.5:0/2362847110 >> 172.21.15.5:0/2362847110 conn(0x7f6a44066e60 msgr2=0x7f6a44158440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:59.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.734+0000 7f6a4aa00640 1 -- 172.21.15.5:0/2362847110 shutdown_connections 2024-08-17T02:47:59.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.734+0000 7f6a4aa00640 1 -- 172.21.15.5:0/2362847110 wait complete. 2024-08-17T02:47:59.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:47:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.903+0000 7fa9a0000640 1 Processor -- start 2024-08-17T02:47:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.903+0000 7fa9a0000640 1 -- start start 2024-08-17T02:47:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.904+0000 7fa9a0000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa9980add30 0x7fa998156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.904+0000 7fa9a0000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9980cb160 con 0x7fa9980ad960 2024-08-17T02:47:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.904+0000 7fa9a0000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9980b0d10 con 0x7fa9980ca050 2024-08-17T02:47:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.904+0000 7fa9a0000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9980ca550 con 0x7fa9980add30 2024-08-17T02:47:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.905+0000 7fa99e000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa9980add30 0x7fa998156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.905+0000 7fa99e000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa9980add30 0x7fa998156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42448/0 (socket says 172.21.15.5:42448) 2024-08-17T02:47:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.905+0000 7fa99e000640 1 -- 172.21.15.5:0/2062877721 learned_addr learned my addr 172.21.15.5:0/2062877721 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:59.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.905+0000 7fa99d600640 1 --1- 172.21.15.5:0/2062877721 >> v1:172.21.15.5:6789/0 conn(0x7fa9980ad960 0x7fa998156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46574/0 (socket says 172.21.15.5:46574) 2024-08-17T02:47:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.905+0000 7fa99e000640 1 -- 172.21.15.5:0/2062877721 >> v1:172.21.15.107:6789/0 conn(0x7fa9980ca050 legacy=0x7fa9980aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.905+0000 7fa99e000640 1 -- 172.21.15.5:0/2062877721 >> v1:172.21.15.5:6789/0 conn(0x7fa9980ad960 legacy=0x7fa998156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.905+0000 7fa99e000640 1 -- 172.21.15.5:0/2062877721 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9980ca830 con 0x7fa9980add30 2024-08-17T02:47:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.905+0000 7fa997e00640 1 -- 172.21.15.5:0/2062877721 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970885987 0 0) 0x7fa9980cb160 con 0x7fa9980ad960 2024-08-17T02:47:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.906+0000 7fa99e000640 1 --2- 172.21.15.5:0/2062877721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9980add30 0x7fa998156b30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa990009f20 tx=0x7fa990009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb3d1e41064e51 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.906+0000 7fa997e00640 1 -- 172.21.15.5:0/2062877721 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990007400 con 0x7fa9980add30 2024-08-17T02:47:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.907+0000 7fa997e00640 1 -- 172.21.15.5:0/2062877721 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa990007560 con 0x7fa9980add30 2024-08-17T02:47:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.907+0000 7fa997e00640 1 -- 172.21.15.5:0/2062877721 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990007900 con 0x7fa9980add30 2024-08-17T02:47:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.907+0000 7fa9a0000640 1 -- 172.21.15.5:0/2062877721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9980add30 msgr2=0x7fa998156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.907+0000 7fa9a0000640 1 --2- 172.21.15.5:0/2062877721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9980add30 0x7fa998156b30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa990009f20 tx=0x7fa990009840 comp rx=0 tx=0).stop 2024-08-17T02:47:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.907+0000 7fa9a0000640 1 -- 172.21.15.5:0/2062877721 shutdown_connections 2024-08-17T02:47:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.907+0000 7fa9a0000640 1 --2- 172.21.15.5:0/2062877721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9980add30 0x7fa998156b30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.907+0000 7fa9a0000640 1 -- 172.21.15.5:0/2062877721 >> 172.21.15.5:0/2062877721 conn(0x7fa998066e60 msgr2=0x7fa998067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.907+0000 7fa9a0000640 1 -- 172.21.15.5:0/2062877721 shutdown_connections 2024-08-17T02:47:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.907+0000 7fa9a0000640 1 -- 172.21.15.5:0/2062877721 wait complete. 2024-08-17T02:47:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.909+0000 7fa9a0000640 1 Processor -- start 2024-08-17T02:47:59.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.909+0000 7fa9a0000640 1 -- start start 2024-08-17T02:47:59.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.910+0000 7fa9a0000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9980ad960 0x7fa99813e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:59.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.910+0000 7fa9a0000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9980add30 0x7fa9980ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:59.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.910+0000 7fa9a0000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9980ca050 0x7fa9980acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:59.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.910+0000 7fa9a0000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa998143700 con 0x7fa9980ca050 2024-08-17T02:47:59.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.910+0000 7fa9a0000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9981439e0 con 0x7fa9980ad960 2024-08-17T02:47:59.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.910+0000 7fa9a0000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa998143cc0 con 0x7fa9980add30 2024-08-17T02:47:59.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.910+0000 7fa99e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9980ca050 0x7fa9980acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:59.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.910+0000 7fa99e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9980ca050 0x7fa9980acd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42452/0 (socket says 172.21.15.5:42452) 2024-08-17T02:47:59.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.910+0000 7fa99e000640 1 -- 172.21.15.5:0/1628533275 learned_addr learned my addr 172.21.15.5:0/1628533275 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:47:59.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.910+0000 7fa99d600640 1 --2- 172.21.15.5:0/1628533275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9980ad960 0x7fa99813e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:59.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.910+0000 7fa99cc00640 1 --2- 172.21.15.5:0/1628533275 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9980add30 0x7fa9980ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:59.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.911+0000 7fa99e000640 1 -- 172.21.15.5:0/1628533275 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9980add30 msgr2=0x7fa9980ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:59.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.911+0000 7fa99e000640 1 --2- 172.21.15.5:0/1628533275 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9980add30 0x7fa9980ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:59.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.911+0000 7fa99e000640 1 -- 172.21.15.5:0/1628533275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9980ad960 msgr2=0x7fa99813e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:59.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.911+0000 7fa99e000640 1 --2- 172.21.15.5:0/1628533275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9980ad960 0x7fa99813e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:59.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.911+0000 7fa99e000640 1 -- 172.21.15.5:0/1628533275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa990009ae0 con 0x7fa9980ca050 2024-08-17T02:47:59.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.911+0000 7fa99e000640 1 --2- 172.21.15.5:0/1628533275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9980ca050 0x7fa9980acd00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa990009ab0 tx=0x7fa990037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:59.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.911+0000 7fa994c00640 1 -- 172.21.15.5:0/1628533275 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990030cf0 con 0x7fa9980ca050 2024-08-17T02:47:59.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.911+0000 7fa994c00640 1 -- 172.21.15.5:0/1628533275 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99003f070 con 0x7fa9980ca050 2024-08-17T02:47:59.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.911+0000 7fa9a0000640 1 -- 172.21.15.5:0/1628533275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa998143fa0 con 0x7fa9980ca050 2024-08-17T02:47:59.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.911+0000 7fa994c00640 1 -- 172.21.15.5:0/1628533275 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990044660 con 0x7fa9980ca050 2024-08-17T02:47:59.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.912+0000 7fa9a0000640 1 -- 172.21.15.5:0/1628533275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99813ede0 con 0x7fa9980ca050 2024-08-17T02:47:59.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.913+0000 7fa9a0000640 1 -- 172.21.15.5:0/1628533275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9981444a0 con 0x7fa9980ca050 2024-08-17T02:47:59.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.913+0000 7fa994c00640 1 -- 172.21.15.5:0/1628533275 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa990041030 con 0x7fa9980ca050 2024-08-17T02:47:59.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.914+0000 7fa994c00640 1 --2- 172.21.15.5:0/1628533275 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa978065150 0x7fa978067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:59.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.914+0000 7fa994c00640 1 -- 172.21.15.5:0/1628533275 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa99002d070 con 0x7fa9980ca050 2024-08-17T02:47:59.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.914+0000 7fa99d600640 1 --2- 172.21.15.5:0/1628533275 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa978065150 0x7fa978067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:59.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.915+0000 7fa99d600640 1 --2- 172.21.15.5:0/1628533275 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa978065150 0x7fa978067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa98c000c00 tx=0x7fa98c007e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:59.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:47:59.918+0000 7fa994c00640 1 -- 172.21.15.5:0/1628533275 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa990071ed0 con 0x7fa9980ca050 2024-08-17T02:48:00.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.130+0000 7fa9a0000640 1 -- 172.21.15.5:0/1628533275 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa998063fb0 con 0x7fa978065150 2024-08-17T02:48:00.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.131+0000 7fa994c00640 1 -- 172.21.15.5:0/1628533275 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fa998063fb0 con 0x7fa978065150 2024-08-17T02:48:00.131 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-17T02:48:00.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:48:00.131 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2024-08-17T02:48:00.132 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:48:00.132 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-17T02:48:00.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.133+0000 7fa9a0000640 1 -- 172.21.15.5:0/1628533275 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa978065150 msgr2=0x7fa978067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:00.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.133+0000 7fa9a0000640 1 --2- 172.21.15.5:0/1628533275 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa978065150 0x7fa978067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa98c000c00 tx=0x7fa98c007e40 comp rx=0 tx=0).stop 2024-08-17T02:48:00.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.133+0000 7fa9a0000640 1 -- 172.21.15.5:0/1628533275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9980ca050 msgr2=0x7fa9980acd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:00.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.133+0000 7fa9a0000640 1 --2- 172.21.15.5:0/1628533275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9980ca050 0x7fa9980acd00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa990009ab0 tx=0x7fa990037000 comp rx=0 tx=0).stop 2024-08-17T02:48:00.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.133+0000 7fa9a0000640 1 -- 172.21.15.5:0/1628533275 shutdown_connections 2024-08-17T02:48:00.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.133+0000 7fa9a0000640 1 --2- 172.21.15.5:0/1628533275 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa978065150 0x7fa978067600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.133+0000 7fa9a0000640 1 --2- 172.21.15.5:0/1628533275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9980ca050 0x7fa9980acd00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.133+0000 7fa9a0000640 1 --2- 172.21.15.5:0/1628533275 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa9980add30 0x7fa9980ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.133+0000 7fa9a0000640 1 --2- 172.21.15.5:0/1628533275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa9980ad960 0x7fa99813e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.133+0000 7fa9a0000640 1 -- 172.21.15.5:0/1628533275 >> 172.21.15.5:0/1628533275 conn(0x7fa998066e60 msgr2=0x7fa998153510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:00.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.133+0000 7fa9a0000640 1 -- 172.21.15.5:0/1628533275 shutdown_connections 2024-08-17T02:48:00.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.133+0000 7fa9a0000640 1 -- 172.21.15.5:0/1628533275 wait complete. 2024-08-17T02:48:00.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:48:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.303+0000 7fa169600640 1 Processor -- start 2024-08-17T02:48:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.304+0000 7fa169600640 1 -- start start 2024-08-17T02:48:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.305+0000 7fa169600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa164158a40 0x7fa1640abe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.305+0000 7fa169600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa1640ac380 0x7fa1640af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.305+0000 7fa169600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1640686f0 con 0x7fa1640af7e0 2024-08-17T02:48:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.305+0000 7fa169600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1640ac800 con 0x7fa164158a40 2024-08-17T02:48:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.305+0000 7fa169600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1640b0270 con 0x7fa1640ac380 2024-08-17T02:48:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.305+0000 7fa163e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa164158a40 0x7fa1640abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.305+0000 7fa163e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa164158a40 0x7fa1640abe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42464/0 (socket says 172.21.15.5:42464) 2024-08-17T02:48:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.305+0000 7fa163e00640 1 -- 172.21.15.5:0/3120241786 learned_addr learned my addr 172.21.15.5:0/3120241786 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:48:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.305+0000 7fa15be00640 1 --2- 172.21.15.5:0/3120241786 >> v2:172.21.15.107:3300/0 conn(0x7fa1640ac380 0x7fa1640af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.306+0000 7fa163e00640 1 -- 172.21.15.5:0/3120241786 >> v2:172.21.15.107:3300/0 conn(0x7fa1640ac380 msgr2=0x7fa1640af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.306+0000 7fa163e00640 1 --2- 172.21.15.5:0/3120241786 >> v2:172.21.15.107:3300/0 conn(0x7fa1640ac380 0x7fa1640af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.306+0000 7fa163e00640 1 -- 172.21.15.5:0/3120241786 >> v1:172.21.15.107:6789/0 conn(0x7fa1640af7e0 legacy=0x7fa1640aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.306+0000 7fa163e00640 1 -- 172.21.15.5:0/3120241786 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1640aff90 con 0x7fa164158a40 2024-08-17T02:48:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.307+0000 7fa163e00640 1 --2- 172.21.15.5:0/3120241786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa164158a40 0x7fa1640abe40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa16406b0b0 tx=0x7fa1540091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18641c964791a1ad server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.307+0000 7fa163400640 1 -- 172.21.15.5:0/3120241786 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15402ad40 con 0x7fa164158a40 2024-08-17T02:48:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.307+0000 7fa163400640 1 -- 172.21.15.5:0/3120241786 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa154032440 con 0x7fa164158a40 2024-08-17T02:48:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.307+0000 7fa163400640 1 -- 172.21.15.5:0/3120241786 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15402aea0 con 0x7fa164158a40 2024-08-17T02:48:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.307+0000 7fa169600640 1 -- 172.21.15.5:0/3120241786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa164158a40 msgr2=0x7fa1640abe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.307+0000 7fa169600640 1 --2- 172.21.15.5:0/3120241786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa164158a40 0x7fa1640abe40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa16406b0b0 tx=0x7fa1540091d0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.307+0000 7fa169600640 1 -- 172.21.15.5:0/3120241786 shutdown_connections 2024-08-17T02:48:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.307+0000 7fa169600640 1 --2- 172.21.15.5:0/3120241786 >> v2:172.21.15.107:3300/0 conn(0x7fa1640ac380 0x7fa1640af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.307+0000 7fa169600640 1 --2- 172.21.15.5:0/3120241786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa164158a40 0x7fa1640abe40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.307+0000 7fa169600640 1 -- 172.21.15.5:0/3120241786 >> 172.21.15.5:0/3120241786 conn(0x7fa1640ce400 msgr2=0x7fa164095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.308+0000 7fa169600640 1 -- 172.21.15.5:0/3120241786 shutdown_connections 2024-08-17T02:48:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.308+0000 7fa169600640 1 -- 172.21.15.5:0/3120241786 wait complete. 2024-08-17T02:48:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.309+0000 7fa169600640 1 Processor -- start 2024-08-17T02:48:00.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.309+0000 7fa169600640 1 -- start start 2024-08-17T02:48:00.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.310+0000 7fa169600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1640ac380 0x7fa1641443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:00.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.310+0000 7fa169600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1640af7e0 0x7fa164169030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:00.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.310+0000 7fa169600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa164158a40 0x7fa164156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:00.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.310+0000 7fa169600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa164097720 con 0x7fa1640ac380 2024-08-17T02:48:00.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.310+0000 7fa169600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa164169af0 con 0x7fa1640af7e0 2024-08-17T02:48:00.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.310+0000 7fa169600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa164169dd0 con 0x7fa164158a40 2024-08-17T02:48:00.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.310+0000 7fa163e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1640ac380 0x7fa1641443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:00.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.310+0000 7fa163e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1640ac380 0x7fa1641443a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42470/0 (socket says 172.21.15.5:42470) 2024-08-17T02:48:00.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.310+0000 7fa163e00640 1 -- 172.21.15.5:0/2082354879 learned_addr learned my addr 172.21.15.5:0/2082354879 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:48:00.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.310+0000 7fa15be00640 1 --2- 172.21.15.5:0/2082354879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1640af7e0 0x7fa164169030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:00.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.310+0000 7fa168c00640 1 --2- 172.21.15.5:0/2082354879 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa164158a40 0x7fa164156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:00.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.311+0000 7fa163e00640 1 -- 172.21.15.5:0/2082354879 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa164158a40 msgr2=0x7fa164156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:00.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.311+0000 7fa163e00640 1 --2- 172.21.15.5:0/2082354879 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa164158a40 0x7fa164156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.311+0000 7fa163e00640 1 -- 172.21.15.5:0/2082354879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1640af7e0 msgr2=0x7fa164169030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:00.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.311+0000 7fa163e00640 1 --2- 172.21.15.5:0/2082354879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1640af7e0 0x7fa164169030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.311+0000 7fa163e00640 1 -- 172.21.15.5:0/2082354879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa154009450 con 0x7fa1640ac380 2024-08-17T02:48:00.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.311+0000 7fa163e00640 1 --2- 172.21.15.5:0/2082354879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1640ac380 0x7fa1641443a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa154035040 tx=0x7fa154032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:00.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.311+0000 7fa15b400640 1 -- 172.21.15.5:0/2082354879 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa154031880 con 0x7fa1640ac380 2024-08-17T02:48:00.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.311+0000 7fa15b400640 1 -- 172.21.15.5:0/2082354879 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa154031a20 con 0x7fa1640ac380 2024-08-17T02:48:00.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.311+0000 7fa15b400640 1 -- 172.21.15.5:0/2082354879 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa154031e20 con 0x7fa1640ac380 2024-08-17T02:48:00.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.311+0000 7fa169600640 1 -- 172.21.15.5:0/2082354879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa164097900 con 0x7fa1640ac380 2024-08-17T02:48:00.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.312+0000 7fa169600640 1 -- 172.21.15.5:0/2082354879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1641448e0 con 0x7fa1640ac380 2024-08-17T02:48:00.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.313+0000 7fa169600640 1 -- 172.21.15.5:0/2082354879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa16416a010 con 0x7fa1640ac380 2024-08-17T02:48:00.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.313+0000 7fa15b400640 1 -- 172.21.15.5:0/2082354879 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa154039040 con 0x7fa1640ac380 2024-08-17T02:48:00.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.314+0000 7fa15b400640 1 --2- 172.21.15.5:0/2082354879 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa140065180 0x7fa140067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:00.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.314+0000 7fa15b400640 1 -- 172.21.15.5:0/2082354879 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa1540a1f30 con 0x7fa1640ac380 2024-08-17T02:48:00.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.314+0000 7fa15be00640 1 --2- 172.21.15.5:0/2082354879 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa140065180 0x7fa140067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:00.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.315+0000 7fa15be00640 1 --2- 172.21.15.5:0/2082354879 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa140065180 0x7fa140067630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa164096920 tx=0x7fa14c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:00.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.318+0000 7fa15b400640 1 -- 172.21.15.5:0/2082354879 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa16416a010 con 0x7fa1640ac380 2024-08-17T02:48:00.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.504+0000 7fa169600640 1 -- 172.21.15.5:0/2082354879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa16416a010 con 0x7fa1640ac380 2024-08-17T02:48:00.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.505+0000 7fa15b400640 1 -- 172.21.15.5:0/2082354879 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa16416a010 con 0x7fa1640ac380 2024-08-17T02:48:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.507+0000 7fa169600640 1 -- 172.21.15.5:0/2082354879 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa140065180 msgr2=0x7fa140067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.507+0000 7fa169600640 1 --2- 172.21.15.5:0/2082354879 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa140065180 0x7fa140067630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa164096920 tx=0x7fa14c008040 comp rx=0 tx=0).stop 2024-08-17T02:48:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.507+0000 7fa169600640 1 -- 172.21.15.5:0/2082354879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1640ac380 msgr2=0x7fa1641443a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:00.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.507+0000 7fa169600640 1 --2- 172.21.15.5:0/2082354879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1640ac380 0x7fa1641443a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa154035040 tx=0x7fa154032000 comp rx=0 tx=0).stop 2024-08-17T02:48:00.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.507+0000 7fa169600640 1 -- 172.21.15.5:0/2082354879 shutdown_connections 2024-08-17T02:48:00.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.507+0000 7fa169600640 1 --2- 172.21.15.5:0/2082354879 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa140065180 0x7fa140067630 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.507+0000 7fa169600640 1 --2- 172.21.15.5:0/2082354879 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa164158a40 0x7fa164156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.507+0000 7fa169600640 1 --2- 172.21.15.5:0/2082354879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1640af7e0 0x7fa164169030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.507+0000 7fa169600640 1 --2- 172.21.15.5:0/2082354879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1640ac380 0x7fa1641443a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.507+0000 7fa169600640 1 -- 172.21.15.5:0/2082354879 >> 172.21.15.5:0/2082354879 conn(0x7fa1640ce400 msgr2=0x7fa164095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:00.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.507+0000 7fa169600640 1 -- 172.21.15.5:0/2082354879 shutdown_connections 2024-08-17T02:48:00.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.507+0000 7fa169600640 1 -- 172.21.15.5:0/2082354879 wait complete. 2024-08-17T02:48:00.523 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000724543 2024-08-17T02:48:00.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.676+0000 7fa17ec00640 1 Processor -- start 2024-08-17T02:48:00.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.676+0000 7fa17ec00640 1 -- start start 2024-08-17T02:48:00.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.677+0000 7fa17ec00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa178158f20 0x7fa178062f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.677+0000 7fa17ec00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa17815a950 0x7fa1780a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.677+0000 7fa17ec00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa1780a9630 0x7fa1780679a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.677+0000 7fa17ec00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1780a9ab0 con 0x7fa17815a950 2024-08-17T02:48:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.677+0000 7fa17ec00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa178067510 con 0x7fa178158f20 2024-08-17T02:48:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.677+0000 7fa17ec00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa178066f00 con 0x7fa1780a9630 2024-08-17T02:48:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.677+0000 7fa16fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa17815a950 0x7fa1780a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.677+0000 7fa16fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa17815a950 0x7fa1780a90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42486/0 (socket says 172.21.15.5:42486) 2024-08-17T02:48:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.677+0000 7fa16fe00640 1 -- 172.21.15.5:0/1197045311 learned_addr learned my addr 172.21.15.5:0/1197045311 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:48:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.678+0000 7fa17cc00640 1 --2- 172.21.15.5:0/1197045311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa1780a9630 0x7fa1780679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.678+0000 7fa16fe00640 1 -- 172.21.15.5:0/1197045311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa1780a9630 msgr2=0x7fa1780679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.678+0000 7fa177e00640 1 --2- 172.21.15.5:0/1197045311 >> v2:172.21.15.107:3300/0 conn(0x7fa178158f20 0x7fa178062f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.678+0000 7fa16fe00640 1 --2- 172.21.15.5:0/1197045311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa1780a9630 0x7fa1780679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.678+0000 7fa16fe00640 1 -- 172.21.15.5:0/1197045311 >> v2:172.21.15.107:3300/0 conn(0x7fa178158f20 msgr2=0x7fa178062f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.678+0000 7fa16fe00640 1 --2- 172.21.15.5:0/1197045311 >> v2:172.21.15.107:3300/0 conn(0x7fa178158f20 0x7fa178062f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.678+0000 7fa16fe00640 1 -- 172.21.15.5:0/1197045311 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1780ccda0 con 0x7fa17815a950 2024-08-17T02:48:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.678+0000 7fa17cc00640 1 --2- 172.21.15.5:0/1197045311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa1780a9630 0x7fa1780679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:48:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.678+0000 7fa177e00640 1 --2- 172.21.15.5:0/1197045311 >> v2:172.21.15.107:3300/0 conn(0x7fa178158f20 0x7fa178062f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:48:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.679+0000 7fa16fe00640 1 --2- 172.21.15.5:0/1197045311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17815a950 0x7fa1780a90f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa178066dc0 tx=0x7fa1600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df08897c56d5e8c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:00.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.679+0000 7fa177400640 1 -- 172.21.15.5:0/1197045311 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16002add0 con 0x7fa17815a950 2024-08-17T02:48:00.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.679+0000 7fa177400640 1 -- 172.21.15.5:0/1197045311 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa160032440 con 0x7fa17815a950 2024-08-17T02:48:00.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.679+0000 7fa177400640 1 -- 172.21.15.5:0/1197045311 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160032820 con 0x7fa17815a950 2024-08-17T02:48:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.680+0000 7fa17ec00640 1 -- 172.21.15.5:0/1197045311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17815a950 msgr2=0x7fa1780a90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:00.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.680+0000 7fa17ec00640 1 --2- 172.21.15.5:0/1197045311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17815a950 0x7fa1780a90f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa178066dc0 tx=0x7fa1600091d0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.680+0000 7fa17ec00640 1 -- 172.21.15.5:0/1197045311 shutdown_connections 2024-08-17T02:48:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.680+0000 7fa17ec00640 1 --2- 172.21.15.5:0/1197045311 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa1780a9630 0x7fa1780679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.680+0000 7fa17ec00640 1 --2- 172.21.15.5:0/1197045311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17815a950 0x7fa1780a90f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.680+0000 7fa17ec00640 1 --2- 172.21.15.5:0/1197045311 >> v2:172.21.15.107:3300/0 conn(0x7fa178158f20 0x7fa178062f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.680+0000 7fa17ec00640 1 -- 172.21.15.5:0/1197045311 >> 172.21.15.5:0/1197045311 conn(0x7fa17806e5b0 msgr2=0x7fa1780b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.680+0000 7fa17ec00640 1 -- 172.21.15.5:0/1197045311 shutdown_connections 2024-08-17T02:48:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.680+0000 7fa17ec00640 1 -- 172.21.15.5:0/1197045311 wait complete. 2024-08-17T02:48:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.681+0000 7fa17ec00640 1 Processor -- start 2024-08-17T02:48:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.681+0000 7fa17ec00640 1 -- start start 2024-08-17T02:48:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.682+0000 7fa17ec00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa1780a9630 0x7fa1781519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.682+0000 7fa17ec00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa178158f20 0x7fa178150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.682+0000 7fa17ec00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17815a950 0x7fa17806b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.682+0000 7fa17ec00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa178152fa0 con 0x7fa17815a950 2024-08-17T02:48:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.682+0000 7fa17ec00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa178152390 con 0x7fa178158f20 2024-08-17T02:48:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.682+0000 7fa17ec00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa178152670 con 0x7fa1780a9630 2024-08-17T02:48:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.683+0000 7fa17cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17815a950 0x7fa17806b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.683+0000 7fa17cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17815a950 0x7fa17806b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42502/0 (socket says 172.21.15.5:42502) 2024-08-17T02:48:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.683+0000 7fa17cc00640 1 -- 172.21.15.5:0/2018462008 learned_addr learned my addr 172.21.15.5:0/2018462008 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:48:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.683+0000 7fa177e00640 1 --2- 172.21.15.5:0/2018462008 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa1780a9630 0x7fa1781519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.683+0000 7fa16fe00640 1 --2- 172.21.15.5:0/2018462008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa178158f20 0x7fa178150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.683+0000 7fa17cc00640 1 -- 172.21.15.5:0/2018462008 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa1780a9630 msgr2=0x7fa1781519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.683+0000 7fa17cc00640 1 --2- 172.21.15.5:0/2018462008 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa1780a9630 0x7fa1781519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.683+0000 7fa17cc00640 1 -- 172.21.15.5:0/2018462008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa178158f20 msgr2=0x7fa178150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.683+0000 7fa17cc00640 1 --2- 172.21.15.5:0/2018462008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa178158f20 0x7fa178150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.683+0000 7fa17cc00640 1 -- 172.21.15.5:0/2018462008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa160009450 con 0x7fa17815a950 2024-08-17T02:48:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.683+0000 7fa177e00640 1 --2- 172.21.15.5:0/2018462008 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa1780a9630 0x7fa1781519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:48:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.683+0000 7fa16fe00640 1 --2- 172.21.15.5:0/2018462008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa178158f20 0x7fa178150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:48:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.683+0000 7fa17cc00640 1 --2- 172.21.15.5:0/2018462008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17815a950 0x7fa17806b780 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa17000ce40 tx=0x7fa1700077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.684+0000 7fa16f400640 1 -- 172.21.15.5:0/2018462008 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170016420 con 0x7fa17815a950 2024-08-17T02:48:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.684+0000 7fa16f400640 1 -- 172.21.15.5:0/2018462008 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1700165a0 con 0x7fa17815a950 2024-08-17T02:48:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.684+0000 7fa16f400640 1 -- 172.21.15.5:0/2018462008 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170016960 con 0x7fa17815a950 2024-08-17T02:48:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.684+0000 7fa17ec00640 1 -- 172.21.15.5:0/2018462008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa178152950 con 0x7fa17815a950 2024-08-17T02:48:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.684+0000 7fa17ec00640 1 -- 172.21.15.5:0/2018462008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa178150fb0 con 0x7fa17815a950 2024-08-17T02:48:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.685+0000 7fa17ec00640 1 -- 172.21.15.5:0/2018462008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa178063fb0 con 0x7fa17815a950 2024-08-17T02:48:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.685+0000 7fa16f400640 1 -- 172.21.15.5:0/2018462008 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa170016cd0 con 0x7fa17815a950 2024-08-17T02:48:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.686+0000 7fa16f400640 1 --2- 172.21.15.5:0/2018462008 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa154065150 0x7fa154067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.686+0000 7fa16f400640 1 -- 172.21.15.5:0/2018462008 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa170012070 con 0x7fa17815a950 2024-08-17T02:48:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.687+0000 7fa177e00640 1 --2- 172.21.15.5:0/2018462008 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa154065150 0x7fa154067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.687+0000 7fa177e00640 1 --2- 172.21.15.5:0/2018462008 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa154065150 0x7fa154067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa178153750 tx=0x7fa168008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.690+0000 7fa16f400640 1 -- 172.21.15.5:0/2018462008 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa17004ee40 con 0x7fa17815a950 2024-08-17T02:48:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:00.896+0000 7fa17ec00640 1 -- 172.21.15.5:0/2018462008 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000724543", "target": ["mon-mgr", ""]}) v1 -- 0x7fa178169f60 con 0x7fa154065150 2024-08-17T02:48:03.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.759+0000 7fa16f400640 1 -- 172.21.15.5:0/2018462008 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7fa178169f60 con 0x7fa154065150 2024-08-17T02:48:03.760 INFO:teuthology.orchestra.run.smithi005.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:48:03.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.764+0000 7fa17ec00640 1 -- 172.21.15.5:0/2018462008 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa154065150 msgr2=0x7fa154067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:03.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.764+0000 7fa17ec00640 1 --2- 172.21.15.5:0/2018462008 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa154065150 0x7fa154067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa178153750 tx=0x7fa168008040 comp rx=0 tx=0).stop 2024-08-17T02:48:03.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.764+0000 7fa17ec00640 1 -- 172.21.15.5:0/2018462008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17815a950 msgr2=0x7fa17806b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:03.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.764+0000 7fa17ec00640 1 --2- 172.21.15.5:0/2018462008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17815a950 0x7fa17806b780 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa17000ce40 tx=0x7fa1700077d0 comp rx=0 tx=0).stop 2024-08-17T02:48:03.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.764+0000 7fa17ec00640 1 -- 172.21.15.5:0/2018462008 shutdown_connections 2024-08-17T02:48:03.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.764+0000 7fa17ec00640 1 --2- 172.21.15.5:0/2018462008 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa154065150 0x7fa154067600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:03.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.764+0000 7fa17ec00640 1 --2- 172.21.15.5:0/2018462008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa17815a950 0x7fa17806b780 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:03.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.764+0000 7fa17ec00640 1 --2- 172.21.15.5:0/2018462008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa178158f20 0x7fa178150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:03.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.764+0000 7fa17ec00640 1 --2- 172.21.15.5:0/2018462008 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa1780a9630 0x7fa1781519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:03.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.764+0000 7fa17ec00640 1 -- 172.21.15.5:0/2018462008 >> 172.21.15.5:0/2018462008 conn(0x7fa17806e5b0 msgr2=0x7fa1781592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:03.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.767+0000 7fa17ec00640 1 -- 172.21.15.5:0/2018462008 shutdown_connections 2024-08-17T02:48:03.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.768+0000 7fa17ec00640 1 -- 172.21.15.5:0/2018462008 wait complete. 2024-08-17T02:48:03.791 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:48:03.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.947+0000 7f9275e00640 1 Processor -- start 2024-08-17T02:48:03.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.948+0000 7f9275e00640 1 -- start start 2024-08-17T02:48:03.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.949+0000 7f9275e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f92700aed20 0x7f9270156d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:03.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.949+0000 7f9275e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f92700af0f0 0x7f92700cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:03.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.949+0000 7f9275e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927015b240 con 0x7f92700cc5a0 2024-08-17T02:48:03.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.949+0000 7f9275e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927015a630 con 0x7f92700af0f0 2024-08-17T02:48:03.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.949+0000 7f9275e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927015a910 con 0x7f92700aed20 2024-08-17T02:48:03.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.949+0000 7f926fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f92700af0f0 0x7f92700cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:03.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.949+0000 7f926fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f92700af0f0 0x7f92700cab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42512/0 (socket says 172.21.15.5:42512) 2024-08-17T02:48:03.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.949+0000 7f926fe00640 1 -- 172.21.15.5:0/776162498 learned_addr learned my addr 172.21.15.5:0/776162498 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:48:03.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.950+0000 7f9274a00640 1 --2- 172.21.15.5:0/776162498 >> v2:172.21.15.107:3300/0 conn(0x7f92700aed20 0x7f9270156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:03.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.950+0000 7f926fe00640 1 -- 172.21.15.5:0/776162498 >> v2:172.21.15.107:3300/0 conn(0x7f92700aed20 msgr2=0x7f9270156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:03.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.950+0000 7f926fe00640 1 --2- 172.21.15.5:0/776162498 >> v2:172.21.15.107:3300/0 conn(0x7f92700aed20 0x7f9270156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:03.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.950+0000 7f926fe00640 1 -- 172.21.15.5:0/776162498 >> v1:172.21.15.107:6789/0 conn(0x7f92700cc5a0 legacy=0x7f9270155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:03.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.950+0000 7f926fe00640 1 -- 172.21.15.5:0/776162498 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927015abf0 con 0x7f92700af0f0 2024-08-17T02:48:03.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.950+0000 7f9274a00640 1 --2- 172.21.15.5:0/776162498 >> v2:172.21.15.107:3300/0 conn(0x7f92700aed20 0x7f9270156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:48:03.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.951+0000 7f926fe00640 1 --2- 172.21.15.5:0/776162498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92700af0f0 0x7f92700cab10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9270067920 tx=0x7f925c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d56353d382b5307 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:03.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.951+0000 7f926f400640 1 -- 172.21.15.5:0/776162498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c02ad40 con 0x7f92700af0f0 2024-08-17T02:48:03.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.951+0000 7f926f400640 1 -- 172.21.15.5:0/776162498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c032440 con 0x7f92700af0f0 2024-08-17T02:48:03.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.951+0000 7f926f400640 1 -- 172.21.15.5:0/776162498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c02aea0 con 0x7f92700af0f0 2024-08-17T02:48:03.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.951+0000 7f9275e00640 1 -- 172.21.15.5:0/776162498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92700af0f0 msgr2=0x7f92700cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:03.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.951+0000 7f9275e00640 1 --2- 172.21.15.5:0/776162498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92700af0f0 0x7f92700cab10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9270067920 tx=0x7f925c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:48:03.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.952+0000 7f9275e00640 1 -- 172.21.15.5:0/776162498 shutdown_connections 2024-08-17T02:48:03.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.952+0000 7f9275e00640 1 --2- 172.21.15.5:0/776162498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92700af0f0 0x7f92700cab10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:03.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.952+0000 7f9275e00640 1 --2- 172.21.15.5:0/776162498 >> v2:172.21.15.107:3300/0 conn(0x7f92700aed20 0x7f9270156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:03.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.952+0000 7f9275e00640 1 -- 172.21.15.5:0/776162498 >> 172.21.15.5:0/776162498 conn(0x7f927006e590 msgr2=0x7f927006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:03.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.952+0000 7f9275e00640 1 -- 172.21.15.5:0/776162498 shutdown_connections 2024-08-17T02:48:03.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.952+0000 7f9275e00640 1 -- 172.21.15.5:0/776162498 wait complete. 2024-08-17T02:48:03.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.953+0000 7f9275e00640 1 Processor -- start 2024-08-17T02:48:03.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.953+0000 7f9275e00640 1 -- start start 2024-08-17T02:48:03.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.954+0000 7f9275e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92700aed20 0x7f92700b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:03.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.954+0000 7f9275e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92700af0f0 0x7f9270169a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:03.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.954+0000 7f9275e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f92700cc5a0 0x7f927014b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:03.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.954+0000 7f9275e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9270169fb0 con 0x7f92700aed20 2024-08-17T02:48:03.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.954+0000 7f9275e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92700b5770 con 0x7f92700af0f0 2024-08-17T02:48:03.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.954+0000 7f9275e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92700b51b0 con 0x7f92700cc5a0 2024-08-17T02:48:03.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.954+0000 7f9274a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92700aed20 0x7f92700b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:03.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.954+0000 7f9274a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92700aed20 0x7f92700b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42520/0 (socket says 172.21.15.5:42520) 2024-08-17T02:48:03.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.954+0000 7f9274a00640 1 -- 172.21.15.5:0/3862286546 learned_addr learned my addr 172.21.15.5:0/3862286546 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:48:03.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.954+0000 7f926fe00640 1 --2- 172.21.15.5:0/3862286546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92700af0f0 0x7f9270169a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:03.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.954+0000 7f9275400640 1 --2- 172.21.15.5:0/3862286546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f92700cc5a0 0x7f927014b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:03.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.955+0000 7f9274a00640 1 -- 172.21.15.5:0/3862286546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f92700cc5a0 msgr2=0x7f927014b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:03.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.955+0000 7f9274a00640 1 --2- 172.21.15.5:0/3862286546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f92700cc5a0 0x7f927014b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:03.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.955+0000 7f9274a00640 1 -- 172.21.15.5:0/3862286546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92700af0f0 msgr2=0x7f9270169a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:03.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.955+0000 7f9274a00640 1 --2- 172.21.15.5:0/3862286546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92700af0f0 0x7f9270169a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:03.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.955+0000 7f9274a00640 1 -- 172.21.15.5:0/3862286546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c009450 con 0x7f92700aed20 2024-08-17T02:48:03.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.955+0000 7f926fe00640 1 --2- 172.21.15.5:0/3862286546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92700af0f0 0x7f9270169a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:48:03.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.955+0000 7f9275400640 1 --2- 172.21.15.5:0/3862286546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f92700cc5a0 0x7f927014b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:48:03.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.955+0000 7f9274a00640 1 --2- 172.21.15.5:0/3862286546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92700aed20 0x7f92700b0410 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f926400c880 tx=0x7f9264008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:03.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.955+0000 7f9263e00640 1 -- 172.21.15.5:0/3862286546 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926400ce10 con 0x7f92700aed20 2024-08-17T02:48:03.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.955+0000 7f9263e00640 1 -- 172.21.15.5:0/3862286546 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9264007890 con 0x7f92700aed20 2024-08-17T02:48:03.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.955+0000 7f9275e00640 1 -- 172.21.15.5:0/3862286546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92700b5490 con 0x7f92700aed20 2024-08-17T02:48:03.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.955+0000 7f9263e00640 1 -- 172.21.15.5:0/3862286546 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264007c10 con 0x7f92700aed20 2024-08-17T02:48:03.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.956+0000 7f9275e00640 1 -- 172.21.15.5:0/3862286546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92700b0ea0 con 0x7f92700aed20 2024-08-17T02:48:03.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.956+0000 7f9275e00640 1 -- 172.21.15.5:0/3862286546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9270070720 con 0x7f92700aed20 2024-08-17T02:48:03.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.957+0000 7f9263e00640 1 -- 172.21.15.5:0/3862286546 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f92640113f0 con 0x7f92700aed20 2024-08-17T02:48:03.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.958+0000 7f9263e00640 1 --2- 172.21.15.5:0/3862286546 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9250065150 0x7f9250067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:03.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.958+0000 7f9263e00640 1 -- 172.21.15.5:0/3862286546 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f9264082780 con 0x7f92700aed20 2024-08-17T02:48:03.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.958+0000 7f926fe00640 1 --2- 172.21.15.5:0/3862286546 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9250065150 0x7f9250067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:03.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.959+0000 7f926fe00640 1 --2- 172.21.15.5:0/3862286546 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9250065150 0x7f9250067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f925c034000 tx=0x7f925c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:03.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:03.963+0000 7f9263e00640 1 -- 172.21.15.5:0/3862286546 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9264053f60 con 0x7f92700aed20 2024-08-17T02:48:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.173+0000 7f9275e00640 1 -- 172.21.15.5:0/3862286546 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f92700cd8b0 con 0x7f9250065150 2024-08-17T02:48:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.175+0000 7f9263e00640 1 -- 172.21.15.5:0/3862286546 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f92700cd8b0 con 0x7f9250065150 2024-08-17T02:48:04.175 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-17T02:48:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:48:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2024-08-17T02:48:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-17T02:48:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-17T02:48:04.175 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volume_0000000000724543" 2024-08-17T02:48:04.176 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-17T02:48:04.176 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-17T02:48:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.177+0000 7f9275e00640 1 -- 172.21.15.5:0/3862286546 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9250065150 msgr2=0x7f9250067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.177+0000 7f9275e00640 1 --2- 172.21.15.5:0/3862286546 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9250065150 0x7f9250067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f925c034000 tx=0x7f925c032000 comp rx=0 tx=0).stop 2024-08-17T02:48:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.177+0000 7f9275e00640 1 -- 172.21.15.5:0/3862286546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92700aed20 msgr2=0x7f92700b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.177+0000 7f9275e00640 1 --2- 172.21.15.5:0/3862286546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92700aed20 0x7f92700b0410 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f926400c880 tx=0x7f9264008040 comp rx=0 tx=0).stop 2024-08-17T02:48:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.177+0000 7f9275e00640 1 -- 172.21.15.5:0/3862286546 shutdown_connections 2024-08-17T02:48:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.177+0000 7f9275e00640 1 --2- 172.21.15.5:0/3862286546 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9250065150 0x7f9250067600 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.177+0000 7f9275e00640 1 --2- 172.21.15.5:0/3862286546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f92700cc5a0 0x7f927014b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.177+0000 7f9275e00640 1 --2- 172.21.15.5:0/3862286546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f92700af0f0 0x7f9270169a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.177+0000 7f9275e00640 1 --2- 172.21.15.5:0/3862286546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92700aed20 0x7f92700b0410 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.177+0000 7f9275e00640 1 -- 172.21.15.5:0/3862286546 >> 172.21.15.5:0/3862286546 conn(0x7f927006e590 msgr2=0x7f92700c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.177+0000 7f9275e00640 1 -- 172.21.15.5:0/3862286546 shutdown_connections 2024-08-17T02:48:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.177+0000 7f9275e00640 1 -- 172.21.15.5:0/3862286546 wait complete. 2024-08-17T02:48:04.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:48:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.345+0000 7f85aca00640 1 Processor -- start 2024-08-17T02:48:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.345+0000 7f85aca00640 1 -- start start 2024-08-17T02:48:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.347+0000 7f85aca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85a80acce0 0x7f85a80ad150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.347+0000 7f85aca00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f85a8156e50 0x7f85a8157290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.347+0000 7f85aca00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a80ad690 con 0x7f85a814c9e0 2024-08-17T02:48:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.347+0000 7f85aca00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a80696e0 con 0x7f85a80acce0 2024-08-17T02:48:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.347+0000 7f85aca00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a80699c0 con 0x7f85a8156e50 2024-08-17T02:48:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.347+0000 7f859de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85a80acce0 0x7f85a80ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.347+0000 7f859de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85a80acce0 0x7f85a80ad150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42526/0 (socket says 172.21.15.5:42526) 2024-08-17T02:48:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.347+0000 7f859de00640 1 -- 172.21.15.5:0/743402391 learned_addr learned my addr 172.21.15.5:0/743402391 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:48:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.347+0000 7f85a7200640 1 --2- 172.21.15.5:0/743402391 >> v2:172.21.15.107:3300/0 conn(0x7f85a8156e50 0x7f85a8157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.347+0000 7f859de00640 1 -- 172.21.15.5:0/743402391 >> v2:172.21.15.107:3300/0 conn(0x7f85a8156e50 msgr2=0x7f85a8157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.347+0000 7f859de00640 1 --2- 172.21.15.5:0/743402391 >> v2:172.21.15.107:3300/0 conn(0x7f85a8156e50 0x7f85a8157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.347+0000 7f859de00640 1 -- 172.21.15.5:0/743402391 >> v1:172.21.15.107:6789/0 conn(0x7f85a814c9e0 legacy=0x7f85a80cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.347+0000 7f859de00640 1 -- 172.21.15.5:0/743402391 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a8069ca0 con 0x7f85a80acce0 2024-08-17T02:48:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.348+0000 7f859de00640 1 --2- 172.21.15.5:0/743402391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a80acce0 0x7f85a80ad150 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f85a80c8200 tx=0x7f85900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14eb551bf8944534 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.349+0000 7f85a5e00640 1 -- 172.21.15.5:0/743402391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859002ae80 con 0x7f85a80acce0 2024-08-17T02:48:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.349+0000 7f85a5e00640 1 -- 172.21.15.5:0/743402391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8590032440 con 0x7f85a80acce0 2024-08-17T02:48:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.349+0000 7f85a5e00640 1 -- 172.21.15.5:0/743402391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8590032800 con 0x7f85a80acce0 2024-08-17T02:48:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.349+0000 7f85aca00640 1 -- 172.21.15.5:0/743402391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a80acce0 msgr2=0x7f85a80ad150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.349+0000 7f85aca00640 1 --2- 172.21.15.5:0/743402391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a80acce0 0x7f85a80ad150 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f85a80c8200 tx=0x7f85900091d0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.349+0000 7f85aca00640 1 -- 172.21.15.5:0/743402391 shutdown_connections 2024-08-17T02:48:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.349+0000 7f85aca00640 1 --2- 172.21.15.5:0/743402391 >> v2:172.21.15.107:3300/0 conn(0x7f85a8156e50 0x7f85a8157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.349+0000 7f85aca00640 1 --2- 172.21.15.5:0/743402391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a80acce0 0x7f85a80ad150 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.349+0000 7f85aca00640 1 -- 172.21.15.5:0/743402391 >> 172.21.15.5:0/743402391 conn(0x7f85a8067930 msgr2=0x7f85a80cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.350+0000 7f85aca00640 1 -- 172.21.15.5:0/743402391 shutdown_connections 2024-08-17T02:48:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.350+0000 7f85aca00640 1 -- 172.21.15.5:0/743402391 wait complete. 2024-08-17T02:48:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.351+0000 7f85aca00640 1 Processor -- start 2024-08-17T02:48:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.351+0000 7f85aca00640 1 -- start start 2024-08-17T02:48:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.352+0000 7f85aca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85a80acce0 0x7f85a80c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.352+0000 7f85aca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a814c9e0 0x7f85a814a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.352+0000 7f85aca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85a8156e50 0x7f85a8154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.352+0000 7f85aca00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a814ed00 con 0x7f85a814c9e0 2024-08-17T02:48:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.352+0000 7f85aca00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a814e0f0 con 0x7f85a8156e50 2024-08-17T02:48:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.352+0000 7f85aca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a814e3d0 con 0x7f85a80acce0 2024-08-17T02:48:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.352+0000 7f859de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a814c9e0 0x7f85a814a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.352+0000 7f859de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a814c9e0 0x7f85a814a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42528/0 (socket says 172.21.15.5:42528) 2024-08-17T02:48:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.352+0000 7f859de00640 1 -- 172.21.15.5:0/1371127804 learned_addr learned my addr 172.21.15.5:0/1371127804 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:48:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.352+0000 7f85a7200640 1 --2- 172.21.15.5:0/1371127804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85a8156e50 0x7f85a8154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.352+0000 7f85a6800640 1 --2- 172.21.15.5:0/1371127804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85a80acce0 0x7f85a80c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.353+0000 7f859de00640 1 -- 172.21.15.5:0/1371127804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85a80acce0 msgr2=0x7f85a80c30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.353+0000 7f859de00640 1 --2- 172.21.15.5:0/1371127804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85a80acce0 0x7f85a80c30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.353+0000 7f859de00640 1 -- 172.21.15.5:0/1371127804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85a8156e50 msgr2=0x7f85a8154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.353+0000 7f859de00640 1 --2- 172.21.15.5:0/1371127804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85a8156e50 0x7f85a8154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.353+0000 7f859de00640 1 -- 172.21.15.5:0/1371127804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8590009450 con 0x7f85a814c9e0 2024-08-17T02:48:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.353+0000 7f85a6800640 1 --2- 172.21.15.5:0/1371127804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85a80acce0 0x7f85a80c30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:48:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.353+0000 7f859de00640 1 --2- 172.21.15.5:0/1371127804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a814c9e0 0x7f85a814a0d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8590009210 tx=0x7f8590032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.353+0000 7f859ea00640 1 -- 172.21.15.5:0/1371127804 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8590031bb0 con 0x7f85a814c9e0 2024-08-17T02:48:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.353+0000 7f859ea00640 1 -- 172.21.15.5:0/1371127804 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8590031d30 con 0x7f85a814c9e0 2024-08-17T02:48:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.353+0000 7f859ea00640 1 -- 172.21.15.5:0/1371127804 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859003d670 con 0x7f85a814c9e0 2024-08-17T02:48:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.353+0000 7f85aca00640 1 -- 172.21.15.5:0/1371127804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a814e6b0 con 0x7f85a814c9e0 2024-08-17T02:48:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.353+0000 7f85aca00640 1 -- 172.21.15.5:0/1371127804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a814dd80 con 0x7f85a814c9e0 2024-08-17T02:48:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.354+0000 7f85aca00640 1 -- 172.21.15.5:0/1371127804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a80c0750 con 0x7f85a814c9e0 2024-08-17T02:48:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.355+0000 7f859ea00640 1 -- 172.21.15.5:0/1371127804 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8590039040 con 0x7f85a814c9e0 2024-08-17T02:48:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.356+0000 7f859ea00640 1 --2- 172.21.15.5:0/1371127804 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8584065180 0x7f8584067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.357+0000 7f859ea00640 1 -- 172.21.15.5:0/1371127804 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f85900a2610 con 0x7f85a814c9e0 2024-08-17T02:48:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.357+0000 7f85a6800640 1 --2- 172.21.15.5:0/1371127804 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8584065180 0x7f8584067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.357+0000 7f85a6800640 1 --2- 172.21.15.5:0/1371127804 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8584065180 0x7f8584067630 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8598001820 tx=0x7f8598009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.361+0000 7f859ea00640 1 -- 172.21.15.5:0/1371127804 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f85a80c0750 con 0x7f85a814c9e0 2024-08-17T02:48:04.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.542+0000 7f85aca00640 1 -- 172.21.15.5:0/1371127804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f85a80c0750 con 0x7f85a814c9e0 2024-08-17T02:48:04.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.543+0000 7f859ea00640 1 -- 172.21.15.5:0/1371127804 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v35) v1 ==== 97+0+8050 (secure 0 0 0) 0x7f85a80c0750 con 0x7f85a814c9e0 2024-08-17T02:48:04.544 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:48:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.545+0000 7f85aca00640 1 -- 172.21.15.5:0/1371127804 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8584065180 msgr2=0x7f8584067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.545+0000 7f85aca00640 1 --2- 172.21.15.5:0/1371127804 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8584065180 0x7f8584067630 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8598001820 tx=0x7f8598009040 comp rx=0 tx=0).stop 2024-08-17T02:48:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.545+0000 7f85aca00640 1 -- 172.21.15.5:0/1371127804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a814c9e0 msgr2=0x7f85a814a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.545+0000 7f85aca00640 1 --2- 172.21.15.5:0/1371127804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a814c9e0 0x7f85a814a0d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8590009210 tx=0x7f8590032000 comp rx=0 tx=0).stop 2024-08-17T02:48:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.545+0000 7f85aca00640 1 -- 172.21.15.5:0/1371127804 shutdown_connections 2024-08-17T02:48:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.545+0000 7f85aca00640 1 --2- 172.21.15.5:0/1371127804 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8584065180 0x7f8584067630 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.545+0000 7f85aca00640 1 --2- 172.21.15.5:0/1371127804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85a8156e50 0x7f85a8154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.545+0000 7f85aca00640 1 --2- 172.21.15.5:0/1371127804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a814c9e0 0x7f85a814a0d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.545+0000 7f85aca00640 1 --2- 172.21.15.5:0/1371127804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f85a80acce0 0x7f85a80c30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.545+0000 7f85aca00640 1 -- 172.21.15.5:0/1371127804 >> 172.21.15.5:0/1371127804 conn(0x7f85a8067930 msgr2=0x7f85a80c9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.546+0000 7f85aca00640 1 -- 172.21.15.5:0/1371127804 shutdown_connections 2024-08-17T02:48:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.546+0000 7f85aca00640 1 -- 172.21.15.5:0/1371127804 wait complete. 2024-08-17T02:48:04.561 INFO:teuthology.orchestra.run.smithi005.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:48.185879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:49.106113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000724543.meta","create_time":"2024-08-17T02:48:00.937205+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000724543"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000724543.data","create_time":"2024-08-17T02:48:01.789476+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000724543"}}}] 2024-08-17T02:48:04.561 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000724543 --format=json 2024-08-17T02:48:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.714+0000 7fbb33e00640 1 Processor -- start 2024-08-17T02:48:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.714+0000 7fbb33e00640 1 -- start start 2024-08-17T02:48:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.715+0000 7fbb33e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb2c0add30 0x7fbb2c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.715+0000 7fbb33e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c0cb160 con 0x7fbb2c0ad960 2024-08-17T02:48:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.715+0000 7fbb33e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c0b0d10 con 0x7fbb2c0ca050 2024-08-17T02:48:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.715+0000 7fbb33e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0ca550 con 0x7fbb2c0add30 2024-08-17T02:48:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.715+0000 7fbb31400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbb2c0ad960 0x7fbb2c156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46588/0 (socket says 172.21.15.5:46588) 2024-08-17T02:48:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.715+0000 7fbb31400640 1 -- 172.21.15.5:0/2708296752 learned_addr learned my addr 172.21.15.5:0/2708296752 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:48:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.716+0000 7fbb31e00640 1 --2- 172.21.15.5:0/2708296752 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb2c0add30 0x7fbb2c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.716+0000 7fbb2be00640 1 -- 172.21.15.5:0/2708296752 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741966804 0 0) 0x7fbb2c0cb160 con 0x7fbb2c0ad960 2024-08-17T02:48:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.716+0000 7fbb2be00640 1 -- 172.21.15.5:0/2708296752 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb140034e0 con 0x7fbb2c0ad960 2024-08-17T02:48:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.716+0000 7fbb2be00640 1 -- 172.21.15.5:0/2708296752 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715905141 0 0) 0x7fbb2c0b0d10 con 0x7fbb2c0ca050 2024-08-17T02:48:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.716+0000 7fbb2be00640 1 -- 172.21.15.5:0/2708296752 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb2c0cb160 con 0x7fbb2c0ca050 2024-08-17T02:48:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.716+0000 7fbb2be00640 1 -- 172.21.15.5:0/2708296752 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3295148209 0 0) 0x7fbb140034e0 con 0x7fbb2c0ad960 2024-08-17T02:48:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.716+0000 7fbb31e00640 1 -- 172.21.15.5:0/2708296752 >> v1:172.21.15.107:6789/0 conn(0x7fbb2c0ca050 legacy=0x7fbb2c0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.716+0000 7fbb31e00640 1 -- 172.21.15.5:0/2708296752 >> v1:172.21.15.5:6789/0 conn(0x7fbb2c0ad960 legacy=0x7fbb2c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.716+0000 7fbb31e00640 1 -- 172.21.15.5:0/2708296752 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c0ca830 con 0x7fbb2c0add30 2024-08-17T02:48:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.717+0000 7fbb31e00640 1 --2- 172.21.15.5:0/2708296752 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb2c0add30 0x7fbb2c156b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009e90 tx=0x7fbb24009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaadf9405cda960 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.718+0000 7fbb2be00640 1 -- 172.21.15.5:0/2708296752 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb20001470 con 0x7fbb2c0add30 2024-08-17T02:48:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.718+0000 7fbb2be00640 1 -- 172.21.15.5:0/2708296752 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2402d050 con 0x7fbb2c0add30 2024-08-17T02:48:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.718+0000 7fbb2be00640 1 -- 172.21.15.5:0/2708296752 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb24031610 con 0x7fbb2c0add30 2024-08-17T02:48:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.718+0000 7fbb33e00640 1 -- 172.21.15.5:0/2708296752 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb2c0add30 msgr2=0x7fbb2c156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.718+0000 7fbb33e00640 1 --2- 172.21.15.5:0/2708296752 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb2c0add30 0x7fbb2c156b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009e90 tx=0x7fbb24009780 comp rx=0 tx=0).stop 2024-08-17T02:48:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.718+0000 7fbb33e00640 1 -- 172.21.15.5:0/2708296752 shutdown_connections 2024-08-17T02:48:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.718+0000 7fbb33e00640 1 --2- 172.21.15.5:0/2708296752 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb2c0add30 0x7fbb2c156b30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.718+0000 7fbb33e00640 1 -- 172.21.15.5:0/2708296752 >> 172.21.15.5:0/2708296752 conn(0x7fbb2c066e60 msgr2=0x7fbb2c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.718+0000 7fbb33e00640 1 -- 172.21.15.5:0/2708296752 shutdown_connections 2024-08-17T02:48:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.718+0000 7fbb33e00640 1 -- 172.21.15.5:0/2708296752 wait complete. 2024-08-17T02:48:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.720+0000 7fbb33e00640 1 Processor -- start 2024-08-17T02:48:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.720+0000 7fbb33e00640 1 -- start start 2024-08-17T02:48:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.721+0000 7fbb33e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb2c0ad960 0x7fbb2c145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.721+0000 7fbb33e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c0add30 0x7fbb2c1561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.721+0000 7fbb33e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb2c0ca050 0x7fbb2c156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.721+0000 7fbb33e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0abfe0 con 0x7fbb2c0add30 2024-08-17T02:48:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.721+0000 7fbb33e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0ac640 con 0x7fbb2c0ca050 2024-08-17T02:48:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.721+0000 7fbb33e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0ac890 con 0x7fbb2c0ad960 2024-08-17T02:48:04.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.721+0000 7fbb30a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c0add30 0x7fbb2c1561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:04.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.721+0000 7fbb30a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c0add30 0x7fbb2c1561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42538/0 (socket says 172.21.15.5:42538) 2024-08-17T02:48:04.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.721+0000 7fbb30a00640 1 -- 172.21.15.5:0/1664919445 learned_addr learned my addr 172.21.15.5:0/1664919445 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:48:04.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.721+0000 7fbb31e00640 1 --2- 172.21.15.5:0/1664919445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb2c0ca050 0x7fbb2c156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:04.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.721+0000 7fbb31400640 1 --2- 172.21.15.5:0/1664919445 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb2c0ad960 0x7fbb2c145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:04.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.721+0000 7fbb30a00640 1 -- 172.21.15.5:0/1664919445 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb2c0ad960 msgr2=0x7fbb2c145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:04.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.721+0000 7fbb30a00640 1 --2- 172.21.15.5:0/1664919445 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb2c0ad960 0x7fbb2c145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.721+0000 7fbb30a00640 1 -- 172.21.15.5:0/1664919445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb2c0ca050 msgr2=0x7fbb2c156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.721+0000 7fbb30a00640 1 --2- 172.21.15.5:0/1664919445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb2c0ca050 0x7fbb2c156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.722+0000 7fbb30a00640 1 -- 172.21.15.5:0/1664919445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb24009a20 con 0x7fbb2c0add30 2024-08-17T02:48:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.722+0000 7fbb30a00640 1 --2- 172.21.15.5:0/1664919445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c0add30 0x7fbb2c1561f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c490 tx=0x7fbb18007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.722+0000 7fbb28c00640 1 -- 172.21.15.5:0/1664919445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18011590 con 0x7fbb2c0add30 2024-08-17T02:48:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.722+0000 7fbb28c00640 1 -- 172.21.15.5:0/1664919445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb18011710 con 0x7fbb2c0add30 2024-08-17T02:48:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.722+0000 7fbb28c00640 1 -- 172.21.15.5:0/1664919445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18011ad0 con 0x7fbb2c0add30 2024-08-17T02:48:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.722+0000 7fbb33e00640 1 -- 172.21.15.5:0/1664919445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2c0acb70 con 0x7fbb2c0add30 2024-08-17T02:48:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.722+0000 7fbb33e00640 1 -- 172.21.15.5:0/1664919445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2c0ad130 con 0x7fbb2c0add30 2024-08-17T02:48:04.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.723+0000 7fbb33e00640 1 -- 172.21.15.5:0/1664919445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2c0ad380 con 0x7fbb2c0add30 2024-08-17T02:48:04.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.724+0000 7fbb28c00640 1 -- 172.21.15.5:0/1664919445 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbb1801c460 con 0x7fbb2c0add30 2024-08-17T02:48:04.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.725+0000 7fbb28c00640 1 --2- 172.21.15.5:0/1664919445 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbb0c065150 0x7fbb0c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:04.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.725+0000 7fbb28c00640 1 -- 172.21.15.5:0/1664919445 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fbb18082360 con 0x7fbb2c0add30 2024-08-17T02:48:04.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.725+0000 7fbb31400640 1 --2- 172.21.15.5:0/1664919445 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbb0c065150 0x7fbb0c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.726+0000 7fbb31400640 1 --2- 172.21.15.5:0/1664919445 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbb0c065150 0x7fbb0c067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbb20001380 tx=0x7fbb20001b00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:04.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.729+0000 7fbb28c00640 1 -- 172.21.15.5:0/1664919445 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbb180500b0 con 0x7fbb2c0add30 2024-08-17T02:48:04.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.970+0000 7fbb33e00640 1 -- 172.21.15.5:0/1664919445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000724543", "format": "json"} v 0) v1 -- 0x7fbb2c063fb0 con 0x7fbb2c0add30 2024-08-17T02:48:04.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.970+0000 7fbb28c00640 1 -- 172.21.15.5:0/1664919445 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000724543", "format": "json"}]=0 v19) v1 ==== 110+0+1841 (secure 0 0 0) 0x7fbb180536d0 con 0x7fbb2c0add30 2024-08-17T02:48:04.971 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:48:04.971 INFO:teuthology.orchestra.run.smithi005.stdout:{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:48:02.750931+0000","modified":"2024-08-17T02:48:04.145198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4691},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4691":{"gid":4691,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.5:6837/1768626934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1768626934},{"type":"v1","addr":"172.21.15.5:6837","nonce":1768626934}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000724543","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:48:04.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.972+0000 7fbb33e00640 1 -- 172.21.15.5:0/1664919445 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbb0c065150 msgr2=0x7fbb0c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:04.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.972+0000 7fbb33e00640 1 --2- 172.21.15.5:0/1664919445 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbb0c065150 0x7fbb0c067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbb20001380 tx=0x7fbb20001b00 comp rx=0 tx=0).stop 2024-08-17T02:48:04.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.972+0000 7fbb33e00640 1 -- 172.21.15.5:0/1664919445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c0add30 msgr2=0x7fbb2c1561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:04.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.972+0000 7fbb33e00640 1 --2- 172.21.15.5:0/1664919445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c0add30 0x7fbb2c1561f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c490 tx=0x7fbb18007d30 comp rx=0 tx=0).stop 2024-08-17T02:48:04.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.972+0000 7fbb33e00640 1 -- 172.21.15.5:0/1664919445 shutdown_connections 2024-08-17T02:48:04.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.972+0000 7fbb33e00640 1 --2- 172.21.15.5:0/1664919445 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbb0c065150 0x7fbb0c067600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.972+0000 7fbb33e00640 1 --2- 172.21.15.5:0/1664919445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb2c0ca050 0x7fbb2c156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.972+0000 7fbb33e00640 1 --2- 172.21.15.5:0/1664919445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb2c0add30 0x7fbb2c1561f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.972+0000 7fbb33e00640 1 --2- 172.21.15.5:0/1664919445 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb2c0ad960 0x7fbb2c145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:04.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.972+0000 7fbb33e00640 1 -- 172.21.15.5:0/1664919445 >> 172.21.15.5:0/1664919445 conn(0x7fbb2c066e60 msgr2=0x7fbb2c155410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:04.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.972+0000 7fbb33e00640 1 -- 172.21.15.5:0/1664919445 shutdown_connections 2024-08-17T02:48:04.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:04.973+0000 7fbb33e00640 1 -- 172.21.15.5:0/1664919445 wait complete. 2024-08-17T02:48:04.987 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000724543 --yes-i-really-mean-it 2024-08-17T02:48:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.141+0000 7f57e5400640 1 Processor -- start 2024-08-17T02:48:05.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.142+0000 7f57e5400640 1 -- start start 2024-08-17T02:48:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.143+0000 7f57e5400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57e0156900 0x7f57e00b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.143+0000 7f57e5400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e00ae7d0 0x7f57e00ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.143+0000 7f57e5400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e00b0b10 con 0x7f57e0156cd0 2024-08-17T02:48:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.143+0000 7f57e5400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e00b0df0 con 0x7f57e0156900 2024-08-17T02:48:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.143+0000 7f57e5400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e00b10d0 con 0x7f57e00ae7d0 2024-08-17T02:48:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.143+0000 7f57dfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57e0156900 0x7f57e00b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.143+0000 7f57dfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57e0156900 0x7f57e00b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42548/0 (socket says 172.21.15.5:42548) 2024-08-17T02:48:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.143+0000 7f57dfe00640 1 -- 172.21.15.5:0/1602612819 learned_addr learned my addr 172.21.15.5:0/1602612819 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:48:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.143+0000 7f57d7e00640 1 --2- 172.21.15.5:0/1602612819 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e00ae7d0 0x7f57e00ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.144+0000 7f57dfe00640 1 -- 172.21.15.5:0/1602612819 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e00ae7d0 msgr2=0x7f57e00ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:48:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.144+0000 7f57dfe00640 1 --2- 172.21.15.5:0/1602612819 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e00ae7d0 0x7f57e00ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.144+0000 7f57dfe00640 1 -- 172.21.15.5:0/1602612819 >> v1:172.21.15.107:6789/0 conn(0x7f57e0156cd0 legacy=0x7f57e015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.144+0000 7f57dfe00640 1 -- 172.21.15.5:0/1602612819 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e00b13b0 con 0x7f57e0156900 2024-08-17T02:48:05.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.145+0000 7f57dfe00640 1 --2- 172.21.15.5:0/1602612819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e0156900 0x7f57e00b01c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009910 tx=0x7f57d00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f79da8e74107aa1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:05.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.145+0000 7f57df400640 1 -- 172.21.15.5:0/1602612819 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d002add0 con 0x7f57e0156900 2024-08-17T02:48:05.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.145+0000 7f57df400640 1 -- 172.21.15.5:0/1602612819 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d0032440 con 0x7f57e0156900 2024-08-17T02:48:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.145+0000 7f57df400640 1 -- 172.21.15.5:0/1602612819 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d0032820 con 0x7f57e0156900 2024-08-17T02:48:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.145+0000 7f57e5400640 1 -- 172.21.15.5:0/1602612819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e0156900 msgr2=0x7f57e00b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.145+0000 7f57e5400640 1 --2- 172.21.15.5:0/1602612819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e0156900 0x7f57e00b01c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009910 tx=0x7f57d00091d0 comp rx=0 tx=0).stop 2024-08-17T02:48:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.146+0000 7f57e5400640 1 -- 172.21.15.5:0/1602612819 shutdown_connections 2024-08-17T02:48:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.146+0000 7f57e5400640 1 --2- 172.21.15.5:0/1602612819 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e00ae7d0 0x7f57e00ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.146+0000 7f57e5400640 1 --2- 172.21.15.5:0/1602612819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e0156900 0x7f57e00b01c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.146+0000 7f57e5400640 1 -- 172.21.15.5:0/1602612819 >> 172.21.15.5:0/1602612819 conn(0x7f57e0067930 msgr2=0x7f57e00cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:48:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.146+0000 7f57e5400640 1 -- 172.21.15.5:0/1602612819 shutdown_connections 2024-08-17T02:48:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.146+0000 7f57e5400640 1 -- 172.21.15.5:0/1602612819 wait complete. 2024-08-17T02:48:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.147+0000 7f57e5400640 1 Processor -- start 2024-08-17T02:48:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.147+0000 7f57e5400640 1 -- start start 2024-08-17T02:48:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.148+0000 7f57e5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e00ae7d0 0x7f57e0168d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.148+0000 7f57e5400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57e0156900 0x7f57e014ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.148+0000 7f57e5400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e0156cd0 0x7f57e00698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:05.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.148+0000 7f57e5400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e0157df0 con 0x7f57e00ae7d0 2024-08-17T02:48:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.148+0000 7f57e5400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e01692a0 con 0x7f57e0156900 2024-08-17T02:48:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.148+0000 7f57e5400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e01571e0 con 0x7f57e0156cd0 2024-08-17T02:48:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.148+0000 7f57dfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e00ae7d0 0x7f57e0168d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.148+0000 7f57dfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e00ae7d0 0x7f57e0168d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42556/0 (socket says 172.21.15.5:42556) 2024-08-17T02:48:05.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.148+0000 7f57dfe00640 1 -- 172.21.15.5:0/4172936172 learned_addr learned my addr 172.21.15.5:0/4172936172 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:48:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.148+0000 7f57d7e00640 1 --2- 172.21.15.5:0/4172936172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57e0156900 0x7f57e014ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.148+0000 7f57e4a00640 1 --2- 172.21.15.5:0/4172936172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e0156cd0 0x7f57e00698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.149+0000 7f57dfe00640 1 -- 172.21.15.5:0/4172936172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e0156cd0 msgr2=0x7f57e00698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.149+0000 7f57dfe00640 1 --2- 172.21.15.5:0/4172936172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f57e0156cd0 0x7f57e00698e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.149+0000 7f57dfe00640 1 -- 172.21.15.5:0/4172936172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57e0156900 msgr2=0x7f57e014ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:48:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.149+0000 7f57dfe00640 1 --2- 172.21.15.5:0/4172936172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57e0156900 0x7f57e014ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:48:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.149+0000 7f57dfe00640 1 -- 172.21.15.5:0/4172936172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d0009450 con 0x7f57e00ae7d0 2024-08-17T02:48:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.149+0000 7f57dfe00640 1 --2- 172.21.15.5:0/4172936172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57e00ae7d0 0x7f57e0168d60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f57d0035040 tx=0x7f57d0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.149+0000 7f57d7400640 1 -- 172.21.15.5:0/4172936172 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d0000d10 con 0x7f57e00ae7d0 2024-08-17T02:48:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.149+0000 7f57d7400640 1 -- 172.21.15.5:0/4172936172 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d0031de0 con 0x7f57e00ae7d0 2024-08-17T02:48:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.149+0000 7f57d7400640 1 -- 172.21.15.5:0/4172936172 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d003d690 con 0x7f57e00ae7d0 2024-08-17T02:48:05.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.149+0000 7f57e5400640 1 -- 172.21.15.5:0/4172936172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e01574c0 con 0x7f57e00ae7d0 2024-08-17T02:48:05.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.150+0000 7f57e5400640 1 -- 172.21.15.5:0/4172936172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e0157a80 con 0x7f57e00ae7d0 2024-08-17T02:48:05.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.151+0000 7f57e5400640 1 -- 172.21.15.5:0/4172936172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e0070720 con 0x7f57e00ae7d0 2024-08-17T02:48:05.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.151+0000 7f57d7400640 1 -- 172.21.15.5:0/4172936172 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f57d0039040 con 0x7f57e00ae7d0 2024-08-17T02:48:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.152+0000 7f57d7400640 1 --2- 172.21.15.5:0/4172936172 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f57bc065150 0x7f57bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:48:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.152+0000 7f57d7400640 1 -- 172.21.15.5:0/4172936172 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f57d00a2720 con 0x7f57e00ae7d0 2024-08-17T02:48:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.152+0000 7f57d7e00640 1 --2- 172.21.15.5:0/4172936172 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f57bc065150 0x7f57bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:48:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.153+0000 7f57d7e00640 1 --2- 172.21.15.5:0/4172936172 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f57bc065150 0x7f57bc067600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f57e01562a0 tx=0x7f57c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:48:05.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.156+0000 7f57d7400640 1 -- 172.21.15.5:0/4172936172 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f57d0070470 con 0x7f57e00ae7d0 2024-08-17T02:48:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:48:05.360+0000 7f57e5400640 1 -- 172.21.15.5:0/4172936172 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000724543", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f57e0157f30 con 0x7f57bc065150 2024-08-17T02:48:27.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:48:27.883 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:48:57.973 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:48:57.979 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:28.252 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:28.257 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:58.347 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:58.352 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:05.057 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:50:05.057 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:50:05.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:50:05.150 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:50:05.249 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:50:05.249 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:50:05.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:50:05.250 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-17T02:50:05.318 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:50:05.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:05.318 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:50:05.356 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:50:05.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:50:05.357 DEBUG:teuthology.orchestra.run.smithi107:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-08-17T02:50:05.424 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:50:05.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:05.425 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:50:05.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:50:05.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.611+0000 7f4088400640 1 Processor -- start 2024-08-17T02:50:05.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.611+0000 7f4088400640 1 -- start start 2024-08-17T02:50:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.613+0000 7f4088400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f40800afca0 0x7f40800b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.613+0000 7f4088400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800acf10 0x7f4080159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.613+0000 7f4088400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408015a4e0 con 0x7f40801589a0 2024-08-17T02:50:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.613+0000 7f4088400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40800b0980 con 0x7f40800afca0 2024-08-17T02:50:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.613+0000 7f4088400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40800c92b0 con 0x7f40800acf10 2024-08-17T02:50:05.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.613+0000 7f4085a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f40800afca0 0x7f40800b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:05.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.613+0000 7f4085a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f40800afca0 0x7f40800b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56160/0 (socket says 172.21.15.5:56160) 2024-08-17T02:50:05.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.613+0000 7f4085a00640 1 -- 172.21.15.5:0/3751485835 learned_addr learned my addr 172.21.15.5:0/3751485835 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:05.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.613+0000 7f4086400640 1 --1- 172.21.15.5:0/3751485835 >> v1:172.21.15.5:6789/0 conn(0x7f40801589a0 0x7f408006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44514/0 (socket says 172.21.15.5:44514) 2024-08-17T02:50:05.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.613+0000 7f4085000640 1 --2- 172.21.15.5:0/3751485835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800acf10 0x7f4080159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.613+0000 7f4085a00640 1 -- 172.21.15.5:0/3751485835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800acf10 msgr2=0x7f4080159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.613+0000 7f4085a00640 1 --2- 172.21.15.5:0/3751485835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800acf10 0x7f4080159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.613+0000 7f4085a00640 1 -- 172.21.15.5:0/3751485835 >> v1:172.21.15.5:6789/0 conn(0x7f40801589a0 legacy=0x7f408006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.614+0000 7f4085a00640 1 -- 172.21.15.5:0/3751485835 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40800ad480 con 0x7f40800afca0 2024-08-17T02:50:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.614+0000 7f407fe00640 1 -- 172.21.15.5:0/3751485835 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482368460 0 0) 0x7f4078001490 con 0x7f40801589a0 2024-08-17T02:50:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.615+0000 7f4085a00640 1 --2- 172.21.15.5:0/3751485835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40800afca0 0x7f40800b0070 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f407400bbf0 tx=0x7f407400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8971e920053b1bc7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.615+0000 7f407fe00640 1 -- 172.21.15.5:0/3751485835 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074031610 con 0x7f40800afca0 2024-08-17T02:50:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.615+0000 7f407fe00640 1 -- 172.21.15.5:0/3751485835 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4074031770 con 0x7f40800afca0 2024-08-17T02:50:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.615+0000 7f407fe00640 1 -- 172.21.15.5:0/3751485835 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074031b10 con 0x7f40800afca0 2024-08-17T02:50:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.615+0000 7f4088400640 1 -- 172.21.15.5:0/3751485835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40800afca0 msgr2=0x7f40800b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.615+0000 7f4088400640 1 --2- 172.21.15.5:0/3751485835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40800afca0 0x7f40800b0070 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f407400bbf0 tx=0x7f407400b460 comp rx=0 tx=0).stop 2024-08-17T02:50:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.615+0000 7f4088400640 1 -- 172.21.15.5:0/3751485835 shutdown_connections 2024-08-17T02:50:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.615+0000 7f4088400640 1 --2- 172.21.15.5:0/3751485835 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800acf10 0x7f4080159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.615+0000 7f4088400640 1 --2- 172.21.15.5:0/3751485835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40800afca0 0x7f40800b0070 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.615+0000 7f4088400640 1 -- 172.21.15.5:0/3751485835 >> 172.21.15.5:0/3751485835 conn(0x7f4080066e60 msgr2=0x7f4080067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.616+0000 7f4088400640 1 -- 172.21.15.5:0/3751485835 shutdown_connections 2024-08-17T02:50:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.616+0000 7f4088400640 1 -- 172.21.15.5:0/3751485835 wait complete. 2024-08-17T02:50:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.617+0000 7f4088400640 1 Processor -- start 2024-08-17T02:50:05.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.617+0000 7f4088400640 1 -- start start 2024-08-17T02:50:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.618+0000 7f4088400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800acf10 0x7f408016d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.618+0000 7f4088400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40800afca0 0x7f408014a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.618+0000 7f4088400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40801589a0 0x7f408014d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.618+0000 7f4088400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4080150240 con 0x7f40801589a0 2024-08-17T02:50:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.618+0000 7f4088400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408016d590 con 0x7f40800afca0 2024-08-17T02:50:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.618+0000 7f4088400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408014aee0 con 0x7f40800acf10 2024-08-17T02:50:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.618+0000 7f4086400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40801589a0 0x7f408014d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.618+0000 7f4085a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800acf10 0x7f408016d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.618+0000 7f4085000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40800afca0 0x7f408014a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.619+0000 7f4085a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800acf10 0x7f408016d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:58584/0 (socket says 172.21.15.5:58584) 2024-08-17T02:50:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.619+0000 7f4085a00640 1 -- 172.21.15.5:0/2143219590 learned_addr learned my addr 172.21.15.5:0/2143219590 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.619+0000 7f4085000640 1 -- 172.21.15.5:0/2143219590 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800acf10 msgr2=0x7f408016d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.619+0000 7f4085000640 1 --2- 172.21.15.5:0/2143219590 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800acf10 0x7f408016d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.619+0000 7f4085000640 1 -- 172.21.15.5:0/2143219590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40801589a0 msgr2=0x7f408014d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.619+0000 7f4085000640 1 --2- 172.21.15.5:0/2143219590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40801589a0 0x7f408014d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.619+0000 7f4085000640 1 -- 172.21.15.5:0/2143219590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407400b700 con 0x7f40800afca0 2024-08-17T02:50:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.619+0000 7f4085a00640 1 --2- 172.21.15.5:0/2143219590 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800acf10 0x7f408016d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.619+0000 7f4086400640 1 --2- 172.21.15.5:0/2143219590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40801589a0 0x7f408014d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.619+0000 7f4085000640 1 --2- 172.21.15.5:0/2143219590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40800afca0 0x7f408014a9a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f406c00e960 tx=0x7f406c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.620+0000 7f407cc00640 1 -- 172.21.15.5:0/2143219590 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c00c940 con 0x7f40800afca0 2024-08-17T02:50:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.620+0000 7f407cc00640 1 -- 172.21.15.5:0/2143219590 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406c00caa0 con 0x7f40800afca0 2024-08-17T02:50:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.620+0000 7f407cc00640 1 -- 172.21.15.5:0/2143219590 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c00ce20 con 0x7f40800afca0 2024-08-17T02:50:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.620+0000 7f4088400640 1 -- 172.21.15.5:0/2143219590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408014f630 con 0x7f40800afca0 2024-08-17T02:50:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.620+0000 7f4088400640 1 -- 172.21.15.5:0/2143219590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408014fbf0 con 0x7f40800afca0 2024-08-17T02:50:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.621+0000 7f4088400640 1 -- 172.21.15.5:0/2143219590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40801503f0 con 0x7f40800afca0 2024-08-17T02:50:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.622+0000 7f407cc00640 1 -- 172.21.15.5:0/2143219590 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f406c013680 con 0x7f40800afca0 2024-08-17T02:50:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.622+0000 7f407cc00640 1 --2- 172.21.15.5:0/2143219590 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4060065150 0x7f4060067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.623+0000 7f407cc00640 1 -- 172.21.15.5:0/2143219590 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f406c0829b0 con 0x7f40800afca0 2024-08-17T02:50:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.623+0000 7f4085a00640 1 --2- 172.21.15.5:0/2143219590 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4060065150 0x7f4060067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.623+0000 7f4085a00640 1 --2- 172.21.15.5:0/2143219590 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4060065150 0x7f4060067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f407400b6d0 tx=0x7f407403a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:05.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.627+0000 7f407cc00640 1 -- 172.21.15.5:0/2143219590 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f40801503f0 con 0x7f40800afca0 2024-08-17T02:50:05.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.848+0000 7f4088400640 1 -- 172.21.15.5:0/2143219590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40801503b0 con 0x7f40800afca0 2024-08-17T02:50:05.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.849+0000 7f407cc00640 1 -- 172.21.15.5:0/2143219590 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5681 (secure 0 0 0) 0x7f406c050700 con 0x7f40800afca0 2024-08-17T02:50:05.851 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:05.851 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2464391944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2464391944},{"type":"v1","addr":"172.21.15.107:6835","nonce":2464391944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2049823505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2049823505},{"type":"v1","addr":"172.21.15.107:6834","nonce":2049823505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:50.110026+0000","modified":"2024-08-17T02:47:53.706251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/723455700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":723455700},{"type":"v1","addr":"172.21.15.5:6836","nonce":723455700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:48:02.750931+0000","modified":"2024-08-17T02:48:04.145198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4691},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4691":{"gid":4691,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.5:6837/1768626934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1768626934},{"type":"v1","addr":"172.21.15.5:6837","nonce":1768626934}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000724543","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:50:05.851 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 19 2024-08-17T02:50:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.851+0000 7f4088400640 1 -- 172.21.15.5:0/2143219590 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4060065150 msgr2=0x7f4060067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.851+0000 7f4088400640 1 --2- 172.21.15.5:0/2143219590 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4060065150 0x7f4060067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f407400b6d0 tx=0x7f407403a000 comp rx=0 tx=0).stop 2024-08-17T02:50:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.851+0000 7f4088400640 1 -- 172.21.15.5:0/2143219590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40800afca0 msgr2=0x7f408014a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.851+0000 7f4088400640 1 --2- 172.21.15.5:0/2143219590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40800afca0 0x7f408014a9a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f406c00e960 tx=0x7f406c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.852+0000 7f4088400640 1 -- 172.21.15.5:0/2143219590 shutdown_connections 2024-08-17T02:50:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.852+0000 7f4088400640 1 --2- 172.21.15.5:0/2143219590 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4060065150 0x7f4060067600 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.852+0000 7f4088400640 1 --2- 172.21.15.5:0/2143219590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40801589a0 0x7f408014d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.852+0000 7f4088400640 1 --2- 172.21.15.5:0/2143219590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40800afca0 0x7f408014a9a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.852+0000 7f4088400640 1 --2- 172.21.15.5:0/2143219590 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800acf10 0x7f408016d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.852+0000 7f4088400640 1 -- 172.21.15.5:0/2143219590 >> 172.21.15.5:0/2143219590 conn(0x7f4080066e60 msgr2=0x7f408014c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.852+0000 7f4088400640 1 -- 172.21.15.5:0/2143219590 shutdown_connections 2024-08-17T02:50:05.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:05.852+0000 7f4088400640 1 -- 172.21.15.5:0/2143219590 wait complete. 2024-08-17T02:50:05.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:50:06.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.018+0000 7fd087c00640 1 Processor -- start 2024-08-17T02:50:06.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.018+0000 7fd087c00640 1 -- start start 2024-08-17T02:50:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.019+0000 7fd087c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd0800ad960 0x7fd08015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.019+0000 7fd087c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0800ca050 0x7fd080156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.019+0000 7fd087c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0800add30 0x7fd080156960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.019+0000 7fd087c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08015b5e0 con 0x7fd0800add30 2024-08-17T02:50:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.019+0000 7fd087c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0800cb160 con 0x7fd0800ad960 2024-08-17T02:50:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.019+0000 7fd087c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800b0d10 con 0x7fd0800ca050 2024-08-17T02:50:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.020+0000 7fd085c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0800add30 0x7fd080156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.020+0000 7fd085200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd0800ad960 0x7fd08015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.020+0000 7fd085c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0800add30 0x7fd080156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58128/0 (socket says 172.21.15.5:58128) 2024-08-17T02:50:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.020+0000 7fd085c00640 1 -- 172.21.15.5:0/2872172055 learned_addr learned my addr 172.21.15.5:0/2872172055 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:06.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.020+0000 7fd07fe00640 1 --2- 172.21.15.5:0/2872172055 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0800ca050 0x7fd080156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.020+0000 7fd085c00640 1 -- 172.21.15.5:0/2872172055 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0800ca050 msgr2=0x7fd080156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:06.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.020+0000 7fd085c00640 1 --2- 172.21.15.5:0/2872172055 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0800ca050 0x7fd080156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.020+0000 7fd085c00640 1 -- 172.21.15.5:0/2872172055 >> v2:172.21.15.107:3300/0 conn(0x7fd0800ad960 msgr2=0x7fd08015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:06.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.020+0000 7fd085c00640 1 --2- 172.21.15.5:0/2872172055 >> v2:172.21.15.107:3300/0 conn(0x7fd0800ad960 0x7fd08015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.020+0000 7fd085c00640 1 -- 172.21.15.5:0/2872172055 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0800ca550 con 0x7fd0800add30 2024-08-17T02:50:06.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.020+0000 7fd085200640 1 --2- 172.21.15.5:0/2872172055 >> v2:172.21.15.107:3300/0 conn(0x7fd0800ad960 0x7fd08015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:06.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.021+0000 7fd085c00640 1 --2- 172.21.15.5:0/2872172055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0800add30 0x7fd080156960 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd0800cc910 tx=0x7fd078009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29041c25f598425b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.021+0000 7fd07f400640 1 -- 172.21.15.5:0/2872172055 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078031400 con 0x7fd0800add30 2024-08-17T02:50:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.021+0000 7fd07f400640 1 -- 172.21.15.5:0/2872172055 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07802d050 con 0x7fd0800add30 2024-08-17T02:50:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.021+0000 7fd07f400640 1 -- 172.21.15.5:0/2872172055 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0780317d0 con 0x7fd0800add30 2024-08-17T02:50:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.022+0000 7fd087c00640 1 -- 172.21.15.5:0/2872172055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0800add30 msgr2=0x7fd080156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.022+0000 7fd087c00640 1 --2- 172.21.15.5:0/2872172055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0800add30 0x7fd080156960 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd0800cc910 tx=0x7fd078009840 comp rx=0 tx=0).stop 2024-08-17T02:50:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.022+0000 7fd087c00640 1 -- 172.21.15.5:0/2872172055 shutdown_connections 2024-08-17T02:50:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.022+0000 7fd087c00640 1 --2- 172.21.15.5:0/2872172055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0800add30 0x7fd080156960 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.022+0000 7fd087c00640 1 --2- 172.21.15.5:0/2872172055 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0800ca050 0x7fd080156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.022+0000 7fd087c00640 1 --2- 172.21.15.5:0/2872172055 >> v2:172.21.15.107:3300/0 conn(0x7fd0800ad960 0x7fd08015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.022+0000 7fd087c00640 1 -- 172.21.15.5:0/2872172055 >> 172.21.15.5:0/2872172055 conn(0x7fd080066e60 msgr2=0x7fd080067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.022+0000 7fd087c00640 1 -- 172.21.15.5:0/2872172055 shutdown_connections 2024-08-17T02:50:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.022+0000 7fd087c00640 1 -- 172.21.15.5:0/2872172055 wait complete. 2024-08-17T02:50:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.023+0000 7fd087c00640 1 Processor -- start 2024-08-17T02:50:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.024+0000 7fd087c00640 1 -- start start 2024-08-17T02:50:06.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.024+0000 7fd087c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0800ad960 0x7fd08013ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.024+0000 7fd087c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0800add30 0x7fd08006b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.025+0000 7fd087c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0800ca050 0x7fd080152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.025+0000 7fd087c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08006a820 con 0x7fd0800ca050 2024-08-17T02:50:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.025+0000 7fd087c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800a70a0 con 0x7fd0800ad960 2024-08-17T02:50:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.025+0000 7fd087c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd080069c10 con 0x7fd0800add30 2024-08-17T02:50:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.025+0000 7fd085c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0800ca050 0x7fd080152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.025+0000 7fd085c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0800ca050 0x7fd080152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58134/0 (socket says 172.21.15.5:58134) 2024-08-17T02:50:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.025+0000 7fd085c00640 1 -- 172.21.15.5:0/3760307717 learned_addr learned my addr 172.21.15.5:0/3760307717 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.025+0000 7fd085200640 1 --2- 172.21.15.5:0/3760307717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0800ad960 0x7fd08013ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.025+0000 7fd07fe00640 1 --2- 172.21.15.5:0/3760307717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0800add30 0x7fd08006b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.025+0000 7fd085c00640 1 -- 172.21.15.5:0/3760307717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0800add30 msgr2=0x7fd08006b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.025+0000 7fd085c00640 1 --2- 172.21.15.5:0/3760307717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0800add30 0x7fd08006b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.025+0000 7fd085c00640 1 -- 172.21.15.5:0/3760307717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0800ad960 msgr2=0x7fd08013ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.025+0000 7fd085c00640 1 --2- 172.21.15.5:0/3760307717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0800ad960 0x7fd08013ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.025+0000 7fd085c00640 1 -- 172.21.15.5:0/3760307717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd074009390 con 0x7fd0800ca050 2024-08-17T02:50:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.026+0000 7fd085c00640 1 --2- 172.21.15.5:0/3760307717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0800ca050 0x7fd080152820 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd07802ad40 tx=0x7fd078036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.026+0000 7fd073e00640 1 -- 172.21.15.5:0/3760307717 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078031880 con 0x7fd0800ca050 2024-08-17T02:50:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.026+0000 7fd073e00640 1 -- 172.21.15.5:0/3760307717 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd078008e50 con 0x7fd0800ca050 2024-08-17T02:50:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.026+0000 7fd073e00640 1 -- 172.21.15.5:0/3760307717 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07803b640 con 0x7fd0800ca050 2024-08-17T02:50:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.026+0000 7fd087c00640 1 -- 172.21.15.5:0/3760307717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd078009ae0 con 0x7fd0800ca050 2024-08-17T02:50:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.026+0000 7fd087c00640 1 -- 172.21.15.5:0/3760307717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08006a4b0 con 0x7fd0800ca050 2024-08-17T02:50:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.027+0000 7fd087c00640 1 -- 172.21.15.5:0/3760307717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd080063fb0 con 0x7fd0800ca050 2024-08-17T02:50:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.028+0000 7fd073e00640 1 -- 172.21.15.5:0/3760307717 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd078038050 con 0x7fd0800ca050 2024-08-17T02:50:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.029+0000 7fd073e00640 1 --2- 172.21.15.5:0/3760307717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd060065150 0x7fd060067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.029+0000 7fd073e00640 1 -- 172.21.15.5:0/3760307717 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fd0780a2cf0 con 0x7fd0800ca050 2024-08-17T02:50:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.029+0000 7fd085200640 1 --2- 172.21.15.5:0/3760307717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd060065150 0x7fd060067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.030+0000 7fd085200640 1 --2- 172.21.15.5:0/3760307717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd060065150 0x7fd060067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd074009e10 tx=0x7fd0740090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.034+0000 7fd073e00640 1 -- 172.21.15.5:0/3760307717 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd078070a40 con 0x7fd0800ca050 2024-08-17T02:50:06.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.215+0000 7fd087c00640 1 -- 172.21.15.5:0/3760307717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd08006e940 con 0x7fd0800ca050 2024-08-17T02:50:06.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.216+0000 7fd073e00640 1 -- 172.21.15.5:0/3760307717 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18551 (secure 0 0 0) 0x7fd078074060 con 0x7fd0800ca050 2024-08-17T02:50:06.218 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:06.218 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":37,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:48:05.751103+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:48.185879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:49.106113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000724543.meta","create_time":"2024-08-17T02:48:00.937205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000724543"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000724543.data","create_time":"2024-08-17T02:48:01.789476+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000724543"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:50:06.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.219+0000 7fd087c00640 1 -- 172.21.15.5:0/3760307717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd060065150 msgr2=0x7fd060067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.219+0000 7fd087c00640 1 --2- 172.21.15.5:0/3760307717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd060065150 0x7fd060067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd074009e10 tx=0x7fd0740090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.219+0000 7fd087c00640 1 -- 172.21.15.5:0/3760307717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0800ca050 msgr2=0x7fd080152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.219+0000 7fd087c00640 1 --2- 172.21.15.5:0/3760307717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0800ca050 0x7fd080152820 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd07802ad40 tx=0x7fd078036000 comp rx=0 tx=0).stop 2024-08-17T02:50:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.219+0000 7fd087c00640 1 -- 172.21.15.5:0/3760307717 shutdown_connections 2024-08-17T02:50:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.219+0000 7fd087c00640 1 --2- 172.21.15.5:0/3760307717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd060065150 0x7fd060067600 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.219+0000 7fd087c00640 1 --2- 172.21.15.5:0/3760307717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0800ca050 0x7fd080152820 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.219+0000 7fd087c00640 1 --2- 172.21.15.5:0/3760307717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd0800add30 0x7fd08006b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.219+0000 7fd087c00640 1 --2- 172.21.15.5:0/3760307717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0800ad960 0x7fd08013ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.219+0000 7fd087c00640 1 -- 172.21.15.5:0/3760307717 >> 172.21.15.5:0/3760307717 conn(0x7fd080066e60 msgr2=0x7fd080155800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.219+0000 7fd087c00640 1 -- 172.21.15.5:0/3760307717 shutdown_connections 2024-08-17T02:50:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.219+0000 7fd087c00640 1 -- 172.21.15.5:0/3760307717 wait complete. 2024-08-17T02:50:06.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:47.106425+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:47:48.185879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:47:49.106113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000724543.meta', 'create_time': '2024-08-17T02:48:00.937205+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000724543'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000724543.data', 'create_time': '2024-08-17T02:48:01.789476+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000724543'}}}] 2024-08-17T02:50:06.236 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:50:06.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.389+0000 7f8449800640 1 Processor -- start 2024-08-17T02:50:06.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.389+0000 7f8449800640 1 -- start start 2024-08-17T02:50:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.390+0000 7f8449800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f844406d900 0x7f844406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.390+0000 7f8449800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f84440ade50 0x7f8444155db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.390+0000 7f8449800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84440ae6c0 0x7f84440aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.390+0000 7f8449800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8444156e50 con 0x7f84440ae6c0 2024-08-17T02:50:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.390+0000 7f8449800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8444159640 con 0x7f84440ade50 2024-08-17T02:50:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.390+0000 7f8449800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84440ae2a0 con 0x7f844406d900 2024-08-17T02:50:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.390+0000 7f8448e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84440ae6c0 0x7f84440aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.390+0000 7f8448e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84440ae6c0 0x7f84440aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58138/0 (socket says 172.21.15.5:58138) 2024-08-17T02:50:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.390+0000 7f8448e00640 1 -- 172.21.15.5:0/2389026791 learned_addr learned my addr 172.21.15.5:0/2389026791 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.390+0000 7f843be00640 1 --2- 172.21.15.5:0/2389026791 >> v2:172.21.15.107:3300/0 conn(0x7f84440ade50 0x7f8444155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.390+0000 7f8443e00640 1 --2- 172.21.15.5:0/2389026791 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f844406d900 0x7f844406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.391+0000 7f8448e00640 1 -- 172.21.15.5:0/2389026791 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f844406d900 msgr2=0x7f844406dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:06.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.391+0000 7f8448e00640 1 --2- 172.21.15.5:0/2389026791 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f844406d900 0x7f844406dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.391+0000 7f8448e00640 1 -- 172.21.15.5:0/2389026791 >> v2:172.21.15.107:3300/0 conn(0x7f84440ade50 msgr2=0x7f8444155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:06.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.391+0000 7f8448e00640 1 --2- 172.21.15.5:0/2389026791 >> v2:172.21.15.107:3300/0 conn(0x7f84440ade50 0x7f8444155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.391+0000 7f8448e00640 1 -- 172.21.15.5:0/2389026791 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84441562f0 con 0x7f84440ae6c0 2024-08-17T02:50:06.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.392+0000 7f8448e00640 1 --2- 172.21.15.5:0/2389026791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84440ae6c0 0x7f84440aeaf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f844406ed90 tx=0x7f843c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc09eaec6e18c287 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:06.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.392+0000 7f8443400640 1 -- 172.21.15.5:0/2389026791 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c032470 con 0x7f84440ae6c0 2024-08-17T02:50:06.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.392+0000 7f8443400640 1 -- 172.21.15.5:0/2389026791 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c0325d0 con 0x7f84440ae6c0 2024-08-17T02:50:06.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.392+0000 7f8443400640 1 -- 172.21.15.5:0/2389026791 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c0329b0 con 0x7f84440ae6c0 2024-08-17T02:50:06.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.393+0000 7f8449800640 1 -- 172.21.15.5:0/2389026791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84440ae6c0 msgr2=0x7f84440aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.393+0000 7f8449800640 1 --2- 172.21.15.5:0/2389026791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84440ae6c0 0x7f84440aeaf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f844406ed90 tx=0x7f843c009840 comp rx=0 tx=0).stop 2024-08-17T02:50:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.393+0000 7f8449800640 1 -- 172.21.15.5:0/2389026791 shutdown_connections 2024-08-17T02:50:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.393+0000 7f8449800640 1 --2- 172.21.15.5:0/2389026791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84440ae6c0 0x7f84440aeaf0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.393+0000 7f8449800640 1 --2- 172.21.15.5:0/2389026791 >> v2:172.21.15.107:3300/0 conn(0x7f84440ade50 0x7f8444155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.393+0000 7f8449800640 1 --2- 172.21.15.5:0/2389026791 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f844406d900 0x7f844406dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.393+0000 7f8449800640 1 -- 172.21.15.5:0/2389026791 >> 172.21.15.5:0/2389026791 conn(0x7f84440cb770 msgr2=0x7f84440cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.393+0000 7f8449800640 1 -- 172.21.15.5:0/2389026791 shutdown_connections 2024-08-17T02:50:06.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.393+0000 7f8449800640 1 -- 172.21.15.5:0/2389026791 wait complete. 2024-08-17T02:50:06.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.394+0000 7f8449800640 1 Processor -- start 2024-08-17T02:50:06.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.394+0000 7f8449800640 1 -- start start 2024-08-17T02:50:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.395+0000 7f8449800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f844406d900 0x7f84440ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.395+0000 7f8449800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84440ade50 0x7f8444142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.395+0000 7f8449800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84440ae6c0 0x7f844414af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.395+0000 7f8449800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84440cad90 con 0x7f84440ade50 2024-08-17T02:50:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.395+0000 7f8449800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84440ca3c0 con 0x7f84440ae6c0 2024-08-17T02:50:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.395+0000 7f8449800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84440c97b0 con 0x7f844406d900 2024-08-17T02:50:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.395+0000 7f843be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84440ade50 0x7f8444142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.395+0000 7f843be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84440ade50 0x7f8444142170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58146/0 (socket says 172.21.15.5:58146) 2024-08-17T02:50:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.396+0000 7f843be00640 1 -- 172.21.15.5:0/2268679371 learned_addr learned my addr 172.21.15.5:0/2268679371 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.396+0000 7f8443e00640 1 --2- 172.21.15.5:0/2268679371 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f844406d900 0x7f84440ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.396+0000 7f8448e00640 1 --2- 172.21.15.5:0/2268679371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84440ae6c0 0x7f844414af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.396+0000 7f843be00640 1 -- 172.21.15.5:0/2268679371 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f844406d900 msgr2=0x7f84440ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.396+0000 7f843be00640 1 --2- 172.21.15.5:0/2268679371 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f844406d900 0x7f84440ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.396+0000 7f843be00640 1 -- 172.21.15.5:0/2268679371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84440ae6c0 msgr2=0x7f844414af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.396+0000 7f843be00640 1 --2- 172.21.15.5:0/2268679371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84440ae6c0 0x7f844414af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.396+0000 7f843be00640 1 -- 172.21.15.5:0/2268679371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c009ae0 con 0x7f84440ade50 2024-08-17T02:50:06.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.396+0000 7f8448e00640 1 --2- 172.21.15.5:0/2268679371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84440ae6c0 0x7f844414af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:06.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.396+0000 7f843be00640 1 --2- 172.21.15.5:0/2268679371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84440ade50 0x7f8444142170 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f842c00ea20 tx=0x7f842c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:06.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.396+0000 7f843b400640 1 -- 172.21.15.5:0/2268679371 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c00ca10 con 0x7f84440ade50 2024-08-17T02:50:06.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.396+0000 7f843b400640 1 -- 172.21.15.5:0/2268679371 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c00cb70 con 0x7f84440ade50 2024-08-17T02:50:06.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.396+0000 7f843b400640 1 -- 172.21.15.5:0/2268679371 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c013470 con 0x7f84440ade50 2024-08-17T02:50:06.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.396+0000 7f8449800640 1 -- 172.21.15.5:0/2268679371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84440c9a90 con 0x7f84440ade50 2024-08-17T02:50:06.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.397+0000 7f8449800640 1 -- 172.21.15.5:0/2268679371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84440ca050 con 0x7f84440ade50 2024-08-17T02:50:06.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.398+0000 7f8449800640 1 -- 172.21.15.5:0/2268679371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8444070720 con 0x7f84440ade50 2024-08-17T02:50:06.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.398+0000 7f843b400640 1 -- 172.21.15.5:0/2268679371 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f842c013820 con 0x7f84440ade50 2024-08-17T02:50:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.399+0000 7f843b400640 1 --2- 172.21.15.5:0/2268679371 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8420065180 0x7f8420067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.399+0000 7f843b400640 1 -- 172.21.15.5:0/2268679371 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f842c082a60 con 0x7f84440ade50 2024-08-17T02:50:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.399+0000 7f8443e00640 1 --2- 172.21.15.5:0/2268679371 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8420065180 0x7f8420067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.400+0000 7f8443e00640 1 --2- 172.21.15.5:0/2268679371 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8420065180 0x7f8420067630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8434009d20 tx=0x7f84340090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:06.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.403+0000 7f843b400640 1 -- 172.21.15.5:0/2268679371 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f842c0507b0 con 0x7f84440ade50 2024-08-17T02:50:06.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.584+0000 7f8449800640 1 -- 172.21.15.5:0/2268679371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f844406b570 con 0x7f84440ade50 2024-08-17T02:50:06.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.584+0000 7f843b400640 1 -- 172.21.15.5:0/2268679371 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f842c017020 con 0x7f84440ade50 2024-08-17T02:50:06.585 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:50:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.587+0000 7f8449800640 1 -- 172.21.15.5:0/2268679371 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8420065180 msgr2=0x7f8420067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.587+0000 7f8449800640 1 --2- 172.21.15.5:0/2268679371 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8420065180 0x7f8420067630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8434009d20 tx=0x7f84340090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.587+0000 7f8449800640 1 -- 172.21.15.5:0/2268679371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84440ade50 msgr2=0x7f8444142170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.587+0000 7f8449800640 1 --2- 172.21.15.5:0/2268679371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84440ade50 0x7f8444142170 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f842c00ea20 tx=0x7f842c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.587+0000 7f8449800640 1 -- 172.21.15.5:0/2268679371 shutdown_connections 2024-08-17T02:50:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.587+0000 7f8449800640 1 --2- 172.21.15.5:0/2268679371 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8420065180 0x7f8420067630 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.587+0000 7f8449800640 1 --2- 172.21.15.5:0/2268679371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84440ae6c0 0x7f844414af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.587+0000 7f8449800640 1 --2- 172.21.15.5:0/2268679371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84440ade50 0x7f8444142170 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.587+0000 7f8449800640 1 --2- 172.21.15.5:0/2268679371 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f844406d900 0x7f84440ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.587+0000 7f8449800640 1 -- 172.21.15.5:0/2268679371 >> 172.21.15.5:0/2268679371 conn(0x7f84440cb770 msgr2=0x7f844406a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.587+0000 7f8449800640 1 -- 172.21.15.5:0/2268679371 shutdown_connections 2024-08-17T02:50:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.587+0000 7f8449800640 1 -- 172.21.15.5:0/2268679371 wait complete. 2024-08-17T02:50:06.603 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:50:06.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.758+0000 7fb462000640 1 Processor -- start 2024-08-17T02:50:06.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.758+0000 7fb462000640 1 -- start start 2024-08-17T02:50:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.759+0000 7fb462000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb45c0ca050 0x7fb45c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.759+0000 7fb462000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb45c0add30 0x7fb45c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.759+0000 7fb462000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c15b5e0 con 0x7fb45c0ad960 2024-08-17T02:50:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.759+0000 7fb462000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45c0cb160 con 0x7fb45c0add30 2024-08-17T02:50:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.759+0000 7fb462000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45c0b0d10 con 0x7fb45c0ca050 2024-08-17T02:50:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.759+0000 7fb45be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb45c0add30 0x7fb45c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.760+0000 7fb45be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb45c0add30 0x7fb45c15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58152/0 (socket says 172.21.15.5:58152) 2024-08-17T02:50:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.760+0000 7fb45be00640 1 -- 172.21.15.5:0/3490511461 learned_addr learned my addr 172.21.15.5:0/3490511461 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.760+0000 7fb45aa00640 1 --2- 172.21.15.5:0/3490511461 >> v2:172.21.15.107:3300/0 conn(0x7fb45c0ca050 0x7fb45c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.760+0000 7fb45be00640 1 -- 172.21.15.5:0/3490511461 >> v2:172.21.15.107:3300/0 conn(0x7fb45c0ca050 msgr2=0x7fb45c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.760+0000 7fb45be00640 1 --2- 172.21.15.5:0/3490511461 >> v2:172.21.15.107:3300/0 conn(0x7fb45c0ca050 0x7fb45c156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.760+0000 7fb45be00640 1 -- 172.21.15.5:0/3490511461 >> v1:172.21.15.107:6789/0 conn(0x7fb45c0ad960 legacy=0x7fb45c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.760+0000 7fb45be00640 1 -- 172.21.15.5:0/3490511461 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c0ca550 con 0x7fb45c0add30 2024-08-17T02:50:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.760+0000 7fb45aa00640 1 --2- 172.21.15.5:0/3490511461 >> v2:172.21.15.107:3300/0 conn(0x7fb45c0ca050 0x7fb45c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.761+0000 7fb45be00640 1 --2- 172.21.15.5:0/3490511461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c0add30 0x7fb45c15b0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb45c063600 tx=0x7fb454009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb39551c5538771 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.761+0000 7fb45a000640 1 -- 172.21.15.5:0/3490511461 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454033430 con 0x7fb45c0add30 2024-08-17T02:50:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.761+0000 7fb45a000640 1 -- 172.21.15.5:0/3490511461 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb454033590 con 0x7fb45c0add30 2024-08-17T02:50:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.761+0000 7fb45a000640 1 -- 172.21.15.5:0/3490511461 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454033930 con 0x7fb45c0add30 2024-08-17T02:50:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.762+0000 7fb462000640 1 -- 172.21.15.5:0/3490511461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c0add30 msgr2=0x7fb45c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.762+0000 7fb462000640 1 --2- 172.21.15.5:0/3490511461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c0add30 0x7fb45c15b0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb45c063600 tx=0x7fb454009840 comp rx=0 tx=0).stop 2024-08-17T02:50:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.762+0000 7fb462000640 1 -- 172.21.15.5:0/3490511461 shutdown_connections 2024-08-17T02:50:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.762+0000 7fb462000640 1 --2- 172.21.15.5:0/3490511461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c0add30 0x7fb45c15b0a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.762+0000 7fb462000640 1 --2- 172.21.15.5:0/3490511461 >> v2:172.21.15.107:3300/0 conn(0x7fb45c0ca050 0x7fb45c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.762+0000 7fb462000640 1 -- 172.21.15.5:0/3490511461 >> 172.21.15.5:0/3490511461 conn(0x7fb45c066e60 msgr2=0x7fb45c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.762+0000 7fb462000640 1 -- 172.21.15.5:0/3490511461 shutdown_connections 2024-08-17T02:50:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.762+0000 7fb462000640 1 -- 172.21.15.5:0/3490511461 wait complete. 2024-08-17T02:50:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.763+0000 7fb462000640 1 Processor -- start 2024-08-17T02:50:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.763+0000 7fb462000640 1 -- start start 2024-08-17T02:50:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.764+0000 7fb462000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb45c0ad960 0x7fb45c142240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.764+0000 7fb462000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb45c0add30 0x7fb45c157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.764+0000 7fb462000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c0ca050 0x7fb45c158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.764+0000 7fb462000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c1668a0 con 0x7fb45c0ca050 2024-08-17T02:50:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.764+0000 7fb462000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c157b30 con 0x7fb45c0add30 2024-08-17T02:50:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.764+0000 7fb462000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c157e10 con 0x7fb45c0ad960 2024-08-17T02:50:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.765+0000 7fb45be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c0ca050 0x7fb45c158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.765+0000 7fb45be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c0ca050 0x7fb45c158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58160/0 (socket says 172.21.15.5:58160) 2024-08-17T02:50:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.765+0000 7fb45be00640 1 -- 172.21.15.5:0/1820089450 learned_addr learned my addr 172.21.15.5:0/1820089450 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.765+0000 7fb45b400640 1 --2- 172.21.15.5:0/1820089450 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb45c0ad960 0x7fb45c142240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.765+0000 7fb45aa00640 1 --2- 172.21.15.5:0/1820089450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb45c0add30 0x7fb45c157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.765+0000 7fb45be00640 1 -- 172.21.15.5:0/1820089450 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb45c0ad960 msgr2=0x7fb45c142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.765+0000 7fb45be00640 1 --2- 172.21.15.5:0/1820089450 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb45c0ad960 0x7fb45c142240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.765+0000 7fb45be00640 1 -- 172.21.15.5:0/1820089450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb45c0add30 msgr2=0x7fb45c157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.765+0000 7fb45be00640 1 --2- 172.21.15.5:0/1820089450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb45c0add30 0x7fb45c157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.765+0000 7fb45be00640 1 -- 172.21.15.5:0/1820089450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb454009ae0 con 0x7fb45c0ca050 2024-08-17T02:50:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.765+0000 7fb45aa00640 1 --2- 172.21.15.5:0/1820089450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb45c0add30 0x7fb45c157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.765+0000 7fb45be00640 1 --2- 172.21.15.5:0/1820089450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c0ca050 0x7fb45c158820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb45402ad90 tx=0x7fb454037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.766+0000 7fb452a00640 1 -- 172.21.15.5:0/1820089450 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454007b90 con 0x7fb45c0ca050 2024-08-17T02:50:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.766+0000 7fb452a00640 1 -- 172.21.15.5:0/1820089450 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb454007d10 con 0x7fb45c0ca050 2024-08-17T02:50:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.766+0000 7fb452a00640 1 -- 172.21.15.5:0/1820089450 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45403f6c0 con 0x7fb45c0ca050 2024-08-17T02:50:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.766+0000 7fb462000640 1 -- 172.21.15.5:0/1820089450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c1580f0 con 0x7fb45c0ca050 2024-08-17T02:50:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.766+0000 7fb462000640 1 -- 172.21.15.5:0/1820089450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c142780 con 0x7fb45c0ca050 2024-08-17T02:50:06.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.767+0000 7fb462000640 1 -- 172.21.15.5:0/1820089450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45c063fb0 con 0x7fb45c0ca050 2024-08-17T02:50:06.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.768+0000 7fb452a00640 1 -- 172.21.15.5:0/1820089450 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb454003020 con 0x7fb45c0ca050 2024-08-17T02:50:06.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.768+0000 7fb452a00640 1 --2- 172.21.15.5:0/1820089450 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb43c065180 0x7fb43c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:06.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.769+0000 7fb452a00640 1 -- 172.21.15.5:0/1820089450 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fb4540a3320 con 0x7fb45c0ca050 2024-08-17T02:50:06.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.769+0000 7fb45b400640 1 --2- 172.21.15.5:0/1820089450 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb43c065180 0x7fb43c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:06.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.769+0000 7fb45b400640 1 --2- 172.21.15.5:0/1820089450 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb43c065180 0x7fb43c067630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00b8d0 tx=0x7fb44c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:06.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.773+0000 7fb452a00640 1 -- 172.21.15.5:0/1820089450 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb454070fc0 con 0x7fb45c0ca050 2024-08-17T02:50:06.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.959+0000 7fb462000640 1 -- 172.21.15.5:0/1820089450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb45c15b5e0 con 0x7fb45c0ca050 2024-08-17T02:50:06.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.960+0000 7fb452a00640 1 -- 172.21.15.5:0/1820089450 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb45c15b5e0 con 0x7fb45c0ca050 2024-08-17T02:50:06.961 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:50:06.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.961+0000 7fb462000640 1 -- 172.21.15.5:0/1820089450 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb43c065180 msgr2=0x7fb43c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.961+0000 7fb462000640 1 --2- 172.21.15.5:0/1820089450 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb43c065180 0x7fb43c067630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00b8d0 tx=0x7fb44c008040 comp rx=0 tx=0).stop 2024-08-17T02:50:06.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.962+0000 7fb462000640 1 -- 172.21.15.5:0/1820089450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c0ca050 msgr2=0x7fb45c158820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:06.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.962+0000 7fb462000640 1 --2- 172.21.15.5:0/1820089450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c0ca050 0x7fb45c158820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb45402ad90 tx=0x7fb454037000 comp rx=0 tx=0).stop 2024-08-17T02:50:06.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.962+0000 7fb462000640 1 -- 172.21.15.5:0/1820089450 shutdown_connections 2024-08-17T02:50:06.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.962+0000 7fb462000640 1 --2- 172.21.15.5:0/1820089450 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb43c065180 0x7fb43c067630 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.962+0000 7fb462000640 1 --2- 172.21.15.5:0/1820089450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c0ca050 0x7fb45c158820 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.962+0000 7fb462000640 1 --2- 172.21.15.5:0/1820089450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb45c0add30 0x7fb45c157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.962+0000 7fb462000640 1 --2- 172.21.15.5:0/1820089450 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb45c0ad960 0x7fb45c142240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:06.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.962+0000 7fb462000640 1 -- 172.21.15.5:0/1820089450 >> 172.21.15.5:0/1820089450 conn(0x7fb45c066e60 msgr2=0x7fb45c154bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:06.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.962+0000 7fb462000640 1 -- 172.21.15.5:0/1820089450 shutdown_connections 2024-08-17T02:50:06.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:06.962+0000 7fb462000640 1 -- 172.21.15.5:0/1820089450 wait complete. 2024-08-17T02:50:06.978 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:50:07.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.132+0000 7f6850a00640 1 Processor -- start 2024-08-17T02:50:07.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.132+0000 7f6850a00640 1 -- start start 2024-08-17T02:50:07.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.133+0000 7f6850a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f684c0ad960 0x7f684c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.133+0000 7f6850a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684c0add30 0x7f684c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.133+0000 7f6850a00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f684c15b5e0 con 0x7f684c0ca050 2024-08-17T02:50:07.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.133+0000 7f6850a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684c0cb160 con 0x7f684c0ad960 2024-08-17T02:50:07.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.133+0000 7f6850a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684c0b0d10 con 0x7f684c0add30 2024-08-17T02:50:07.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.133+0000 7f6849e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f684c0ad960 0x7f684c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.133+0000 7f6849e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f684c0ad960 0x7f684c15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58166/0 (socket says 172.21.15.5:58166) 2024-08-17T02:50:07.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.133+0000 7f6849e00640 1 -- 172.21.15.5:0/684706682 learned_addr learned my addr 172.21.15.5:0/684706682 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:07.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.134+0000 7f684a800640 1 --2- 172.21.15.5:0/684706682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684c0add30 0x7f684c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.134+0000 7f6849e00640 1 -- 172.21.15.5:0/684706682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684c0add30 msgr2=0x7f684c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:07.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.134+0000 7f6849e00640 1 --2- 172.21.15.5:0/684706682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684c0add30 0x7f684c156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.134+0000 7f6849e00640 1 -- 172.21.15.5:0/684706682 >> v1:172.21.15.107:6789/0 conn(0x7f684c0ca050 legacy=0x7f684c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:07.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.134+0000 7f6849e00640 1 -- 172.21.15.5:0/684706682 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684c0ca550 con 0x7f684c0ad960 2024-08-17T02:50:07.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.134+0000 7f684a800640 1 --2- 172.21.15.5:0/684706682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684c0add30 0x7f684c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:07.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.135+0000 7f6849e00640 1 --2- 172.21.15.5:0/684706682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684c0ad960 0x7f684c15b0a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f683c009910 tx=0x7f683c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a667a186219efa9d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:07.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.135+0000 7f6849400640 1 -- 172.21.15.5:0/684706682 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c02ae40 con 0x7f684c0ad960 2024-08-17T02:50:07.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.135+0000 7f6849400640 1 -- 172.21.15.5:0/684706682 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c032440 con 0x7f684c0ad960 2024-08-17T02:50:07.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.135+0000 7f6849400640 1 -- 172.21.15.5:0/684706682 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c032820 con 0x7f684c0ad960 2024-08-17T02:50:07.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.135+0000 7f6850a00640 1 -- 172.21.15.5:0/684706682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684c0ad960 msgr2=0x7f684c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.135+0000 7f6850a00640 1 --2- 172.21.15.5:0/684706682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684c0ad960 0x7f684c15b0a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f683c009910 tx=0x7f683c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.136+0000 7f6850a00640 1 -- 172.21.15.5:0/684706682 shutdown_connections 2024-08-17T02:50:07.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.136+0000 7f6850a00640 1 --2- 172.21.15.5:0/684706682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684c0add30 0x7f684c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.136+0000 7f6850a00640 1 --2- 172.21.15.5:0/684706682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684c0ad960 0x7f684c15b0a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.136+0000 7f6850a00640 1 -- 172.21.15.5:0/684706682 >> 172.21.15.5:0/684706682 conn(0x7f684c066e60 msgr2=0x7f684c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:07.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.136+0000 7f6850a00640 1 -- 172.21.15.5:0/684706682 shutdown_connections 2024-08-17T02:50:07.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.136+0000 7f6850a00640 1 -- 172.21.15.5:0/684706682 wait complete. 2024-08-17T02:50:07.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.137+0000 7f6850a00640 1 Processor -- start 2024-08-17T02:50:07.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.137+0000 7f6850a00640 1 -- start start 2024-08-17T02:50:07.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.138+0000 7f6850a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684c0ad960 0x7f684c1423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.138+0000 7f6850a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f684c0add30 0x7f684c153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.138+0000 7f6850a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684c0ca050 0x7f684c1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.138+0000 7f6850a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c142920 con 0x7f684c0ca050 2024-08-17T02:50:07.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.138+0000 7f6850a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c0ac420 con 0x7f684c0add30 2024-08-17T02:50:07.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.138+0000 7f6850a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684c0acfa0 con 0x7f684c0ad960 2024-08-17T02:50:07.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.138+0000 7f684a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684c0ca050 0x7f684c1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.138+0000 7f6849e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684c0ad960 0x7f684c1423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.138+0000 7f6849e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684c0ad960 0x7f684c1423e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:39686/0 (socket says 172.21.15.5:39686) 2024-08-17T02:50:07.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.138+0000 7f6849e00640 1 -- 172.21.15.5:0/1562557047 learned_addr learned my addr 172.21.15.5:0/1562557047 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:07.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.138+0000 7f6841400640 1 --2- 172.21.15.5:0/1562557047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f684c0add30 0x7f684c153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.139+0000 7f684a800640 1 -- 172.21.15.5:0/1562557047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684c0ad960 msgr2=0x7f684c1423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.139+0000 7f684a800640 1 --2- 172.21.15.5:0/1562557047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684c0ad960 0x7f684c1423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.139+0000 7f684a800640 1 -- 172.21.15.5:0/1562557047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f684c0add30 msgr2=0x7f684c153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.139+0000 7f684a800640 1 --2- 172.21.15.5:0/1562557047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f684c0add30 0x7f684c153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.139+0000 7f684a800640 1 -- 172.21.15.5:0/1562557047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683c009450 con 0x7f684c0ca050 2024-08-17T02:50:07.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.139+0000 7f684a800640 1 --2- 172.21.15.5:0/1562557047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684c0ca050 0x7f684c1536b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f684400cf30 tx=0x7f6844007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:07.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.139+0000 7f6842000640 1 -- 172.21.15.5:0/1562557047 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684400ae90 con 0x7f684c0ca050 2024-08-17T02:50:07.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.139+0000 7f6842000640 1 -- 172.21.15.5:0/1562557047 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684400d650 con 0x7f684c0ca050 2024-08-17T02:50:07.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.139+0000 7f6842000640 1 -- 172.21.15.5:0/1562557047 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684400da10 con 0x7f684c0ca050 2024-08-17T02:50:07.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.139+0000 7f6850a00640 1 -- 172.21.15.5:0/1562557047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684c0ac670 con 0x7f684c0ca050 2024-08-17T02:50:07.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.140+0000 7f6850a00640 1 -- 172.21.15.5:0/1562557047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684c0acc30 con 0x7f684c0ca050 2024-08-17T02:50:07.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.141+0000 7f6850a00640 1 -- 172.21.15.5:0/1562557047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684c0ad150 con 0x7f684c0ca050 2024-08-17T02:50:07.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.141+0000 7f6842000640 1 -- 172.21.15.5:0/1562557047 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f684401e3b0 con 0x7f684c0ca050 2024-08-17T02:50:07.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.142+0000 7f6842000640 1 --2- 172.21.15.5:0/1562557047 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6828065220 0x7f68280676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.142+0000 7f6842000640 1 -- 172.21.15.5:0/1562557047 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6844083120 con 0x7f684c0ca050 2024-08-17T02:50:07.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.142+0000 7f6849e00640 1 --2- 172.21.15.5:0/1562557047 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6828065220 0x7f68280676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.143+0000 7f6849e00640 1 --2- 172.21.15.5:0/1562557047 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6828065220 0x7f68280676d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f683c009210 tx=0x7f683c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:07.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.146+0000 7f6842000640 1 -- 172.21.15.5:0/1562557047 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f684c0ad150 con 0x7f684c0ca050 2024-08-17T02:50:07.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.327+0000 7f6850a00640 1 -- 172.21.15.5:0/1562557047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f684c0ad110 con 0x7f684c0ca050 2024-08-17T02:50:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.328+0000 7f6842000640 1 -- 172.21.15.5:0/1562557047 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6844050ef0 con 0x7f684c0ca050 2024-08-17T02:50:07.329 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-17T02:50:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.330+0000 7f6850a00640 1 -- 172.21.15.5:0/1562557047 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6828065220 msgr2=0x7f68280676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.330+0000 7f6850a00640 1 --2- 172.21.15.5:0/1562557047 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6828065220 0x7f68280676d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f683c009210 tx=0x7f683c032000 comp rx=0 tx=0).stop 2024-08-17T02:50:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.330+0000 7f6850a00640 1 -- 172.21.15.5:0/1562557047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684c0ca050 msgr2=0x7f684c1536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.330+0000 7f6850a00640 1 --2- 172.21.15.5:0/1562557047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684c0ca050 0x7f684c1536b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f684400cf30 tx=0x7f6844007840 comp rx=0 tx=0).stop 2024-08-17T02:50:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.330+0000 7f6850a00640 1 -- 172.21.15.5:0/1562557047 shutdown_connections 2024-08-17T02:50:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.330+0000 7f6850a00640 1 --2- 172.21.15.5:0/1562557047 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6828065220 0x7f68280676d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.330+0000 7f6850a00640 1 --2- 172.21.15.5:0/1562557047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684c0ca050 0x7f684c1536b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.330+0000 7f6850a00640 1 --2- 172.21.15.5:0/1562557047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f684c0add30 0x7f684c153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.330+0000 7f6850a00640 1 --2- 172.21.15.5:0/1562557047 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f684c0ad960 0x7f684c1423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.330+0000 7f6850a00640 1 -- 172.21.15.5:0/1562557047 >> 172.21.15.5:0/1562557047 conn(0x7f684c066e60 msgr2=0x7f684c14ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.330+0000 7f6850a00640 1 -- 172.21.15.5:0/1562557047 shutdown_connections 2024-08-17T02:50:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.330+0000 7f6850a00640 1 -- 172.21.15.5:0/1562557047 wait complete. 2024-08-17T02:50:07.346 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000724543.meta pg_num 2024-08-17T02:50:07.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.500+0000 7f0c26e00640 1 Processor -- start 2024-08-17T02:50:07.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.500+0000 7f0c26e00640 1 -- start start 2024-08-17T02:50:07.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.501+0000 7f0c26e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c201590b0 0x7f0c200b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.501+0000 7f0c26e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0c200acf10 0x7f0c20159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.501+0000 7f0c26e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c2015a4e0 con 0x7f0c200afca0 2024-08-17T02:50:07.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.501+0000 7f0c26e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c200b0980 con 0x7f0c200acf10 2024-08-17T02:50:07.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.501+0000 7f0c26e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c200c92b0 con 0x7f0c201590b0 2024-08-17T02:50:07.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.501+0000 7f0c24e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0c200acf10 0x7f0c20159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.501+0000 7f0c24e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0c200acf10 0x7f0c20159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58192/0 (socket says 172.21.15.5:58192) 2024-08-17T02:50:07.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.501+0000 7f0c24e00640 1 -- 172.21.15.5:0/1093062502 learned_addr learned my addr 172.21.15.5:0/1093062502 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:07.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.502+0000 7f0c1f400640 1 --2- 172.21.15.5:0/1093062502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c201590b0 0x7f0c200b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.502+0000 7f0c24e00640 1 -- 172.21.15.5:0/1093062502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c201590b0 msgr2=0x7f0c200b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:07.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.502+0000 7f0c24e00640 1 --2- 172.21.15.5:0/1093062502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c201590b0 0x7f0c200b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.502+0000 7f0c24e00640 1 -- 172.21.15.5:0/1093062502 >> v1:172.21.15.107:6789/0 conn(0x7f0c200afca0 legacy=0x7f0c201589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.502+0000 7f0c24e00640 1 -- 172.21.15.5:0/1093062502 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c200ad480 con 0x7f0c200acf10 2024-08-17T02:50:07.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.503+0000 7f0c24e00640 1 --2- 172.21.15.5:0/1093062502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c200acf10 0x7f0c20159fa0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0c18009f20 tx=0x7f0c18009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e746149a36d081e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:07.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.503+0000 7f0c1ea00640 1 -- 172.21.15.5:0/1093062502 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18031440 con 0x7f0c200acf10 2024-08-17T02:50:07.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.503+0000 7f0c1ea00640 1 -- 172.21.15.5:0/1093062502 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c180315a0 con 0x7f0c200acf10 2024-08-17T02:50:07.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.503+0000 7f0c1ea00640 1 -- 172.21.15.5:0/1093062502 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18031980 con 0x7f0c200acf10 2024-08-17T02:50:07.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.504+0000 7f0c26e00640 1 -- 172.21.15.5:0/1093062502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c200acf10 msgr2=0x7f0c20159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.504+0000 7f0c26e00640 1 --2- 172.21.15.5:0/1093062502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c200acf10 0x7f0c20159fa0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0c18009f20 tx=0x7f0c18009840 comp rx=0 tx=0).stop 2024-08-17T02:50:07.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.504+0000 7f0c26e00640 1 -- 172.21.15.5:0/1093062502 shutdown_connections 2024-08-17T02:50:07.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.504+0000 7f0c26e00640 1 --2- 172.21.15.5:0/1093062502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c200acf10 0x7f0c20159fa0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.504+0000 7f0c26e00640 1 --2- 172.21.15.5:0/1093062502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c201590b0 0x7f0c200b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.504+0000 7f0c26e00640 1 -- 172.21.15.5:0/1093062502 >> 172.21.15.5:0/1093062502 conn(0x7f0c20066e60 msgr2=0x7f0c20067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:07.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.504+0000 7f0c26e00640 1 -- 172.21.15.5:0/1093062502 shutdown_connections 2024-08-17T02:50:07.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.504+0000 7f0c26e00640 1 -- 172.21.15.5:0/1093062502 wait complete. 2024-08-17T02:50:07.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.505+0000 7f0c26e00640 1 Processor -- start 2024-08-17T02:50:07.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.505+0000 7f0c26e00640 1 -- start start 2024-08-17T02:50:07.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.506+0000 7f0c26e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c200acf10 0x7f0c200c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.506+0000 7f0c26e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c200afca0 0x7f0c2014ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.506+0000 7f0c26e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c201590b0 0x7f0c201539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.506+0000 7f0c26e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c201568e0 con 0x7f0c201590b0 2024-08-17T02:50:07.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.506+0000 7f0c26e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c20156e30 con 0x7f0c200acf10 2024-08-17T02:50:07.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.506+0000 7f0c26e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c201690a0 con 0x7f0c200afca0 2024-08-17T02:50:07.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.506+0000 7f0c24e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c201590b0 0x7f0c201539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.507+0000 7f0c24e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c201590b0 0x7f0c201539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58208/0 (socket says 172.21.15.5:58208) 2024-08-17T02:50:07.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.507+0000 7f0c24e00640 1 -- 172.21.15.5:0/3107335682 learned_addr learned my addr 172.21.15.5:0/3107335682 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:07.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.507+0000 7f0c1f400640 1 --2- 172.21.15.5:0/3107335682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c200afca0 0x7f0c2014ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.507+0000 7f0c1fe00640 1 --2- 172.21.15.5:0/3107335682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c200acf10 0x7f0c200c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.507+0000 7f0c24e00640 1 -- 172.21.15.5:0/3107335682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c200afca0 msgr2=0x7f0c2014ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.507+0000 7f0c24e00640 1 --2- 172.21.15.5:0/3107335682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c200afca0 0x7f0c2014ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.507+0000 7f0c24e00640 1 -- 172.21.15.5:0/3107335682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c200acf10 msgr2=0x7f0c200c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.507+0000 7f0c24e00640 1 --2- 172.21.15.5:0/3107335682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c200acf10 0x7f0c200c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.507+0000 7f0c24e00640 1 -- 172.21.15.5:0/3107335682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c18009ae0 con 0x7f0c201590b0 2024-08-17T02:50:07.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.507+0000 7f0c1f400640 1 --2- 172.21.15.5:0/3107335682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c200afca0 0x7f0c2014ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:07.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.507+0000 7f0c24e00640 1 --2- 172.21.15.5:0/3107335682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c201590b0 0x7f0c201539a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c18009f20 tx=0x7f0c18039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:07.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.507+0000 7f0c17400640 1 -- 172.21.15.5:0/3107335682 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1800e140 con 0x7f0c201590b0 2024-08-17T02:50:07.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.507+0000 7f0c17400640 1 -- 172.21.15.5:0/3107335682 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1803f070 con 0x7f0c201590b0 2024-08-17T02:50:07.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.507+0000 7f0c17400640 1 -- 172.21.15.5:0/3107335682 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18007ae0 con 0x7f0c201590b0 2024-08-17T02:50:07.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.507+0000 7f0c26e00640 1 -- 172.21.15.5:0/3107335682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c200c7cc0 con 0x7f0c201590b0 2024-08-17T02:50:07.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.508+0000 7f0c26e00640 1 -- 172.21.15.5:0/3107335682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c20156ac0 con 0x7f0c201590b0 2024-08-17T02:50:07.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.509+0000 7f0c26e00640 1 -- 172.21.15.5:0/3107335682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c20156fe0 con 0x7f0c201590b0 2024-08-17T02:50:07.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.509+0000 7f0c17400640 1 -- 172.21.15.5:0/3107335682 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0c18041030 con 0x7f0c201590b0 2024-08-17T02:50:07.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.510+0000 7f0c17400640 1 --2- 172.21.15.5:0/3107335682 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0c00065150 0x7f0c00067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.510+0000 7f0c17400640 1 -- 172.21.15.5:0/3107335682 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f0c180a3c20 con 0x7f0c201590b0 2024-08-17T02:50:07.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.510+0000 7f0c1fe00640 1 --2- 172.21.15.5:0/3107335682 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0c00065150 0x7f0c00067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.511+0000 7f0c1fe00640 1 --2- 172.21.15.5:0/3107335682 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0c00065150 0x7f0c00067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c100037c0 tx=0x7f0c10009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:07.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.514+0000 7f0c17400640 1 -- 172.21.15.5:0/3107335682 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0c20156fe0 con 0x7f0c201590b0 2024-08-17T02:50:07.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.696+0000 7f0c26e00640 1 -- 172.21.15.5:0/3107335682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000724543.meta", "var": "pg_num"} v 0) v1 -- 0x7f0c20156fa0 con 0x7f0c201590b0 2024-08-17T02:50:07.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.696+0000 7f0c17400640 1 -- 172.21.15.5:0/3107335682 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000724543.meta", "var": "pg_num"}]=0 v37) v1 ==== 124+0+11 (secure 0 0 0) 0x7f0c18071980 con 0x7f0c201590b0 2024-08-17T02:50:07.698 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:50:07.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.698+0000 7f0c26e00640 1 -- 172.21.15.5:0/3107335682 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0c00065150 msgr2=0x7f0c00067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.698+0000 7f0c26e00640 1 --2- 172.21.15.5:0/3107335682 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0c00065150 0x7f0c00067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c100037c0 tx=0x7f0c10009040 comp rx=0 tx=0).stop 2024-08-17T02:50:07.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.698+0000 7f0c26e00640 1 -- 172.21.15.5:0/3107335682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c201590b0 msgr2=0x7f0c201539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.698+0000 7f0c26e00640 1 --2- 172.21.15.5:0/3107335682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c201590b0 0x7f0c201539a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c18009f20 tx=0x7f0c18039000 comp rx=0 tx=0).stop 2024-08-17T02:50:07.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.698+0000 7f0c26e00640 1 -- 172.21.15.5:0/3107335682 shutdown_connections 2024-08-17T02:50:07.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.698+0000 7f0c26e00640 1 --2- 172.21.15.5:0/3107335682 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0c00065150 0x7f0c00067600 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.698+0000 7f0c26e00640 1 --2- 172.21.15.5:0/3107335682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c201590b0 0x7f0c201539a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.698+0000 7f0c26e00640 1 --2- 172.21.15.5:0/3107335682 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0c200afca0 0x7f0c2014ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.698+0000 7f0c26e00640 1 --2- 172.21.15.5:0/3107335682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c200acf10 0x7f0c200c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.698+0000 7f0c26e00640 1 -- 172.21.15.5:0/3107335682 >> 172.21.15.5:0/3107335682 conn(0x7f0c20066e60 msgr2=0x7f0c200caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:07.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.699+0000 7f0c26e00640 1 -- 172.21.15.5:0/3107335682 shutdown_connections 2024-08-17T02:50:07.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.699+0000 7f0c26e00640 1 -- 172.21.15.5:0/3107335682 wait complete. 2024-08-17T02:50:07.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000724543.data pg_num 2024-08-17T02:50:07.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.868+0000 7ff9dcc00640 1 Processor -- start 2024-08-17T02:50:07.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.868+0000 7ff9dcc00640 1 -- start start 2024-08-17T02:50:07.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.869+0000 7ff9dcc00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff9d8158a00 0x7ff9d8158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.869+0000 7ff9dcc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9d80cb190 0x7ff9d80cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.869+0000 7ff9dcc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9d806e590 0x7ff9d806e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.869+0000 7ff9dcc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d806ef10 con 0x7ff9d806e590 2024-08-17T02:50:07.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.869+0000 7ff9dcc00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d80cbc50 con 0x7ff9d8158a00 2024-08-17T02:50:07.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.869+0000 7ff9dcc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d80cbf30 con 0x7ff9d80cb190 2024-08-17T02:50:07.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.869+0000 7ff9d7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9d806e590 0x7ff9d806e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.869+0000 7ff9d7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9d806e590 0x7ff9d806e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58222/0 (socket says 172.21.15.5:58222) 2024-08-17T02:50:07.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.869+0000 7ff9d7e00640 1 -- 172.21.15.5:0/444750498 learned_addr learned my addr 172.21.15.5:0/444750498 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:07.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.869+0000 7ff9d6a00640 1 --2- 172.21.15.5:0/444750498 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9d80cb190 0x7ff9d80cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.869+0000 7ff9d7400640 1 --2- 172.21.15.5:0/444750498 >> v2:172.21.15.107:3300/0 conn(0x7ff9d8158a00 0x7ff9d8158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.870+0000 7ff9d7e00640 1 -- 172.21.15.5:0/444750498 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9d80cb190 msgr2=0x7ff9d80cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.870+0000 7ff9d7e00640 1 --2- 172.21.15.5:0/444750498 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9d80cb190 0x7ff9d80cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.870+0000 7ff9d7e00640 1 -- 172.21.15.5:0/444750498 >> v2:172.21.15.107:3300/0 conn(0x7ff9d8158a00 msgr2=0x7ff9d8158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.870+0000 7ff9d7e00640 1 --2- 172.21.15.5:0/444750498 >> v2:172.21.15.107:3300/0 conn(0x7ff9d8158a00 0x7ff9d8158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.870+0000 7ff9d7e00640 1 -- 172.21.15.5:0/444750498 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d80cc210 con 0x7ff9d806e590 2024-08-17T02:50:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.871+0000 7ff9d7e00640 1 --2- 172.21.15.5:0/444750498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9d806e590 0x7ff9d806e9d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80cfae0 tx=0x7ff9d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a285a2ccdcf26882 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:07.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.871+0000 7ff9d6000640 1 -- 172.21.15.5:0/444750498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0031400 con 0x7ff9d806e590 2024-08-17T02:50:07.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.871+0000 7ff9d6000640 1 -- 172.21.15.5:0/444750498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d002d050 con 0x7ff9d806e590 2024-08-17T02:50:07.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.871+0000 7ff9d6000640 1 -- 172.21.15.5:0/444750498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00317d0 con 0x7ff9d806e590 2024-08-17T02:50:07.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.872+0000 7ff9dcc00640 1 -- 172.21.15.5:0/444750498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9d806e590 msgr2=0x7ff9d806e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.872+0000 7ff9dcc00640 1 --2- 172.21.15.5:0/444750498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9d806e590 0x7ff9d806e9d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80cfae0 tx=0x7ff9d0009840 comp rx=0 tx=0).stop 2024-08-17T02:50:07.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.872+0000 7ff9dcc00640 1 -- 172.21.15.5:0/444750498 shutdown_connections 2024-08-17T02:50:07.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.872+0000 7ff9dcc00640 1 --2- 172.21.15.5:0/444750498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9d806e590 0x7ff9d806e9d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.872+0000 7ff9dcc00640 1 --2- 172.21.15.5:0/444750498 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9d80cb190 0x7ff9d80cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.872+0000 7ff9dcc00640 1 --2- 172.21.15.5:0/444750498 >> v2:172.21.15.107:3300/0 conn(0x7ff9d8158a00 0x7ff9d8158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.872+0000 7ff9dcc00640 1 -- 172.21.15.5:0/444750498 >> 172.21.15.5:0/444750498 conn(0x7ff9d80cfb80 msgr2=0x7ff9d80cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:07.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.872+0000 7ff9dcc00640 1 -- 172.21.15.5:0/444750498 shutdown_connections 2024-08-17T02:50:07.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.872+0000 7ff9dcc00640 1 -- 172.21.15.5:0/444750498 wait complete. 2024-08-17T02:50:07.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.873+0000 7ff9dcc00640 1 Processor -- start 2024-08-17T02:50:07.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.873+0000 7ff9dcc00640 1 -- start start 2024-08-17T02:50:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.874+0000 7ff9dcc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9d806e590 0x7ff9d8169720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.874+0000 7ff9dcc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9d80cb190 0x7ff9d81551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.874+0000 7ff9dcc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d8158a00 0x7ff9d8157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.874+0000 7ff9dcc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d8169c60 con 0x7ff9d80cb190 2024-08-17T02:50:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.874+0000 7ff9dcc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d80c6b90 con 0x7ff9d8158a00 2024-08-17T02:50:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.874+0000 7ff9dcc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d80c7430 con 0x7ff9d806e590 2024-08-17T02:50:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.874+0000 7ff9d6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9d80cb190 0x7ff9d81551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.874+0000 7ff9d6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9d80cb190 0x7ff9d81551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58236/0 (socket says 172.21.15.5:58236) 2024-08-17T02:50:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.874+0000 7ff9d6a00640 1 -- 172.21.15.5:0/1201871163 learned_addr learned my addr 172.21.15.5:0/1201871163 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.875+0000 7ff9d7e00640 1 --2- 172.21.15.5:0/1201871163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d8158a00 0x7ff9d8157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.875+0000 7ff9d7400640 1 --2- 172.21.15.5:0/1201871163 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9d806e590 0x7ff9d8169720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.875+0000 7ff9d6a00640 1 -- 172.21.15.5:0/1201871163 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9d806e590 msgr2=0x7ff9d8169720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.875+0000 7ff9d6a00640 1 --2- 172.21.15.5:0/1201871163 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9d806e590 0x7ff9d8169720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.875+0000 7ff9d6a00640 1 -- 172.21.15.5:0/1201871163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d8158a00 msgr2=0x7ff9d8157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:07.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.875+0000 7ff9d6a00640 1 --2- 172.21.15.5:0/1201871163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d8158a00 0x7ff9d8157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:07.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.875+0000 7ff9d6a00640 1 -- 172.21.15.5:0/1201871163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d0009ae0 con 0x7ff9d80cb190 2024-08-17T02:50:07.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.875+0000 7ff9d6a00640 1 --2- 172.21.15.5:0/1201871163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9d80cb190 0x7ff9d81551f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400ea50 tx=0x7ff9c40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:07.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.875+0000 7ff9cea00640 1 -- 172.21.15.5:0/1201871163 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c400ca10 con 0x7ff9d80cb190 2024-08-17T02:50:07.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.875+0000 7ff9cea00640 1 -- 172.21.15.5:0/1201871163 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c400cb70 con 0x7ff9d80cb190 2024-08-17T02:50:07.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.876+0000 7ff9dcc00640 1 -- 172.21.15.5:0/1201871163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d8155d20 con 0x7ff9d80cb190 2024-08-17T02:50:07.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.876+0000 7ff9cea00640 1 -- 172.21.15.5:0/1201871163 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4013470 con 0x7ff9d80cb190 2024-08-17T02:50:07.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.876+0000 7ff9dcc00640 1 -- 172.21.15.5:0/1201871163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d80c6de0 con 0x7ff9d80cb190 2024-08-17T02:50:07.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.877+0000 7ff9dcc00640 1 -- 172.21.15.5:0/1201871163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d8070720 con 0x7ff9d80cb190 2024-08-17T02:50:07.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.878+0000 7ff9cea00640 1 -- 172.21.15.5:0/1201871163 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff9c4013860 con 0x7ff9d80cb190 2024-08-17T02:50:07.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.878+0000 7ff9cea00640 1 --2- 172.21.15.5:0/1201871163 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff9b8065150 0x7ff9b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:07.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.878+0000 7ff9cea00640 1 -- 172.21.15.5:0/1201871163 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7ff9c4082a60 con 0x7ff9d80cb190 2024-08-17T02:50:07.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.879+0000 7ff9d7400640 1 --2- 172.21.15.5:0/1201871163 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff9b8065150 0x7ff9b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:07.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.879+0000 7ff9d7400640 1 --2- 172.21.15.5:0/1201871163 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff9b8065150 0x7ff9b8067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8158620 tx=0x7ff9c80090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:07.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:07.882+0000 7ff9cea00640 1 -- 172.21.15.5:0/1201871163 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff9c40507b0 con 0x7ff9d80cb190 2024-08-17T02:50:08.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.068+0000 7ff9dcc00640 1 -- 172.21.15.5:0/1201871163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000724543.data", "var": "pg_num"} v 0) v1 -- 0x7ff9d80c7570 con 0x7ff9d80cb190 2024-08-17T02:50:08.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.069+0000 7ff9cea00640 1 -- 172.21.15.5:0/1201871163 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000724543.data", "var": "pg_num"}]=0 v37) v1 ==== 124+0+11 (secure 0 0 0) 0x7ff9c4053dd0 con 0x7ff9d80cb190 2024-08-17T02:50:08.070 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:50:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.071+0000 7ff9dcc00640 1 -- 172.21.15.5:0/1201871163 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff9b8065150 msgr2=0x7ff9b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.071+0000 7ff9dcc00640 1 --2- 172.21.15.5:0/1201871163 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff9b8065150 0x7ff9b8067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8158620 tx=0x7ff9c80090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.071+0000 7ff9dcc00640 1 -- 172.21.15.5:0/1201871163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9d80cb190 msgr2=0x7ff9d81551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.071+0000 7ff9dcc00640 1 --2- 172.21.15.5:0/1201871163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9d80cb190 0x7ff9d81551f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400ea50 tx=0x7ff9c40090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.071+0000 7ff9dcc00640 1 -- 172.21.15.5:0/1201871163 shutdown_connections 2024-08-17T02:50:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.071+0000 7ff9dcc00640 1 --2- 172.21.15.5:0/1201871163 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff9b8065150 0x7ff9b8067600 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.071+0000 7ff9dcc00640 1 --2- 172.21.15.5:0/1201871163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9d8158a00 0x7ff9d8157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.071+0000 7ff9dcc00640 1 --2- 172.21.15.5:0/1201871163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9d80cb190 0x7ff9d81551f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.071+0000 7ff9dcc00640 1 --2- 172.21.15.5:0/1201871163 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9d806e590 0x7ff9d8169720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.071+0000 7ff9dcc00640 1 -- 172.21.15.5:0/1201871163 >> 172.21.15.5:0/1201871163 conn(0x7ff9d80cfb80 msgr2=0x7ff9d815b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.071+0000 7ff9dcc00640 1 -- 172.21.15.5:0/1201871163 shutdown_connections 2024-08-17T02:50:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.071+0000 7ff9dcc00640 1 -- 172.21.15.5:0/1201871163 wait complete. 2024-08-17T02:50:08.087 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:50:08.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.237+0000 7faa46200640 1 Processor -- start 2024-08-17T02:50:08.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.237+0000 7faa46200640 1 -- start start 2024-08-17T02:50:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.239+0000 7faa46200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa40158c30 0x7faa4015d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.239+0000 7faa46200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faa4006c6a0 0x7faa4006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.239+0000 7faa46200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa400abe60 con 0x7faa400aef90 2024-08-17T02:50:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.239+0000 7faa46200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4006d080 con 0x7faa4006c6a0 2024-08-17T02:50:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.239+0000 7faa46200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa400ac0c0 con 0x7faa40158c30 2024-08-17T02:50:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.239+0000 7faa3fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faa400aef90 0x7faa400ab750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56694/0 (socket says 172.21.15.5:56694) 2024-08-17T02:50:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.239+0000 7faa3fe00640 1 -- 172.21.15.5:0/3978575538 learned_addr learned my addr 172.21.15.5:0/3978575538 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.239+0000 7faa45800640 1 --2- 172.21.15.5:0/3978575538 >> v2:172.21.15.107:3300/0 conn(0x7faa4006c6a0 0x7faa4006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.239+0000 7faa44e00640 1 --2- 172.21.15.5:0/3978575538 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa40158c30 0x7faa4015d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.239+0000 7faa3f400640 1 -- 172.21.15.5:0/3978575538 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2531602429 0 0) 0x7faa400abe60 con 0x7faa400aef90 2024-08-17T02:50:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.240+0000 7faa3f400640 1 -- 172.21.15.5:0/3978575538 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa280034e0 con 0x7faa400aef90 2024-08-17T02:50:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.240+0000 7faa45800640 1 -- 172.21.15.5:0/3978575538 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa40158c30 msgr2=0x7faa4015d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.240+0000 7faa45800640 1 --2- 172.21.15.5:0/3978575538 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa40158c30 0x7faa4015d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.240+0000 7faa45800640 1 -- 172.21.15.5:0/3978575538 >> v1:172.21.15.5:6789/0 conn(0x7faa400aef90 legacy=0x7faa400ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.240+0000 7faa45800640 1 -- 172.21.15.5:0/3978575538 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa400ac3a0 con 0x7faa4006c6a0 2024-08-17T02:50:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.241+0000 7faa45800640 1 --2- 172.21.15.5:0/3978575538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa4006c6a0 0x7faa4006cb40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faa38009e60 tx=0x7faa38009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62bf4653ec48bc2b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.241+0000 7faa3f400640 1 -- 172.21.15.5:0/3978575538 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38007550 con 0x7faa4006c6a0 2024-08-17T02:50:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.241+0000 7faa3f400640 1 -- 172.21.15.5:0/3978575538 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3802d050 con 0x7faa4006c6a0 2024-08-17T02:50:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.241+0000 7faa3f400640 1 -- 172.21.15.5:0/3978575538 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38007920 con 0x7faa4006c6a0 2024-08-17T02:50:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.242+0000 7faa46200640 1 -- 172.21.15.5:0/3978575538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa4006c6a0 msgr2=0x7faa4006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.242+0000 7faa46200640 1 --2- 172.21.15.5:0/3978575538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa4006c6a0 0x7faa4006cb40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faa38009e60 tx=0x7faa38009780 comp rx=0 tx=0).stop 2024-08-17T02:50:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.242+0000 7faa46200640 1 -- 172.21.15.5:0/3978575538 shutdown_connections 2024-08-17T02:50:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.242+0000 7faa46200640 1 --2- 172.21.15.5:0/3978575538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa4006c6a0 0x7faa4006cb40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.242+0000 7faa46200640 1 --2- 172.21.15.5:0/3978575538 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa40158c30 0x7faa4015d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.242+0000 7faa46200640 1 -- 172.21.15.5:0/3978575538 >> 172.21.15.5:0/3978575538 conn(0x7faa4006e8d0 msgr2=0x7faa4006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.242+0000 7faa46200640 1 -- 172.21.15.5:0/3978575538 shutdown_connections 2024-08-17T02:50:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.242+0000 7faa46200640 1 -- 172.21.15.5:0/3978575538 wait complete. 2024-08-17T02:50:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.243+0000 7faa46200640 1 Processor -- start 2024-08-17T02:50:08.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.243+0000 7faa46200640 1 -- start start 2024-08-17T02:50:08.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.244+0000 7faa46200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa4006c6a0 0x7faa400c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.244+0000 7faa46200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa400aef90 0x7faa400c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.244+0000 7faa46200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa40158c30 0x7faa400c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.244+0000 7faa46200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa401538f0 con 0x7faa40158c30 2024-08-17T02:50:08.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.244+0000 7faa46200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa400b0750 con 0x7faa400aef90 2024-08-17T02:50:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.244+0000 7faa46200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa40153330 con 0x7faa4006c6a0 2024-08-17T02:50:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.244+0000 7faa45800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa40158c30 0x7faa400c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.245+0000 7faa45800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa40158c30 0x7faa400c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58238/0 (socket says 172.21.15.5:58238) 2024-08-17T02:50:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.245+0000 7faa45800640 1 -- 172.21.15.5:0/430578626 learned_addr learned my addr 172.21.15.5:0/430578626 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.245+0000 7faa44e00640 1 --2- 172.21.15.5:0/430578626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa4006c6a0 0x7faa400c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.245+0000 7faa3fe00640 1 --2- 172.21.15.5:0/430578626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa400aef90 0x7faa400c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.245+0000 7faa45800640 1 -- 172.21.15.5:0/430578626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa4006c6a0 msgr2=0x7faa400c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.245+0000 7faa45800640 1 --2- 172.21.15.5:0/430578626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa4006c6a0 0x7faa400c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.245+0000 7faa45800640 1 -- 172.21.15.5:0/430578626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa400aef90 msgr2=0x7faa400c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.245+0000 7faa45800640 1 --2- 172.21.15.5:0/430578626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa400aef90 0x7faa400c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.245+0000 7faa45800640 1 -- 172.21.15.5:0/430578626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38009a20 con 0x7faa40158c30 2024-08-17T02:50:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.245+0000 7faa44e00640 1 --2- 172.21.15.5:0/430578626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa4006c6a0 0x7faa400c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.245+0000 7faa3fe00640 1 --2- 172.21.15.5:0/430578626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa400aef90 0x7faa400c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.245+0000 7faa45800640 1 --2- 172.21.15.5:0/430578626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa40158c30 0x7faa400c7c90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faa38009ec0 tx=0x7faa38037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:08.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.245+0000 7faa33e00640 1 -- 172.21.15.5:0/430578626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38031890 con 0x7faa40158c30 2024-08-17T02:50:08.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.246+0000 7faa46200640 1 -- 172.21.15.5:0/430578626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa40153610 con 0x7faa40158c30 2024-08-17T02:50:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.246+0000 7faa33e00640 1 -- 172.21.15.5:0/430578626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa38040070 con 0x7faa40158c30 2024-08-17T02:50:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.246+0000 7faa33e00640 1 -- 172.21.15.5:0/430578626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38031c20 con 0x7faa40158c30 2024-08-17T02:50:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.246+0000 7faa46200640 1 -- 172.21.15.5:0/430578626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa400b0be0 con 0x7faa40158c30 2024-08-17T02:50:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.247+0000 7faa46200640 1 -- 172.21.15.5:0/430578626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa40070720 con 0x7faa40158c30 2024-08-17T02:50:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.247+0000 7faa33e00640 1 -- 172.21.15.5:0/430578626 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faa38042030 con 0x7faa40158c30 2024-08-17T02:50:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.249+0000 7faa33e00640 1 --2- 172.21.15.5:0/430578626 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faa20065180 0x7faa20067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.249+0000 7faa33e00640 1 -- 172.21.15.5:0/430578626 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7faa380a4250 con 0x7faa40158c30 2024-08-17T02:50:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.249+0000 7faa44e00640 1 --2- 172.21.15.5:0/430578626 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faa20065180 0x7faa20067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.249+0000 7faa44e00640 1 --2- 172.21.15.5:0/430578626 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faa20065180 0x7faa20067630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa40155c20 tx=0x7faa34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.253+0000 7faa33e00640 1 -- 172.21.15.5:0/430578626 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faa38071ef0 con 0x7faa40158c30 2024-08-17T02:50:08.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.478+0000 7faa46200640 1 -- 172.21.15.5:0/430578626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa400b0890 con 0x7faa40158c30 2024-08-17T02:50:08.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.478+0000 7faa33e00640 1 -- 172.21.15.5:0/430578626 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5681 (secure 0 0 0) 0x7faa38075510 con 0x7faa40158c30 2024-08-17T02:50:08.480 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:08.480 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2464391944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2464391944},{"type":"v1","addr":"172.21.15.107:6835","nonce":2464391944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2049823505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2049823505},{"type":"v1","addr":"172.21.15.107:6834","nonce":2049823505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:50.110026+0000","modified":"2024-08-17T02:47:53.706251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/723455700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":723455700},{"type":"v1","addr":"172.21.15.5:6836","nonce":723455700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:48:02.750931+0000","modified":"2024-08-17T02:48:04.145198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4691},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4691":{"gid":4691,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.5:6837/1768626934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1768626934},{"type":"v1","addr":"172.21.15.5:6837","nonce":1768626934}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000724543","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:50:08.480 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 19 2024-08-17T02:50:08.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.480+0000 7faa46200640 1 -- 172.21.15.5:0/430578626 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faa20065180 msgr2=0x7faa20067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.480+0000 7faa46200640 1 --2- 172.21.15.5:0/430578626 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faa20065180 0x7faa20067630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa40155c20 tx=0x7faa34008040 comp rx=0 tx=0).stop 2024-08-17T02:50:08.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.480+0000 7faa46200640 1 -- 172.21.15.5:0/430578626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa40158c30 msgr2=0x7faa400c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.480+0000 7faa46200640 1 --2- 172.21.15.5:0/430578626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa40158c30 0x7faa400c7c90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faa38009ec0 tx=0x7faa38037000 comp rx=0 tx=0).stop 2024-08-17T02:50:08.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.480+0000 7faa46200640 1 -- 172.21.15.5:0/430578626 shutdown_connections 2024-08-17T02:50:08.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.480+0000 7faa46200640 1 --2- 172.21.15.5:0/430578626 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faa20065180 0x7faa20067630 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.480+0000 7faa46200640 1 --2- 172.21.15.5:0/430578626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa40158c30 0x7faa400c7c90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.480+0000 7faa46200640 1 --2- 172.21.15.5:0/430578626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa400aef90 0x7faa400c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.480+0000 7faa46200640 1 --2- 172.21.15.5:0/430578626 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa4006c6a0 0x7faa400c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.480+0000 7faa46200640 1 -- 172.21.15.5:0/430578626 >> 172.21.15.5:0/430578626 conn(0x7faa4006e8d0 msgr2=0x7faa40156660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:08.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.481+0000 7faa46200640 1 -- 172.21.15.5:0/430578626 shutdown_connections 2024-08-17T02:50:08.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.481+0000 7faa46200640 1 -- 172.21.15.5:0/430578626 wait complete. 2024-08-17T02:50:08.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:50:08.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.646+0000 7fa422600640 1 Processor -- start 2024-08-17T02:50:08.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.646+0000 7fa422600640 1 -- start start 2024-08-17T02:50:08.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.648+0000 7fa422600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa41c155010 0x7fa41c069780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.648+0000 7fa422600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa41c159870 0x7fa41c069cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.648+0000 7fa422600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41c1593e0 con 0x7fa41c1553e0 2024-08-17T02:50:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.648+0000 7fa422600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41c1563d0 con 0x7fa41c155010 2024-08-17T02:50:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.648+0000 7fa422600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c158d90 con 0x7fa41c159870 2024-08-17T02:50:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.648+0000 7fa421200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa41c155010 0x7fa41c069780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.648+0000 7fa421200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa41c155010 0x7fa41c069780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58252/0 (socket says 172.21.15.5:58252) 2024-08-17T02:50:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.648+0000 7fa421200640 1 -- 172.21.15.5:0/2503336997 learned_addr learned my addr 172.21.15.5:0/2503336997 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.648+0000 7fa41be00640 1 --2- 172.21.15.5:0/2503336997 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa41c159870 0x7fa41c069cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.648+0000 7fa421200640 1 -- 172.21.15.5:0/2503336997 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa41c159870 msgr2=0x7fa41c069cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.648+0000 7fa421200640 1 --2- 172.21.15.5:0/2503336997 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa41c159870 0x7fa41c069cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.648+0000 7fa421200640 1 -- 172.21.15.5:0/2503336997 >> v1:172.21.15.5:6789/0 conn(0x7fa41c1553e0 legacy=0x7fa41c155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.649+0000 7fa421200640 1 -- 172.21.15.5:0/2503336997 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c159070 con 0x7fa41c155010 2024-08-17T02:50:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.648+0000 7fa41b400640 1 -- 172.21.15.5:0/2503336997 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388931975 0 0) 0x7fa41c1593e0 con 0x7fa41c1553e0 2024-08-17T02:50:08.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.650+0000 7fa421200640 1 --2- 172.21.15.5:0/2503336997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa41c155010 0x7fa41c069780 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa410009910 tx=0x7fa4100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c97bc29e926411f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:08.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.650+0000 7fa41b400640 1 -- 172.21.15.5:0/2503336997 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41002adb0 con 0x7fa41c155010 2024-08-17T02:50:08.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.650+0000 7fa41b400640 1 -- 172.21.15.5:0/2503336997 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa410032440 con 0x7fa41c155010 2024-08-17T02:50:08.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.650+0000 7fa41b400640 1 -- 172.21.15.5:0/2503336997 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4100327e0 con 0x7fa41c155010 2024-08-17T02:50:08.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.650+0000 7fa422600640 1 -- 172.21.15.5:0/2503336997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa41c155010 msgr2=0x7fa41c069780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.650+0000 7fa422600640 1 --2- 172.21.15.5:0/2503336997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa41c155010 0x7fa41c069780 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa410009910 tx=0x7fa4100091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.651+0000 7fa422600640 1 -- 172.21.15.5:0/2503336997 shutdown_connections 2024-08-17T02:50:08.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.651+0000 7fa422600640 1 --2- 172.21.15.5:0/2503336997 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa41c159870 0x7fa41c069cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.651+0000 7fa422600640 1 --2- 172.21.15.5:0/2503336997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa41c155010 0x7fa41c069780 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.651+0000 7fa422600640 1 -- 172.21.15.5:0/2503336997 >> 172.21.15.5:0/2503336997 conn(0x7fa41c062af0 msgr2=0x7fa41c062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:08.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.651+0000 7fa422600640 1 -- 172.21.15.5:0/2503336997 shutdown_connections 2024-08-17T02:50:08.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.651+0000 7fa422600640 1 -- 172.21.15.5:0/2503336997 wait complete. 2024-08-17T02:50:08.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.652+0000 7fa422600640 1 Processor -- start 2024-08-17T02:50:08.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.652+0000 7fa422600640 1 -- start start 2024-08-17T02:50:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.653+0000 7fa422600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa41c155010 0x7fa41c13d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.653+0000 7fa422600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa41c1553e0 0x7fa41c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.653+0000 7fa422600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa41c159870 0x7fa41c153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.653+0000 7fa422600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0c1520 con 0x7fa41c159870 2024-08-17T02:50:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.653+0000 7fa422600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0c0910 con 0x7fa41c155010 2024-08-17T02:50:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.653+0000 7fa422600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0c0bf0 con 0x7fa41c1553e0 2024-08-17T02:50:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.653+0000 7fa421c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa41c159870 0x7fa41c153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.653+0000 7fa421c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa41c159870 0x7fa41c153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58258/0 (socket says 172.21.15.5:58258) 2024-08-17T02:50:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.653+0000 7fa421c00640 1 -- 172.21.15.5:0/3966084683 learned_addr learned my addr 172.21.15.5:0/3966084683 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.653+0000 7fa421200640 1 --2- 172.21.15.5:0/3966084683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa41c155010 0x7fa41c13d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.654+0000 7fa41be00640 1 --2- 172.21.15.5:0/3966084683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa41c1553e0 0x7fa41c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.654+0000 7fa421c00640 1 -- 172.21.15.5:0/3966084683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa41c1553e0 msgr2=0x7fa41c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.654+0000 7fa421c00640 1 --2- 172.21.15.5:0/3966084683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa41c1553e0 0x7fa41c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.654+0000 7fa421c00640 1 -- 172.21.15.5:0/3966084683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa41c155010 msgr2=0x7fa41c13d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.654+0000 7fa421c00640 1 --2- 172.21.15.5:0/3966084683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa41c155010 0x7fa41c13d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.654+0000 7fa421c00640 1 -- 172.21.15.5:0/3966084683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa410009450 con 0x7fa41c159870 2024-08-17T02:50:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.654+0000 7fa421c00640 1 --2- 172.21.15.5:0/3966084683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa41c159870 0x7fa41c153460 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa41400c890 tx=0x7fa414001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.654+0000 7fa40fe00640 1 -- 172.21.15.5:0/3966084683 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41400ce80 con 0x7fa41c159870 2024-08-17T02:50:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.655+0000 7fa40fe00640 1 -- 172.21.15.5:0/3966084683 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41400a850 con 0x7fa41c159870 2024-08-17T02:50:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.655+0000 7fa422600640 1 -- 172.21.15.5:0/3966084683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c0c0ed0 con 0x7fa41c159870 2024-08-17T02:50:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.655+0000 7fa40fe00640 1 -- 172.21.15.5:0/3966084683 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41400ac10 con 0x7fa41c159870 2024-08-17T02:50:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.655+0000 7fa422600640 1 -- 172.21.15.5:0/3966084683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41c13d9c0 con 0x7fa41c159870 2024-08-17T02:50:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.656+0000 7fa422600640 1 -- 172.21.15.5:0/3966084683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41c0c16d0 con 0x7fa41c159870 2024-08-17T02:50:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.656+0000 7fa40fe00640 1 -- 172.21.15.5:0/3966084683 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa414003030 con 0x7fa41c159870 2024-08-17T02:50:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.657+0000 7fa40fe00640 1 --2- 172.21.15.5:0/3966084683 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa3fc065220 0x7fa3fc0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.657+0000 7fa40fe00640 1 -- 172.21.15.5:0/3966084683 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fa414082610 con 0x7fa41c159870 2024-08-17T02:50:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.658+0000 7fa421200640 1 --2- 172.21.15.5:0/3966084683 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa3fc065220 0x7fa3fc0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.658+0000 7fa421200640 1 --2- 172.21.15.5:0/3966084683 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa3fc065220 0x7fa3fc0676d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa410034000 tx=0x7fa410032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.661+0000 7fa40fe00640 1 -- 172.21.15.5:0/3966084683 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa41c0c16d0 con 0x7fa41c159870 2024-08-17T02:50:08.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.845+0000 7fa422600640 1 -- 172.21.15.5:0/3966084683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa41c0c16d0 con 0x7fa41c159870 2024-08-17T02:50:08.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.846+0000 7fa40fe00640 1 -- 172.21.15.5:0/3966084683 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18551 (secure 0 0 0) 0x7fa41c0c16d0 con 0x7fa41c159870 2024-08-17T02:50:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:08.848 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":37,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:48:05.751103+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:48.185879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:49.106113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000724543.meta","create_time":"2024-08-17T02:48:00.937205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000724543"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000724543.data","create_time":"2024-08-17T02:48:01.789476+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000724543"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:50:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.849+0000 7fa422600640 1 -- 172.21.15.5:0/3966084683 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa3fc065220 msgr2=0x7fa3fc0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.849+0000 7fa422600640 1 --2- 172.21.15.5:0/3966084683 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa3fc065220 0x7fa3fc0676d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa410034000 tx=0x7fa410032000 comp rx=0 tx=0).stop 2024-08-17T02:50:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.849+0000 7fa422600640 1 -- 172.21.15.5:0/3966084683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa41c159870 msgr2=0x7fa41c153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.849+0000 7fa422600640 1 --2- 172.21.15.5:0/3966084683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa41c159870 0x7fa41c153460 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa41400c890 tx=0x7fa414001630 comp rx=0 tx=0).stop 2024-08-17T02:50:08.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.849+0000 7fa422600640 1 -- 172.21.15.5:0/3966084683 shutdown_connections 2024-08-17T02:50:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.849+0000 7fa422600640 1 --2- 172.21.15.5:0/3966084683 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fa3fc065220 0x7fa3fc0676d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.849+0000 7fa422600640 1 --2- 172.21.15.5:0/3966084683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa41c159870 0x7fa41c153460 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.849+0000 7fa422600640 1 --2- 172.21.15.5:0/3966084683 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa41c1553e0 0x7fa41c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.849+0000 7fa422600640 1 --2- 172.21.15.5:0/3966084683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa41c155010 0x7fa41c13d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.849+0000 7fa422600640 1 -- 172.21.15.5:0/3966084683 >> 172.21.15.5:0/3966084683 conn(0x7fa41c062af0 msgr2=0x7fa41c0c9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.849+0000 7fa422600640 1 -- 172.21.15.5:0/3966084683 shutdown_connections 2024-08-17T02:50:08.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:08.849+0000 7fa422600640 1 -- 172.21.15.5:0/3966084683 wait complete. 2024-08-17T02:50:08.866 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:50:08.866 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:50:09.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.017+0000 7feb67200640 1 Processor -- start 2024-08-17T02:50:09.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.018+0000 7feb67200640 1 -- start start 2024-08-17T02:50:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.019+0000 7feb67200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feb6815d570 0x7feb68163c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.019+0000 7feb67200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6815c9d0 con 0x7feb680cd550 2024-08-17T02:50:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.019+0000 7feb67200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6815a200 con 0x7feb68069840 2024-08-17T02:50:09.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.019+0000 7feb67200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb680cbfe0 con 0x7feb6815d570 2024-08-17T02:50:09.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.019+0000 7feb5fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feb680cd550 0x7feb6815ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56714/0 (socket says 172.21.15.5:56714) 2024-08-17T02:50:09.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.019+0000 7feb5fe00640 1 -- 172.21.15.5:0/2197312198 learned_addr learned my addr 172.21.15.5:0/2197312198 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:09.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.019+0000 7feb66800640 1 --2- 172.21.15.5:0/2197312198 >> v2:172.21.15.107:3300/0 conn(0x7feb6815d570 0x7feb68163c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.020+0000 7feb65400640 1 -- 172.21.15.5:0/2197312198 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787999597 0 0) 0x7feb6815c9d0 con 0x7feb680cd550 2024-08-17T02:50:09.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.020+0000 7feb65400640 1 -- 172.21.15.5:0/2197312198 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb4c0034e0 con 0x7feb680cd550 2024-08-17T02:50:09.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.020+0000 7feb65400640 1 -- 172.21.15.5:0/2197312198 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720092748 0 0) 0x7feb6815a200 con 0x7feb68069840 2024-08-17T02:50:09.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.020+0000 7feb65400640 1 -- 172.21.15.5:0/2197312198 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb6815c9d0 con 0x7feb68069840 2024-08-17T02:50:09.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.020+0000 7feb66800640 1 -- 172.21.15.5:0/2197312198 >> v1:172.21.15.107:6789/0 conn(0x7feb68069840 legacy=0x7feb680cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.020+0000 7feb66800640 1 -- 172.21.15.5:0/2197312198 >> v1:172.21.15.5:6789/0 conn(0x7feb680cd550 legacy=0x7feb6815ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.020+0000 7feb66800640 1 -- 172.21.15.5:0/2197312198 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680b0830 con 0x7feb6815d570 2024-08-17T02:50:09.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.021+0000 7feb66800640 1 --2- 172.21.15.5:0/2197312198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb6815d570 0x7feb68163c40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feb60009e60 tx=0x7feb60009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dfab54a753ff4a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:09.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.021+0000 7feb65400640 1 -- 172.21.15.5:0/2197312198 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb60007550 con 0x7feb6815d570 2024-08-17T02:50:09.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.021+0000 7feb65400640 1 -- 172.21.15.5:0/2197312198 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6002d050 con 0x7feb6815d570 2024-08-17T02:50:09.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.021+0000 7feb65400640 1 -- 172.21.15.5:0/2197312198 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600078c0 con 0x7feb6815d570 2024-08-17T02:50:09.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.022+0000 7feb67200640 1 -- 172.21.15.5:0/2197312198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb6815d570 msgr2=0x7feb68163c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.022+0000 7feb67200640 1 --2- 172.21.15.5:0/2197312198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb6815d570 0x7feb68163c40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feb60009e60 tx=0x7feb60009780 comp rx=0 tx=0).stop 2024-08-17T02:50:09.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.022+0000 7feb67200640 1 -- 172.21.15.5:0/2197312198 shutdown_connections 2024-08-17T02:50:09.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.022+0000 7feb67200640 1 --2- 172.21.15.5:0/2197312198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb6815d570 0x7feb68163c40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.022+0000 7feb67200640 1 -- 172.21.15.5:0/2197312198 >> 172.21.15.5:0/2197312198 conn(0x7feb68066e60 msgr2=0x7feb68067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:09.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.022+0000 7feb67200640 1 -- 172.21.15.5:0/2197312198 shutdown_connections 2024-08-17T02:50:09.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.022+0000 7feb67200640 1 -- 172.21.15.5:0/2197312198 wait complete. 2024-08-17T02:50:09.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.023+0000 7feb67200640 1 Processor -- start 2024-08-17T02:50:09.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.024+0000 7feb67200640 1 -- start start 2024-08-17T02:50:09.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.024+0000 7feb67200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb68069840 0x7feb68157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.024+0000 7feb67200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb6815d570 0x7feb68154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.024+0000 7feb67200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb68155440 0x7feb68144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.024+0000 7feb67200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb68168ef0 con 0x7feb68069840 2024-08-17T02:50:09.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.024+0000 7feb67200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb68157550 con 0x7feb68155440 2024-08-17T02:50:09.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.024+0000 7feb67200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6815b330 con 0x7feb6815d570 2024-08-17T02:50:09.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.025+0000 7feb65e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb68069840 0x7feb68157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.025+0000 7feb65e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb68069840 0x7feb68157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58264/0 (socket says 172.21.15.5:58264) 2024-08-17T02:50:09.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.025+0000 7feb65e00640 1 -- 172.21.15.5:0/3911976484 learned_addr learned my addr 172.21.15.5:0/3911976484 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:09.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.025+0000 7feb5fe00640 1 --2- 172.21.15.5:0/3911976484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb6815d570 0x7feb68154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.025+0000 7feb66800640 1 --2- 172.21.15.5:0/3911976484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb68155440 0x7feb68144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.025+0000 7feb65e00640 1 -- 172.21.15.5:0/3911976484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb6815d570 msgr2=0x7feb68154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.025+0000 7feb65e00640 1 --2- 172.21.15.5:0/3911976484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb6815d570 0x7feb68154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.025+0000 7feb65e00640 1 -- 172.21.15.5:0/3911976484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb68155440 msgr2=0x7feb68144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.025+0000 7feb65e00640 1 --2- 172.21.15.5:0/3911976484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb68155440 0x7feb68144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.025+0000 7feb65e00640 1 -- 172.21.15.5:0/3911976484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb60009a20 con 0x7feb68069840 2024-08-17T02:50:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.025+0000 7feb66800640 1 --2- 172.21.15.5:0/3911976484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb68155440 0x7feb68144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.025+0000 7feb5fe00640 1 --2- 172.21.15.5:0/3911976484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb6815d570 0x7feb68154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.025+0000 7feb65e00640 1 --2- 172.21.15.5:0/3911976484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb68069840 0x7feb68157010 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feb5800c590 tx=0x7feb58007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.026+0000 7feb5d600640 1 -- 172.21.15.5:0/3911976484 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58012630 con 0x7feb68069840 2024-08-17T02:50:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.026+0000 7feb5d600640 1 -- 172.21.15.5:0/3911976484 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb580127b0 con 0x7feb68069840 2024-08-17T02:50:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.026+0000 7feb5d600640 1 -- 172.21.15.5:0/3911976484 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58012bb0 con 0x7feb68069840 2024-08-17T02:50:09.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.026+0000 7feb67200640 1 -- 172.21.15.5:0/3911976484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb6815b610 con 0x7feb68069840 2024-08-17T02:50:09.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.026+0000 7feb67200640 1 -- 172.21.15.5:0/3911976484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb6815bbd0 con 0x7feb68069840 2024-08-17T02:50:09.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.027+0000 7feb67200640 1 -- 172.21.15.5:0/3911976484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb68070720 con 0x7feb68069840 2024-08-17T02:50:09.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.028+0000 7feb5d600640 1 -- 172.21.15.5:0/3911976484 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7feb5801a3b0 con 0x7feb68069840 2024-08-17T02:50:09.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.029+0000 7feb5d600640 1 --2- 172.21.15.5:0/3911976484 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7feb44065150 0x7feb44067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.029+0000 7feb5d600640 1 -- 172.21.15.5:0/3911976484 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7feb58082810 con 0x7feb68069840 2024-08-17T02:50:09.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.029+0000 7feb5fe00640 1 --2- 172.21.15.5:0/3911976484 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7feb44065150 0x7feb44067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.030+0000 7feb5fe00640 1 --2- 172.21.15.5:0/3911976484 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7feb44065150 0x7feb44067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feb6806d9d0 tx=0x7feb50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.033+0000 7feb5d600640 1 -- 172.21.15.5:0/3911976484 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7feb580504b0 con 0x7feb68069840 2024-08-17T02:50:09.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.251+0000 7feb67200640 1 -- 172.21.15.5:0/3911976484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb6809b470 con 0x7feb68069840 2024-08-17T02:50:09.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.251+0000 7feb5d600640 1 -- 172.21.15.5:0/3911976484 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5681 (secure 0 0 0) 0x7feb58053ad0 con 0x7feb68069840 2024-08-17T02:50:09.252 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:09.253 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2464391944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2464391944},{"type":"v1","addr":"172.21.15.107:6835","nonce":2464391944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2049823505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2049823505},{"type":"v1","addr":"172.21.15.107:6834","nonce":2049823505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:50.110026+0000","modified":"2024-08-17T02:47:53.706251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/723455700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":723455700},{"type":"v1","addr":"172.21.15.5:6836","nonce":723455700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:48:02.750931+0000","modified":"2024-08-17T02:48:04.145198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4691},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4691":{"gid":4691,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.5:6837/1768626934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1768626934},{"type":"v1","addr":"172.21.15.5:6837","nonce":1768626934}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000724543","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:50:09.253 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 19 2024-08-17T02:50:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.253+0000 7feb67200640 1 -- 172.21.15.5:0/3911976484 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7feb44065150 msgr2=0x7feb44067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.253+0000 7feb67200640 1 --2- 172.21.15.5:0/3911976484 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7feb44065150 0x7feb44067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feb6806d9d0 tx=0x7feb50009040 comp rx=0 tx=0).stop 2024-08-17T02:50:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.253+0000 7feb67200640 1 -- 172.21.15.5:0/3911976484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb68069840 msgr2=0x7feb68157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.253+0000 7feb67200640 1 --2- 172.21.15.5:0/3911976484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb68069840 0x7feb68157010 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feb5800c590 tx=0x7feb58007d80 comp rx=0 tx=0).stop 2024-08-17T02:50:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.253+0000 7feb67200640 1 -- 172.21.15.5:0/3911976484 shutdown_connections 2024-08-17T02:50:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.253+0000 7feb67200640 1 --2- 172.21.15.5:0/3911976484 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7feb44065150 0x7feb44067600 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.253+0000 7feb67200640 1 --2- 172.21.15.5:0/3911976484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb68155440 0x7feb68144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.253+0000 7feb67200640 1 --2- 172.21.15.5:0/3911976484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7feb6815d570 0x7feb68154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.253+0000 7feb67200640 1 --2- 172.21.15.5:0/3911976484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb68069840 0x7feb68157010 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.253+0000 7feb67200640 1 -- 172.21.15.5:0/3911976484 >> 172.21.15.5:0/3911976484 conn(0x7feb68066e60 msgr2=0x7feb680686e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.253+0000 7feb67200640 1 -- 172.21.15.5:0/3911976484 shutdown_connections 2024-08-17T02:50:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.254+0000 7feb67200640 1 -- 172.21.15.5:0/3911976484 wait complete. 2024-08-17T02:50:09.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:50:09.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.425+0000 7f6986e00640 1 Processor -- start 2024-08-17T02:50:09.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.425+0000 7f6986e00640 1 -- start start 2024-08-17T02:50:09.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.426+0000 7f6986e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f698015a490 0x7f69800ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.426+0000 7f6986e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69800b1920 0x7f69800b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.426+0000 7f6986e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698015a880 con 0x7f6980158c60 2024-08-17T02:50:09.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.426+0000 7f6986e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69800b0540 con 0x7f69800b1920 2024-08-17T02:50:09.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.426+0000 7f6986e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698015b6b0 con 0x7f698015a490 2024-08-17T02:50:09.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.426+0000 7f6986400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69800b1920 0x7f69800b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.426+0000 7f6986400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69800b1920 0x7f69800b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58272/0 (socket says 172.21.15.5:58272) 2024-08-17T02:50:09.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.426+0000 7f6986400640 1 -- 172.21.15.5:0/233125115 learned_addr learned my addr 172.21.15.5:0/233125115 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:09.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.426+0000 7f6985000640 1 --2- 172.21.15.5:0/233125115 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f698015a490 0x7f69800ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.427+0000 7f6986400640 1 -- 172.21.15.5:0/233125115 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f698015a490 msgr2=0x7f69800ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:09.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.427+0000 7f6986400640 1 --2- 172.21.15.5:0/233125115 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f698015a490 0x7f69800ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.427+0000 7f6986400640 1 -- 172.21.15.5:0/233125115 >> v1:172.21.15.107:6789/0 conn(0x7f6980158c60 legacy=0x7f6980159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:09.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.427+0000 7f6986400640 1 -- 172.21.15.5:0/233125115 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698015aac0 con 0x7f69800b1920 2024-08-17T02:50:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.428+0000 7f6986400640 1 --2- 172.21.15.5:0/233125115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69800b1920 0x7f69800b1d60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6978009f20 tx=0x7f6978009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a236d7e0f454fbf9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.428+0000 7f697fe00640 1 -- 172.21.15.5:0/233125115 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978031400 con 0x7f69800b1920 2024-08-17T02:50:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.428+0000 7f697fe00640 1 -- 172.21.15.5:0/233125115 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697802d050 con 0x7f69800b1920 2024-08-17T02:50:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.428+0000 7f697fe00640 1 -- 172.21.15.5:0/233125115 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69780317d0 con 0x7f69800b1920 2024-08-17T02:50:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.429+0000 7f6986e00640 1 -- 172.21.15.5:0/233125115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69800b1920 msgr2=0x7f69800b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.429+0000 7f6986e00640 1 --2- 172.21.15.5:0/233125115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69800b1920 0x7f69800b1d60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6978009f20 tx=0x7f6978009840 comp rx=0 tx=0).stop 2024-08-17T02:50:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.429+0000 7f6986e00640 1 -- 172.21.15.5:0/233125115 shutdown_connections 2024-08-17T02:50:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.429+0000 7f6986e00640 1 --2- 172.21.15.5:0/233125115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69800b1920 0x7f69800b1d60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.429+0000 7f6986e00640 1 --2- 172.21.15.5:0/233125115 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f698015a490 0x7f69800ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.429+0000 7f6986e00640 1 -- 172.21.15.5:0/233125115 >> 172.21.15.5:0/233125115 conn(0x7f698006e590 msgr2=0x7f698006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.429+0000 7f6986e00640 1 -- 172.21.15.5:0/233125115 shutdown_connections 2024-08-17T02:50:09.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.429+0000 7f6986e00640 1 -- 172.21.15.5:0/233125115 wait complete. 2024-08-17T02:50:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.430+0000 7f6986e00640 1 Processor -- start 2024-08-17T02:50:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.430+0000 7f6986e00640 1 -- start start 2024-08-17T02:50:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.431+0000 7f6986e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69800b1920 0x7f69800cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.431+0000 7f6986e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6980158c60 0x7f69800a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.431+0000 7f6986e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f698015a490 0x7f69800cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.431+0000 7f6986e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69800cf290 con 0x7f69800b1920 2024-08-17T02:50:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.431+0000 7f6986e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69800ce3e0 con 0x7f6980158c60 2024-08-17T02:50:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.431+0000 7f6986e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69800ce680 con 0x7f698015a490 2024-08-17T02:50:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.431+0000 7f6985a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69800b1920 0x7f69800cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.431+0000 7f6985a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69800b1920 0x7f69800cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58286/0 (socket says 172.21.15.5:58286) 2024-08-17T02:50:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.431+0000 7f6985a00640 1 -- 172.21.15.5:0/3883638255 learned_addr learned my addr 172.21.15.5:0/3883638255 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.432+0000 7f6986400640 1 --2- 172.21.15.5:0/3883638255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f698015a490 0x7f69800cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.432+0000 7f6985000640 1 --2- 172.21.15.5:0/3883638255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6980158c60 0x7f69800a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.432+0000 7f6985a00640 1 -- 172.21.15.5:0/3883638255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f698015a490 msgr2=0x7f69800cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.432+0000 7f6985a00640 1 --2- 172.21.15.5:0/3883638255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f698015a490 0x7f69800cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.432+0000 7f6985a00640 1 -- 172.21.15.5:0/3883638255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6980158c60 msgr2=0x7f69800a69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.432+0000 7f6985a00640 1 --2- 172.21.15.5:0/3883638255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6980158c60 0x7f69800a69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.432+0000 7f6985a00640 1 -- 172.21.15.5:0/3883638255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6978009ae0 con 0x7f69800b1920 2024-08-17T02:50:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.432+0000 7f6985000640 1 --2- 172.21.15.5:0/3883638255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6980158c60 0x7f69800a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.432+0000 7f6986400640 1 --2- 172.21.15.5:0/3883638255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f698015a490 0x7f69800cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.432+0000 7f6985a00640 1 --2- 172.21.15.5:0/3883638255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69800b1920 0x7f69800cf720 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f697400c560 tx=0x7f6974007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.432+0000 7f697cc00640 1 -- 172.21.15.5:0/3883638255 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6974011590 con 0x7f69800b1920 2024-08-17T02:50:09.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.432+0000 7f697cc00640 1 -- 172.21.15.5:0/3883638255 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6974011710 con 0x7f69800b1920 2024-08-17T02:50:09.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.432+0000 7f6986e00640 1 -- 172.21.15.5:0/3883638255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69800ce960 con 0x7f69800b1920 2024-08-17T02:50:09.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.432+0000 7f697cc00640 1 -- 172.21.15.5:0/3883638255 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6974011ad0 con 0x7f69800b1920 2024-08-17T02:50:09.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.432+0000 7f6986e00640 1 -- 172.21.15.5:0/3883638255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69800cef20 con 0x7f69800b1920 2024-08-17T02:50:09.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.434+0000 7f6986e00640 1 -- 172.21.15.5:0/3883638255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6980070720 con 0x7f69800b1920 2024-08-17T02:50:09.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.435+0000 7f697cc00640 1 -- 172.21.15.5:0/3883638255 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f697401b3b0 con 0x7f69800b1920 2024-08-17T02:50:09.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.435+0000 7f697cc00640 1 --2- 172.21.15.5:0/3883638255 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6960065150 0x7f6960067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.435+0000 7f697cc00640 1 -- 172.21.15.5:0/3883638255 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6974081c10 con 0x7f69800b1920 2024-08-17T02:50:09.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.436+0000 7f6985000640 1 --2- 172.21.15.5:0/3883638255 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6960065150 0x7f6960067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.436+0000 7f6985000640 1 --2- 172.21.15.5:0/3883638255 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6960065150 0x7f6960067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f69800d03f0 tx=0x7f696c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:09.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.440+0000 7f697cc00640 1 -- 172.21.15.5:0/3883638255 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f697404f8b0 con 0x7f69800b1920 2024-08-17T02:50:09.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.662+0000 7f6986e00640 1 -- 172.21.15.5:0/3883638255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f698015a880 con 0x7f69800b1920 2024-08-17T02:50:09.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.662+0000 7f697cc00640 1 -- 172.21.15.5:0/3883638255 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5681 (secure 0 0 0) 0x7f698015a880 con 0x7f69800b1920 2024-08-17T02:50:09.664 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:09.664 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2464391944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2464391944},{"type":"v1","addr":"172.21.15.107:6835","nonce":2464391944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2049823505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2049823505},{"type":"v1","addr":"172.21.15.107:6834","nonce":2049823505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:50.110026+0000","modified":"2024-08-17T02:47:53.706251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/723455700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":723455700},{"type":"v1","addr":"172.21.15.5:6836","nonce":723455700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:48:02.750931+0000","modified":"2024-08-17T02:48:04.145198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4691},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4691":{"gid":4691,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.5:6837/1768626934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1768626934},{"type":"v1","addr":"172.21.15.5:6837","nonce":1768626934}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000724543","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:50:09.664 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 19 2024-08-17T02:50:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.664+0000 7f6986e00640 1 -- 172.21.15.5:0/3883638255 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6960065150 msgr2=0x7f6960067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.664+0000 7f6986e00640 1 --2- 172.21.15.5:0/3883638255 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6960065150 0x7f6960067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f69800d03f0 tx=0x7f696c008040 comp rx=0 tx=0).stop 2024-08-17T02:50:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.664+0000 7f6986e00640 1 -- 172.21.15.5:0/3883638255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69800b1920 msgr2=0x7f69800cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.664+0000 7f6986e00640 1 --2- 172.21.15.5:0/3883638255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69800b1920 0x7f69800cf720 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f697400c560 tx=0x7f6974007ef0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.664+0000 7f6986e00640 1 -- 172.21.15.5:0/3883638255 shutdown_connections 2024-08-17T02:50:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.664+0000 7f6986e00640 1 --2- 172.21.15.5:0/3883638255 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6960065150 0x7f6960067600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.664+0000 7f6986e00640 1 --2- 172.21.15.5:0/3883638255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f698015a490 0x7f69800cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.664+0000 7f6986e00640 1 --2- 172.21.15.5:0/3883638255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6980158c60 0x7f69800a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.664+0000 7f6986e00640 1 --2- 172.21.15.5:0/3883638255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69800b1920 0x7f69800cf720 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.664+0000 7f6986e00640 1 -- 172.21.15.5:0/3883638255 >> 172.21.15.5:0/3883638255 conn(0x7f698006e590 msgr2=0x7f69800ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.665+0000 7f6986e00640 1 -- 172.21.15.5:0/3883638255 shutdown_connections 2024-08-17T02:50:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.665+0000 7f6986e00640 1 -- 172.21.15.5:0/3883638255 wait complete. 2024-08-17T02:50:09.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:50:09.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.830+0000 7faacb000640 1 Processor -- start 2024-08-17T02:50:09.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.831+0000 7faacb000640 1 -- start start 2024-08-17T02:50:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.832+0000 7faacb000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faac4158c90 0x7faac40ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.832+0000 7faacb000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faac40cadc0 0x7faac40cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.832+0000 7faacb000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac40cf600 con 0x7faac40cca40 2024-08-17T02:50:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.832+0000 7faacb000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac40cea90 con 0x7faac40cadc0 2024-08-17T02:50:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.832+0000 7faacb000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac40ced30 con 0x7faac4158c90 2024-08-17T02:50:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.832+0000 7faac9200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faac40cadc0 0x7faac40cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.832+0000 7faac9200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faac40cadc0 0x7faac40cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58288/0 (socket says 172.21.15.5:58288) 2024-08-17T02:50:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.832+0000 7faac9200640 1 -- 172.21.15.5:0/4007758918 learned_addr learned my addr 172.21.15.5:0/4007758918 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:09.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.832+0000 7faaca600640 1 --1- 172.21.15.5:0/4007758918 >> v1:172.21.15.5:6789/0 conn(0x7faac40cca40 0x7faac40685f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56724/0 (socket says 172.21.15.5:56724) 2024-08-17T02:50:09.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.832+0000 7faac9c00640 1 --2- 172.21.15.5:0/4007758918 >> v2:172.21.15.107:3300/0 conn(0x7faac4158c90 0x7faac40ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.833+0000 7faac9200640 1 -- 172.21.15.5:0/4007758918 >> v2:172.21.15.107:3300/0 conn(0x7faac4158c90 msgr2=0x7faac40ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:09.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.833+0000 7faac9200640 1 --2- 172.21.15.5:0/4007758918 >> v2:172.21.15.107:3300/0 conn(0x7faac4158c90 0x7faac40ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.833+0000 7faac9200640 1 -- 172.21.15.5:0/4007758918 >> v1:172.21.15.5:6789/0 conn(0x7faac40cca40 legacy=0x7faac40685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.833+0000 7faac9200640 1 -- 172.21.15.5:0/4007758918 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac40cefd0 con 0x7faac40cadc0 2024-08-17T02:50:09.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.833+0000 7faac3e00640 1 -- 172.21.15.5:0/4007758918 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415564478 0 0) 0x7faac40cf600 con 0x7faac40cca40 2024-08-17T02:50:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.834+0000 7faac9200640 1 --2- 172.21.15.5:0/4007758918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40cadc0 0x7faac40cc500 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faac406f380 tx=0x7faab00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f930fcf619b291d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.834+0000 7faac3e00640 1 -- 172.21.15.5:0/4007758918 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab002ae80 con 0x7faac40cadc0 2024-08-17T02:50:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.834+0000 7faac3e00640 1 -- 172.21.15.5:0/4007758918 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab0032440 con 0x7faac40cadc0 2024-08-17T02:50:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.834+0000 7faac3e00640 1 -- 172.21.15.5:0/4007758918 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab00327c0 con 0x7faac40cadc0 2024-08-17T02:50:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.834+0000 7faacb000640 1 -- 172.21.15.5:0/4007758918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40cadc0 msgr2=0x7faac40cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.834+0000 7faacb000640 1 --2- 172.21.15.5:0/4007758918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40cadc0 0x7faac40cc500 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faac406f380 tx=0x7faab00091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.835+0000 7faacb000640 1 -- 172.21.15.5:0/4007758918 shutdown_connections 2024-08-17T02:50:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.835+0000 7faacb000640 1 --2- 172.21.15.5:0/4007758918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40cadc0 0x7faac40cc500 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.835+0000 7faacb000640 1 --2- 172.21.15.5:0/4007758918 >> v2:172.21.15.107:3300/0 conn(0x7faac4158c90 0x7faac40ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.835+0000 7faacb000640 1 -- 172.21.15.5:0/4007758918 >> 172.21.15.5:0/4007758918 conn(0x7faac4087a80 msgr2=0x7faac406e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.835+0000 7faacb000640 1 -- 172.21.15.5:0/4007758918 shutdown_connections 2024-08-17T02:50:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.835+0000 7faacb000640 1 -- 172.21.15.5:0/4007758918 wait complete. 2024-08-17T02:50:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.836+0000 7faacb000640 1 Processor -- start 2024-08-17T02:50:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.836+0000 7faacb000640 1 -- start start 2024-08-17T02:50:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.837+0000 7faacb000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faac40cadc0 0x7faac4152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.837+0000 7faacb000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40cca40 0x7faac4154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.837+0000 7faacb000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faac4158c90 0x7faac415b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.837+0000 7faacb000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac4152ec0 con 0x7faac40cca40 2024-08-17T02:50:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.837+0000 7faacb000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac41531a0 con 0x7faac40cadc0 2024-08-17T02:50:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.837+0000 7faacb000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac4153480 con 0x7faac4158c90 2024-08-17T02:50:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.838+0000 7faac9200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40cca40 0x7faac4154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.838+0000 7faac9200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40cca40 0x7faac4154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58298/0 (socket says 172.21.15.5:58298) 2024-08-17T02:50:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.838+0000 7faac9200640 1 -- 172.21.15.5:0/3206164024 learned_addr learned my addr 172.21.15.5:0/3206164024 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.838+0000 7faac9c00640 1 --2- 172.21.15.5:0/3206164024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faac40cadc0 0x7faac4152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.838+0000 7faaca600640 1 --2- 172.21.15.5:0/3206164024 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faac4158c90 0x7faac415b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.838+0000 7faac9200640 1 -- 172.21.15.5:0/3206164024 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faac4158c90 msgr2=0x7faac415b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.838+0000 7faac9200640 1 --2- 172.21.15.5:0/3206164024 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faac4158c90 0x7faac415b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.838+0000 7faac9200640 1 -- 172.21.15.5:0/3206164024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faac40cadc0 msgr2=0x7faac4152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.838+0000 7faac9200640 1 --2- 172.21.15.5:0/3206164024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faac40cadc0 0x7faac4152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.838+0000 7faac9200640 1 -- 172.21.15.5:0/3206164024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab0009450 con 0x7faac40cca40 2024-08-17T02:50:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.838+0000 7faac9200640 1 --2- 172.21.15.5:0/3206164024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40cca40 0x7faac4154800 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faab0009210 tx=0x7faab0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.839+0000 7faac0c00640 1 -- 172.21.15.5:0/3206164024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0031de0 con 0x7faac40cca40 2024-08-17T02:50:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.839+0000 7faac0c00640 1 -- 172.21.15.5:0/3206164024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab003d420 con 0x7faac40cca40 2024-08-17T02:50:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.839+0000 7faacb000640 1 -- 172.21.15.5:0/3206164024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac4153760 con 0x7faac40cca40 2024-08-17T02:50:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.839+0000 7faac0c00640 1 -- 172.21.15.5:0/3206164024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab003d7e0 con 0x7faac40cca40 2024-08-17T02:50:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.839+0000 7faacb000640 1 -- 172.21.15.5:0/3206164024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac415bbc0 con 0x7faac40cca40 2024-08-17T02:50:09.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.840+0000 7faacb000640 1 -- 172.21.15.5:0/3206164024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac4155400 con 0x7faac40cca40 2024-08-17T02:50:09.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.841+0000 7faac0c00640 1 -- 172.21.15.5:0/3206164024 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faab0039040 con 0x7faac40cca40 2024-08-17T02:50:09.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.841+0000 7faac0c00640 1 --2- 172.21.15.5:0/3206164024 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faaa4065180 0x7faaa4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.842+0000 7faac0c00640 1 -- 172.21.15.5:0/3206164024 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7faab00a2d10 con 0x7faac40cca40 2024-08-17T02:50:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.842+0000 7faac9c00640 1 --2- 172.21.15.5:0/3206164024 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faaa4065180 0x7faaa4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.842+0000 7faac9c00640 1 --2- 172.21.15.5:0/3206164024 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faaa4065180 0x7faaa4067630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faab800bd40 tx=0x7faab8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:09.846+0000 7faac0c00640 1 -- 172.21.15.5:0/3206164024 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faab0070b00 con 0x7faac40cca40 2024-08-17T02:50:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.028+0000 7faacb000640 1 -- 172.21.15.5:0/3206164024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faac4070720 con 0x7faac40cca40 2024-08-17T02:50:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.029+0000 7faac0c00640 1 -- 172.21.15.5:0/3206164024 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18551 (secure 0 0 0) 0x7faab0037090 con 0x7faac40cca40 2024-08-17T02:50:10.031 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:10.031 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":37,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:48:05.751103+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:48.185879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:49.106113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000724543.meta","create_time":"2024-08-17T02:48:00.937205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000724543"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000724543.data","create_time":"2024-08-17T02:48:01.789476+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000724543"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:50:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.031+0000 7faacb000640 1 -- 172.21.15.5:0/3206164024 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faaa4065180 msgr2=0x7faaa4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.031+0000 7faacb000640 1 --2- 172.21.15.5:0/3206164024 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faaa4065180 0x7faaa4067630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faab800bd40 tx=0x7faab8008040 comp rx=0 tx=0).stop 2024-08-17T02:50:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.031+0000 7faacb000640 1 -- 172.21.15.5:0/3206164024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40cca40 msgr2=0x7faac4154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.031+0000 7faacb000640 1 --2- 172.21.15.5:0/3206164024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40cca40 0x7faac4154800 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faab0009210 tx=0x7faab0032000 comp rx=0 tx=0).stop 2024-08-17T02:50:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.031+0000 7faacb000640 1 -- 172.21.15.5:0/3206164024 shutdown_connections 2024-08-17T02:50:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.031+0000 7faacb000640 1 --2- 172.21.15.5:0/3206164024 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7faaa4065180 0x7faaa4067630 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.032+0000 7faacb000640 1 --2- 172.21.15.5:0/3206164024 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faac4158c90 0x7faac415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.032+0000 7faacb000640 1 --2- 172.21.15.5:0/3206164024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac40cca40 0x7faac4154800 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.032+0000 7faacb000640 1 --2- 172.21.15.5:0/3206164024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faac40cadc0 0x7faac4152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.032+0000 7faacb000640 1 -- 172.21.15.5:0/3206164024 >> 172.21.15.5:0/3206164024 conn(0x7faac4087a80 msgr2=0x7faac40c5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.032+0000 7faacb000640 1 -- 172.21.15.5:0/3206164024 shutdown_connections 2024-08-17T02:50:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.032+0000 7faacb000640 1 -- 172.21.15.5:0/3206164024 wait complete. 2024-08-17T02:50:10.049 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:50:10.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.200+0000 7f0341c00640 1 Processor -- start 2024-08-17T02:50:10.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.201+0000 7f0341c00640 1 -- start start 2024-08-17T02:50:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.202+0000 7f0341c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f033c0acc60 0x7f033c0ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.202+0000 7f0341c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f033c0c9740 0x7f033c0c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.202+0000 7f0341c00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c0c92b0 con 0x7f033c0abdf0 2024-08-17T02:50:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.202+0000 7f0341c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033c0ad5f0 con 0x7f033c0acc60 2024-08-17T02:50:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.202+0000 7f0341c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0c8ca0 con 0x7f033c0c9740 2024-08-17T02:50:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.202+0000 7f0333e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f033c0acc60 0x7f033c0ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.202+0000 7f0333e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f033c0acc60 0x7f033c0ad0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58304/0 (socket says 172.21.15.5:58304) 2024-08-17T02:50:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.202+0000 7f0333e00640 1 -- 172.21.15.5:0/3963777387 learned_addr learned my addr 172.21.15.5:0/3963777387 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.202+0000 7f0341200640 1 --2- 172.21.15.5:0/3963777387 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f033c0c9740 0x7f033c0c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.203+0000 7f0333e00640 1 -- 172.21.15.5:0/3963777387 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f033c0c9740 msgr2=0x7f033c0c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.203+0000 7f0333e00640 1 --2- 172.21.15.5:0/3963777387 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f033c0c9740 0x7f033c0c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.203+0000 7f0333e00640 1 -- 172.21.15.5:0/3963777387 >> v1:172.21.15.107:6789/0 conn(0x7f033c0abdf0 legacy=0x7f033c159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.203+0000 7f0333e00640 1 -- 172.21.15.5:0/3963777387 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c159ec0 con 0x7f033c0acc60 2024-08-17T02:50:10.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.204+0000 7f0333e00640 1 --2- 172.21.15.5:0/3963777387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f033c0acc60 0x7f033c0ad0b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f032400bbc0 tx=0x7f032400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d88c57546ac8e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:10.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.204+0000 7f033b400640 1 -- 172.21.15.5:0/3963777387 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324031610 con 0x7f033c0acc60 2024-08-17T02:50:10.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.204+0000 7f033b400640 1 -- 172.21.15.5:0/3963777387 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0324031770 con 0x7f033c0acc60 2024-08-17T02:50:10.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.204+0000 7f033b400640 1 -- 172.21.15.5:0/3963777387 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324031b50 con 0x7f033c0acc60 2024-08-17T02:50:10.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.204+0000 7f0341c00640 1 -- 172.21.15.5:0/3963777387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f033c0acc60 msgr2=0x7f033c0ad0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:10.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.205+0000 7f0341c00640 1 --2- 172.21.15.5:0/3963777387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f033c0acc60 0x7f033c0ad0b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f032400bbc0 tx=0x7f032400b460 comp rx=0 tx=0).stop 2024-08-17T02:50:10.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.205+0000 7f0341c00640 1 -- 172.21.15.5:0/3963777387 shutdown_connections 2024-08-17T02:50:10.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.205+0000 7f0341c00640 1 --2- 172.21.15.5:0/3963777387 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f033c0c9740 0x7f033c0c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.205+0000 7f0341c00640 1 --2- 172.21.15.5:0/3963777387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f033c0acc60 0x7f033c0ad0b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.205+0000 7f0341c00640 1 -- 172.21.15.5:0/3963777387 >> 172.21.15.5:0/3963777387 conn(0x7f033c066e60 msgr2=0x7f033c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:10.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.205+0000 7f0341c00640 1 -- 172.21.15.5:0/3963777387 shutdown_connections 2024-08-17T02:50:10.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.205+0000 7f0341c00640 1 -- 172.21.15.5:0/3963777387 wait complete. 2024-08-17T02:50:10.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.206+0000 7f0341c00640 1 Processor -- start 2024-08-17T02:50:10.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.206+0000 7f0341c00640 1 -- start start 2024-08-17T02:50:10.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.207+0000 7f0341c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f033c0abdf0 0x7f033c0c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:10.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.207+0000 7f0341c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f033c0acc60 0x7f033c149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:10.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.207+0000 7f0341c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f033c0c9740 0x7f033c1588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:10.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.207+0000 7f0341c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0c15c0 con 0x7f033c0acc60 2024-08-17T02:50:10.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.207+0000 7f0341c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0c06d0 con 0x7f033c0abdf0 2024-08-17T02:50:10.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.207+0000 7f0341c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0c09b0 con 0x7f033c0c9740 2024-08-17T02:50:10.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.208+0000 7f0341200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f033c0c9740 0x7f033c1588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:10.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.208+0000 7f0341200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f033c0c9740 0x7f033c1588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:39808/0 (socket says 172.21.15.5:39808) 2024-08-17T02:50:10.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.208+0000 7f0341200640 1 -- 172.21.15.5:0/696396002 learned_addr learned my addr 172.21.15.5:0/696396002 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:10.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.208+0000 7f033be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f033c0abdf0 0x7f033c0c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:10.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.208+0000 7f0333e00640 1 --2- 172.21.15.5:0/696396002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f033c0acc60 0x7f033c149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:10.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.208+0000 7f0341200640 1 -- 172.21.15.5:0/696396002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f033c0abdf0 msgr2=0x7f033c0c1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:10.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.208+0000 7f0341200640 1 --2- 172.21.15.5:0/696396002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f033c0abdf0 0x7f033c0c1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.208+0000 7f0341200640 1 -- 172.21.15.5:0/696396002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f033c0acc60 msgr2=0x7f033c149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:10.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.208+0000 7f0341200640 1 --2- 172.21.15.5:0/696396002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f033c0acc60 0x7f033c149140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.208+0000 7f0341200640 1 -- 172.21.15.5:0/696396002 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032400b700 con 0x7f033c0c9740 2024-08-17T02:50:10.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.208+0000 7f0333e00640 1 --2- 172.21.15.5:0/696396002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f033c0acc60 0x7f033c149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:10.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.208+0000 7f0341200640 1 --2- 172.21.15.5:0/696396002 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f033c0c9740 0x7f033c1588c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0334009df0 tx=0x7f033400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:10.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.209+0000 7f0333400640 1 -- 172.21.15.5:0/696396002 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033400cd40 con 0x7f033c0c9740 2024-08-17T02:50:10.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.209+0000 7f0333400640 1 -- 172.21.15.5:0/696396002 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033400f040 con 0x7f033c0c9740 2024-08-17T02:50:10.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.209+0000 7f0333400640 1 -- 172.21.15.5:0/696396002 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03340146d0 con 0x7f033c0c9740 2024-08-17T02:50:10.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.209+0000 7f0341c00640 1 -- 172.21.15.5:0/696396002 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033c0c0c90 con 0x7f033c0c9740 2024-08-17T02:50:10.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.209+0000 7f0341c00640 1 -- 172.21.15.5:0/696396002 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033c0c1250 con 0x7f033c0c9740 2024-08-17T02:50:10.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.210+0000 7f0341c00640 1 -- 172.21.15.5:0/696396002 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033c070720 con 0x7f033c0c9740 2024-08-17T02:50:10.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.211+0000 7f0333400640 1 -- 172.21.15.5:0/696396002 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0334014a80 con 0x7f033c0c9740 2024-08-17T02:50:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.211+0000 7f0333400640 1 --2- 172.21.15.5:0/696396002 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0318065150 0x7f0318067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.212+0000 7f0333400640 1 -- 172.21.15.5:0/696396002 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f03340831c0 con 0x7f033c0c9740 2024-08-17T02:50:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.212+0000 7f033be00640 1 --2- 172.21.15.5:0/696396002 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0318065150 0x7f0318067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.212+0000 7f033be00640 1 --2- 172.21.15.5:0/696396002 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0318065150 0x7f0318067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f032c007fd0 tx=0x7f032c007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:10.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.217+0000 7f0333400640 1 -- 172.21.15.5:0/696396002 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0334050f10 con 0x7f033c0c9740 2024-08-17T02:50:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.443+0000 7f0341c00640 1 -- 172.21.15.5:0/696396002 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f033c067c80 con 0x7f033c0c9740 2024-08-17T02:50:10.445 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-17T02:50:10.444+0000 7f4dd2600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:50:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.450+0000 7f0333400640 1 -- 172.21.15.5:0/696396002 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0334054530 con 0x7f033c0c9740 2024-08-17T02:50:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:50:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.453+0000 7f0341c00640 1 -- 172.21.15.5:0/696396002 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0318065150 msgr2=0x7f0318067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.453+0000 7f0341c00640 1 --2- 172.21.15.5:0/696396002 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0318065150 0x7f0318067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f032c007fd0 tx=0x7f032c007e30 comp rx=0 tx=0).stop 2024-08-17T02:50:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.453+0000 7f0341c00640 1 -- 172.21.15.5:0/696396002 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f033c0c9740 msgr2=0x7f033c1588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.453+0000 7f0341c00640 1 --2- 172.21.15.5:0/696396002 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f033c0c9740 0x7f033c1588c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0334009df0 tx=0x7f033400b040 comp rx=0 tx=0).stop 2024-08-17T02:50:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.453+0000 7f0341c00640 1 -- 172.21.15.5:0/696396002 shutdown_connections 2024-08-17T02:50:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.453+0000 7f0341c00640 1 --2- 172.21.15.5:0/696396002 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0318065150 0x7f0318067600 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.453+0000 7f0341c00640 1 --2- 172.21.15.5:0/696396002 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f033c0c9740 0x7f033c1588c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.453+0000 7f0341c00640 1 --2- 172.21.15.5:0/696396002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f033c0acc60 0x7f033c149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.453+0000 7f0341c00640 1 --2- 172.21.15.5:0/696396002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f033c0abdf0 0x7f033c0c1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.453+0000 7f0341c00640 1 -- 172.21.15.5:0/696396002 >> 172.21.15.5:0/696396002 conn(0x7f033c066e60 msgr2=0x7f033c06aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.453+0000 7f0341c00640 1 -- 172.21.15.5:0/696396002 shutdown_connections 2024-08-17T02:50:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.453+0000 7f0341c00640 1 -- 172.21.15.5:0/696396002 wait complete. 2024-08-17T02:50:10.461 INFO:tasks.ceph.mds.a.smithi005.stderr: -7196> 2024-08-17T02:47:54.604+0000 7f86d2600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:50:10.470 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:50:10.505 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-17T02:50:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.629+0000 7f1411000640 1 Processor -- start 2024-08-17T02:50:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.629+0000 7f1411000640 1 -- start start 2024-08-17T02:50:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.630+0000 7f1411000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f140c0b1850 0x7f140c0b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.630+0000 7f1411000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f140c0d0650 0x7f140c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.630+0000 7f1411000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c0ce9b0 con 0x7f140c1585a0 2024-08-17T02:50:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.630+0000 7f1411000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c0cec90 con 0x7f140c0b1850 2024-08-17T02:50:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.630+0000 7f1411000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0cef70 con 0x7f140c0d0650 2024-08-17T02:50:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.630+0000 7f140b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f140c0b1850 0x7f140c0b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.630+0000 7f140be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f140c1585a0 0x7f140c158a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56728/0 (socket says 172.21.15.5:56728) 2024-08-17T02:50:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.630+0000 7f140be00640 1 -- 172.21.15.5:0/2846384879 learned_addr learned my addr 172.21.15.5:0/2846384879 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.630+0000 7f140b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f140c0b1850 0x7f140c0b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58336/0 (socket says 172.21.15.5:58336) 2024-08-17T02:50:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.631+0000 7f1402a00640 1 --2- 172.21.15.5:0/2846384879 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f140c0d0650 0x7f140c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.631+0000 7f140b400640 1 -- 172.21.15.5:0/2846384879 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f140c0d0650 msgr2=0x7f140c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.631+0000 7f140b400640 1 --2- 172.21.15.5:0/2846384879 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f140c0d0650 0x7f140c0ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.631+0000 7f140b400640 1 -- 172.21.15.5:0/2846384879 >> v1:172.21.15.5:6789/0 conn(0x7f140c1585a0 legacy=0x7f140c158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.631+0000 7f140aa00640 1 -- 172.21.15.5:0/2846384879 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373787567 0 0) 0x7f140c0ce9b0 con 0x7f140c1585a0 2024-08-17T02:50:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.631+0000 7f140b400640 1 -- 172.21.15.5:0/2846384879 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c0cf250 con 0x7f140c0b1850 2024-08-17T02:50:10.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.632+0000 7f140b400640 1 --2- 172.21.15.5:0/2846384879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c0b1850 0x7f140c0b1c20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009850 tx=0x7f13fc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a68d10065405a72 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.632+0000 7f140aa00640 1 -- 172.21.15.5:0/2846384879 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc02ad90 con 0x7f140c0b1850 2024-08-17T02:50:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.632+0000 7f140aa00640 1 -- 172.21.15.5:0/2846384879 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc032440 con 0x7f140c0b1850 2024-08-17T02:50:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.632+0000 7f140aa00640 1 -- 172.21.15.5:0/2846384879 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0327e0 con 0x7f140c0b1850 2024-08-17T02:50:10.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.633+0000 7f1411000640 1 -- 172.21.15.5:0/2846384879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c0b1850 msgr2=0x7f140c0b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:10.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.633+0000 7f1411000640 1 --2- 172.21.15.5:0/2846384879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c0b1850 0x7f140c0b1c20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009850 tx=0x7f13fc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.633+0000 7f1411000640 1 -- 172.21.15.5:0/2846384879 shutdown_connections 2024-08-17T02:50:10.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.633+0000 7f1411000640 1 --2- 172.21.15.5:0/2846384879 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f140c0d0650 0x7f140c0ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.633+0000 7f1411000640 1 --2- 172.21.15.5:0/2846384879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c0b1850 0x7f140c0b1c20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.633+0000 7f1411000640 1 -- 172.21.15.5:0/2846384879 >> 172.21.15.5:0/2846384879 conn(0x7f140c06e590 msgr2=0x7f140c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:10.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.633+0000 7f1411000640 1 -- 172.21.15.5:0/2846384879 shutdown_connections 2024-08-17T02:50:10.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.633+0000 7f1411000640 1 -- 172.21.15.5:0/2846384879 wait complete. 2024-08-17T02:50:10.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.634+0000 7f1411000640 1 Processor -- start 2024-08-17T02:50:10.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.634+0000 7f1411000640 1 -- start start 2024-08-17T02:50:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.635+0000 7f1411000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f140c0b1850 0x7f140c135480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.635+0000 7f1411000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f140c0d0650 0x7f140c142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.635+0000 7f1411000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c1585a0 0x7f140c1434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.635+0000 7f1411000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0a8480 con 0x7f140c1585a0 2024-08-17T02:50:10.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.635+0000 7f1411000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0a7870 con 0x7f140c0b1850 2024-08-17T02:50:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.635+0000 7f1411000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0a7b50 con 0x7f140c0d0650 2024-08-17T02:50:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.636+0000 7f140be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c1585a0 0x7f140c1434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.636+0000 7f140be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c1585a0 0x7f140c1434a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58342/0 (socket says 172.21.15.5:58342) 2024-08-17T02:50:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.636+0000 7f140be00640 1 -- 172.21.15.5:0/2215800362 learned_addr learned my addr 172.21.15.5:0/2215800362 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.636+0000 7f1402a00640 1 --2- 172.21.15.5:0/2215800362 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f140c0d0650 0x7f140c142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.636+0000 7f140b400640 1 --2- 172.21.15.5:0/2215800362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f140c0b1850 0x7f140c135480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.636+0000 7f140be00640 1 -- 172.21.15.5:0/2215800362 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f140c0d0650 msgr2=0x7f140c142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.636+0000 7f140be00640 1 --2- 172.21.15.5:0/2215800362 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f140c0d0650 0x7f140c142f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.636+0000 7f140be00640 1 -- 172.21.15.5:0/2215800362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f140c0b1850 msgr2=0x7f140c135480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.636+0000 7f140be00640 1 --2- 172.21.15.5:0/2215800362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f140c0b1850 0x7f140c135480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.636+0000 7f140be00640 1 -- 172.21.15.5:0/2215800362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13fc009390 con 0x7f140c1585a0 2024-08-17T02:50:10.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.636+0000 7f140be00640 1 --2- 172.21.15.5:0/2215800362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c1585a0 0x7f140c1434a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f140400cbf0 tx=0x7f14040019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.636+0000 7f1403400640 1 -- 172.21.15.5:0/2215800362 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140400ce10 con 0x7f140c1585a0 2024-08-17T02:50:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.637+0000 7f1403400640 1 -- 172.21.15.5:0/2215800362 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140400a850 con 0x7f140c1585a0 2024-08-17T02:50:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.637+0000 7f1403400640 1 -- 172.21.15.5:0/2215800362 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140400ac90 con 0x7f140c1585a0 2024-08-17T02:50:10.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.637+0000 7f1411000640 1 -- 172.21.15.5:0/2215800362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c0a7e30 con 0x7f140c1585a0 2024-08-17T02:50:10.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.637+0000 7f1411000640 1 -- 172.21.15.5:0/2215800362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c1359c0 con 0x7f140c1585a0 2024-08-17T02:50:10.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.638+0000 7f1411000640 1 -- 172.21.15.5:0/2215800362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c070720 con 0x7f140c1585a0 2024-08-17T02:50:10.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.639+0000 7f1403400640 1 -- 172.21.15.5:0/2215800362 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1404007300 con 0x7f140c1585a0 2024-08-17T02:50:10.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.640+0000 7f1403400640 1 --2- 172.21.15.5:0/2215800362 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f13e8065180 0x7f13e8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:10.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.640+0000 7f1403400640 1 -- 172.21.15.5:0/2215800362 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f1404082970 con 0x7f140c1585a0 2024-08-17T02:50:10.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.640+0000 7f140b400640 1 --2- 172.21.15.5:0/2215800362 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f13e8065180 0x7f13e8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:10.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.641+0000 7f140b400640 1 --2- 172.21.15.5:0/2215800362 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f13e8065180 0x7f13e8067630 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f13fc034000 tx=0x7f13fc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:10.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.644+0000 7f1403400640 1 -- 172.21.15.5:0/2215800362 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1404050630 con 0x7f140c1585a0 2024-08-17T02:50:10.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:10.869+0000 7f1411000640 1 -- 172.21.15.5:0/2215800362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f140c068140 con 0x7f140c1585a0 2024-08-17T02:50:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.452+0000 7f1403400640 1 -- 172.21.15.5:0/2215800362 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1404053c50 con 0x7f140c1585a0 2024-08-17T02:50:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.455+0000 7f1411000640 1 -- 172.21.15.5:0/2215800362 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f13e8065180 msgr2=0x7f13e8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.455+0000 7f1411000640 1 --2- 172.21.15.5:0/2215800362 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f13e8065180 0x7f13e8067630 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f13fc034000 tx=0x7f13fc032000 comp rx=0 tx=0).stop 2024-08-17T02:50:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.455+0000 7f1411000640 1 -- 172.21.15.5:0/2215800362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c1585a0 msgr2=0x7f140c1434a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.455+0000 7f1411000640 1 --2- 172.21.15.5:0/2215800362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c1585a0 0x7f140c1434a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f140400cbf0 tx=0x7f14040019b0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.455+0000 7f1411000640 1 -- 172.21.15.5:0/2215800362 shutdown_connections 2024-08-17T02:50:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.455+0000 7f1411000640 1 --2- 172.21.15.5:0/2215800362 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f13e8065180 0x7f13e8067630 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.455+0000 7f1411000640 1 --2- 172.21.15.5:0/2215800362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f140c1585a0 0x7f140c1434a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.455+0000 7f1411000640 1 --2- 172.21.15.5:0/2215800362 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f140c0d0650 0x7f140c142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.455+0000 7f1411000640 1 --2- 172.21.15.5:0/2215800362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f140c0b1850 0x7f140c135480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.455+0000 7f1411000640 1 -- 172.21.15.5:0/2215800362 >> 172.21.15.5:0/2215800362 conn(0x7f140c06e590 msgr2=0x7f140c158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.455+0000 7f1411000640 1 -- 172.21.15.5:0/2215800362 shutdown_connections 2024-08-17T02:50:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.455+0000 7f1411000640 1 -- 172.21.15.5:0/2215800362 wait complete. 2024-08-17T02:50:11.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:50:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.670+0000 7f4291400640 1 Processor -- start 2024-08-17T02:50:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.670+0000 7f4291400640 1 -- start start 2024-08-17T02:50:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.671+0000 7f4291400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f428c1589a0 0x7f428c0acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.671+0000 7f4291400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f428c159b40 0x7f428c06e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.671+0000 7f4291400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428c0cd450 con 0x7f428c0aef70 2024-08-17T02:50:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.671+0000 7f4291400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428c0af3c0 con 0x7f428c159b40 2024-08-17T02:50:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.671+0000 7f4291400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0ad380 con 0x7f428c1589a0 2024-08-17T02:50:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.672+0000 7f4289e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f428c0aef70 0x7f428c158d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56736/0 (socket says 172.21.15.5:56736) 2024-08-17T02:50:11.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.672+0000 7f4289e00640 1 -- 172.21.15.5:0/252465503 learned_addr learned my addr 172.21.15.5:0/252465503 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.672+0000 7f428a800640 1 --2- 172.21.15.5:0/252465503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f428c1589a0 0x7f428c0acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.672+0000 7f428b200640 1 --2- 172.21.15.5:0/252465503 >> v2:172.21.15.107:3300/0 conn(0x7f428c159b40 0x7f428c06e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.672+0000 7f4289400640 1 -- 172.21.15.5:0/252465503 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379678626 0 0) 0x7f428c0cd450 con 0x7f428c0aef70 2024-08-17T02:50:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.672+0000 7f4289400640 1 -- 172.21.15.5:0/252465503 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42700034e0 con 0x7f428c0aef70 2024-08-17T02:50:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.672+0000 7f4289400640 1 -- 172.21.15.5:0/252465503 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4212632804 0 0) 0x7f42700034e0 con 0x7f428c0aef70 2024-08-17T02:50:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.672+0000 7f4289400640 1 -- 172.21.15.5:0/252465503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f428c1589a0 msgr2=0x7f428c0acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.672+0000 7f4289400640 1 --2- 172.21.15.5:0/252465503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f428c1589a0 0x7f428c0acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.672+0000 7f4289400640 1 -- 172.21.15.5:0/252465503 >> v2:172.21.15.107:3300/0 conn(0x7f428c159b40 msgr2=0x7f428c06e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.672+0000 7f4289400640 1 --2- 172.21.15.5:0/252465503 >> v2:172.21.15.107:3300/0 conn(0x7f428c159b40 0x7f428c06e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.672+0000 7f4289400640 1 -- 172.21.15.5:0/252465503 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c0ad660 con 0x7f428c0aef70 2024-08-17T02:50:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.672+0000 7f4289400640 1 -- 172.21.15.5:0/252465503 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7f4278001470 con 0x7f428c0aef70 2024-08-17T02:50:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.672+0000 7f4289400640 1 -- 172.21.15.5:0/252465503 >> v1:172.21.15.5:6789/0 conn(0x7f428c0aef70 legacy=0x7f428c158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.672+0000 7f4289400640 1 --2- 172.21.15.5:0/252465503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42700039d0 0x7f4270003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.672+0000 7f4289400640 1 --2- 172.21.15.5:0/252465503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4270004780 0x7f4270004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.673+0000 7f4289400640 1 --2- 172.21.15.5:0/252465503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4270005130 0x7f427000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.673+0000 7f4289400640 1 -- 172.21.15.5:0/252465503 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0af3c0 con 0x7f4270004780 2024-08-17T02:50:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.673+0000 7f4289400640 1 -- 172.21.15.5:0/252465503 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0ad380 con 0x7f4270005130 2024-08-17T02:50:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.673+0000 7f4289400640 1 -- 172.21.15.5:0/252465503 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427000bf10 con 0x7f42700039d0 2024-08-17T02:50:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.673+0000 7f428a800640 1 --2- 172.21.15.5:0/252465503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f428c1589a0 0x7f428c0acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.673+0000 7f428b200640 1 --2- 172.21.15.5:0/252465503 >> v2:172.21.15.107:3300/0 conn(0x7f428c159b40 0x7f428c06e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.673+0000 7f4289e00640 1 --2- 172.21.15.5:0/252465503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4270004780 0x7f4270004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.673+0000 7f428b200640 1 --2- 172.21.15.5:0/252465503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4270005130 0x7f427000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.673+0000 7f428a800640 1 --2- 172.21.15.5:0/252465503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42700039d0 0x7f4270003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.673+0000 7f4289e00640 1 -- 172.21.15.5:0/252465503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42700039d0 msgr2=0x7f4270003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.673+0000 7f4289e00640 1 --2- 172.21.15.5:0/252465503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42700039d0 0x7f4270003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.673+0000 7f4289e00640 1 -- 172.21.15.5:0/252465503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4270005130 msgr2=0x7f427000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.673+0000 7f4289e00640 1 --2- 172.21.15.5:0/252465503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4270005130 0x7f427000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.673+0000 7f4289e00640 1 -- 172.21.15.5:0/252465503 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42700034e0 con 0x7f4270004780 2024-08-17T02:50:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.673+0000 7f428b200640 1 --2- 172.21.15.5:0/252465503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4270005130 0x7f427000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.673+0000 7f428a800640 1 --2- 172.21.15.5:0/252465503 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42700039d0 0x7f4270003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.674+0000 7f4289e00640 1 --2- 172.21.15.5:0/252465503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4270004780 0x7f4270004bf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f427800c2a0 tx=0x7f4278001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c89b22a961e3a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.674+0000 7f4289400640 1 -- 172.21.15.5:0/252465503 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278005890 con 0x7f4270004780 2024-08-17T02:50:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.674+0000 7f4289400640 1 -- 172.21.15.5:0/252465503 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4278005a30 con 0x7f4270004780 2024-08-17T02:50:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.674+0000 7f4289400640 1 -- 172.21.15.5:0/252465503 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278005e70 con 0x7f4270004780 2024-08-17T02:50:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.675+0000 7f4291400640 1 -- 172.21.15.5:0/252465503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4270004780 msgr2=0x7f4270004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.675+0000 7f4291400640 1 --2- 172.21.15.5:0/252465503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4270004780 0x7f4270004bf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f427800c2a0 tx=0x7f4278001e90 comp rx=0 tx=0).stop 2024-08-17T02:50:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.675+0000 7f428b200640 1 -- 172.21.15.5:0/252465503 reap_dead start 2024-08-17T02:50:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.675+0000 7f4291400640 1 -- 172.21.15.5:0/252465503 shutdown_connections 2024-08-17T02:50:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.675+0000 7f4291400640 1 -- 172.21.15.5:0/252465503 >> 172.21.15.5:0/252465503 conn(0x7f428c06c760 msgr2=0x7f428c06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.675+0000 7f4291400640 1 -- 172.21.15.5:0/252465503 shutdown_connections 2024-08-17T02:50:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.675+0000 7f4291400640 1 -- 172.21.15.5:0/252465503 wait complete. 2024-08-17T02:50:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.676+0000 7f4291400640 1 Processor -- start 2024-08-17T02:50:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.677+0000 7f4291400640 1 -- start start 2024-08-17T02:50:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.677+0000 7f4291400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4270004780 0x7f428c0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.677+0000 7f4291400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f428c0c5c30 0x7f428c1432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.677+0000 7f4291400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428c169d90 0x7f428c0caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.677+0000 7f4291400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0c8830 con 0x7f4270004780 2024-08-17T02:50:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.677+0000 7f4291400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0c6130 con 0x7f428c169d90 2024-08-17T02:50:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.677+0000 7f4291400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0c6410 con 0x7f428c0c5c30 2024-08-17T02:50:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.678+0000 7f428a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4270004780 0x7f428c0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.678+0000 7f428a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4270004780 0x7f428c0c71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58362/0 (socket says 172.21.15.5:58362) 2024-08-17T02:50:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.678+0000 7f428a800640 1 -- 172.21.15.5:0/2537021949 learned_addr learned my addr 172.21.15.5:0/2537021949 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.678+0000 7f428a800640 1 -- 172.21.15.5:0/2537021949 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f428c0c5c30 msgr2=0x7f428c1432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.678+0000 7f4289e00640 1 --2- 172.21.15.5:0/2537021949 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f428c0c5c30 0x7f428c1432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.678+0000 7f428b200640 1 --2- 172.21.15.5:0/2537021949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428c169d90 0x7f428c0caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.678+0000 7f428a800640 1 --2- 172.21.15.5:0/2537021949 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f428c0c5c30 0x7f428c1432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.678+0000 7f428a800640 1 -- 172.21.15.5:0/2537021949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428c169d90 msgr2=0x7f428c0caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.678+0000 7f428a800640 1 --2- 172.21.15.5:0/2537021949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428c169d90 0x7f428c0caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.678+0000 7f428a800640 1 -- 172.21.15.5:0/2537021949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c0c66f0 con 0x7f4270004780 2024-08-17T02:50:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.678+0000 7f428b200640 1 --2- 172.21.15.5:0/2537021949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428c169d90 0x7f428c0caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.678+0000 7f4289e00640 1 --2- 172.21.15.5:0/2537021949 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f428c0c5c30 0x7f428c1432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.679+0000 7f428a800640 1 --2- 172.21.15.5:0/2537021949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4270004780 0x7f428c0c71d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f427c0109f0 tx=0x7f427c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.679+0000 7f4282000640 1 -- 172.21.15.5:0/2537021949 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c014600 con 0x7f4270004780 2024-08-17T02:50:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.679+0000 7f4282000640 1 -- 172.21.15.5:0/2537021949 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427c014760 con 0x7f4270004780 2024-08-17T02:50:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.679+0000 7f4282000640 1 -- 172.21.15.5:0/2537021949 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c014ae0 con 0x7f4270004780 2024-08-17T02:50:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.679+0000 7f4291400640 1 -- 172.21.15.5:0/2537021949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c0c69d0 con 0x7f4270004780 2024-08-17T02:50:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.679+0000 7f4291400640 1 -- 172.21.15.5:0/2537021949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c16a230 con 0x7f4270004780 2024-08-17T02:50:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.680+0000 7f4291400640 1 -- 172.21.15.5:0/2537021949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c0c6e50 con 0x7f4270004780 2024-08-17T02:50:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.681+0000 7f4282000640 1 -- 172.21.15.5:0/2537021949 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f427c0123a0 con 0x7f4270004780 2024-08-17T02:50:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.682+0000 7f4282000640 1 --2- 172.21.15.5:0/2537021949 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f426c065150 0x7f426c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.682+0000 7f4282000640 1 -- 172.21.15.5:0/2537021949 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f427c0824c0 con 0x7f4270004780 2024-08-17T02:50:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.682+0000 7f4289e00640 1 --2- 172.21.15.5:0/2537021949 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f426c065150 0x7f426c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.683+0000 7f4289e00640 1 --2- 172.21.15.5:0/2537021949 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f426c065150 0x7f426c067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4278033000 tx=0x7f4278034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.686+0000 7f4282000640 1 -- 172.21.15.5:0/2537021949 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f427c050100 con 0x7f4270004780 2024-08-17T02:50:11.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:11.873+0000 7f4291400640 1 -- 172.21.15.5:0/2537021949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f428c063fb0 con 0x7f4270004780 2024-08-17T02:50:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.454+0000 7f4282000640 1 -- 172.21.15.5:0/2537021949 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7f427c053720 con 0x7f4270004780 2024-08-17T02:50:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:50:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.458+0000 7f4291400640 1 -- 172.21.15.5:0/2537021949 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f426c065150 msgr2=0x7f426c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.458+0000 7f4291400640 1 --2- 172.21.15.5:0/2537021949 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f426c065150 0x7f426c067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4278033000 tx=0x7f4278034000 comp rx=0 tx=0).stop 2024-08-17T02:50:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.458+0000 7f4291400640 1 -- 172.21.15.5:0/2537021949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4270004780 msgr2=0x7f428c0c71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.458+0000 7f4291400640 1 --2- 172.21.15.5:0/2537021949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4270004780 0x7f428c0c71d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f427c0109f0 tx=0x7f427c008040 comp rx=0 tx=0).stop 2024-08-17T02:50:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.458+0000 7f4291400640 1 -- 172.21.15.5:0/2537021949 shutdown_connections 2024-08-17T02:50:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.458+0000 7f4291400640 1 --2- 172.21.15.5:0/2537021949 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f426c065150 0x7f426c067600 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.458+0000 7f4291400640 1 --2- 172.21.15.5:0/2537021949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f428c169d90 0x7f428c0caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.458+0000 7f4291400640 1 --2- 172.21.15.5:0/2537021949 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f428c0c5c30 0x7f428c1432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.458+0000 7f4291400640 1 --2- 172.21.15.5:0/2537021949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4270004780 0x7f428c0c71d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.458+0000 7f4291400640 1 -- 172.21.15.5:0/2537021949 >> 172.21.15.5:0/2537021949 conn(0x7f428c06c760 msgr2=0x7f428c068320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.458+0000 7f4291400640 1 -- 172.21.15.5:0/2537021949 shutdown_connections 2024-08-17T02:50:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.458+0000 7f4291400640 1 -- 172.21.15.5:0/2537021949 wait complete. 2024-08-17T02:50:12.477 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:50:12.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.631+0000 7fad0da00640 1 Processor -- start 2024-08-17T02:50:12.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.631+0000 7fad0da00640 1 -- start start 2024-08-17T02:50:12.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.633+0000 7fad0da00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad080b4f60 0x7fad080ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.633+0000 7fad0da00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad080b3ac0 con 0x7fad08158dc0 2024-08-17T02:50:12.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.633+0000 7fad0da00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad080b3190 con 0x7fad081589f0 2024-08-17T02:50:12.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.633+0000 7fad0da00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad080b3470 con 0x7fad080b4f60 2024-08-17T02:50:12.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.633+0000 7facffe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fad08158dc0 0x7fad080cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56738/0 (socket says 172.21.15.5:56738) 2024-08-17T02:50:12.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.633+0000 7facffe00640 1 -- 172.21.15.5:0/627698649 learned_addr learned my addr 172.21.15.5:0/627698649 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:12.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.633+0000 7fad0d000640 1 --2- 172.21.15.5:0/627698649 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad080b4f60 0x7fad080ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.633+0000 7fad07400640 1 -- 172.21.15.5:0/627698649 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798442851 0 0) 0x7fad080b3ac0 con 0x7fad08158dc0 2024-08-17T02:50:12.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.634+0000 7fad07400640 1 -- 172.21.15.5:0/627698649 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facec0034e0 con 0x7fad08158dc0 2024-08-17T02:50:12.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.634+0000 7fad07400640 1 -- 172.21.15.5:0/627698649 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615828641 0 0) 0x7fad080b3190 con 0x7fad081589f0 2024-08-17T02:50:12.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.634+0000 7fad07400640 1 -- 172.21.15.5:0/627698649 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad080b3ac0 con 0x7fad081589f0 2024-08-17T02:50:12.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.634+0000 7fad0d000640 1 -- 172.21.15.5:0/627698649 >> v1:172.21.15.107:6789/0 conn(0x7fad081589f0 legacy=0x7fad080ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.634+0000 7fad0d000640 1 -- 172.21.15.5:0/627698649 >> v1:172.21.15.5:6789/0 conn(0x7fad08158dc0 legacy=0x7fad080cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.634+0000 7fad0d000640 1 -- 172.21.15.5:0/627698649 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad080b3750 con 0x7fad080b4f60 2024-08-17T02:50:12.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.635+0000 7fad0d000640 1 --2- 172.21.15.5:0/627698649 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad080b4f60 0x7fad080ceef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad00009e90 tx=0x7fad00009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80092a30b33f5265 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:12.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.635+0000 7fad07400640 1 -- 172.21.15.5:0/627698649 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad00007550 con 0x7fad080b4f60 2024-08-17T02:50:12.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.635+0000 7fad07400640 1 -- 172.21.15.5:0/627698649 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0002d050 con 0x7fad080b4f60 2024-08-17T02:50:12.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.635+0000 7fad07400640 1 -- 172.21.15.5:0/627698649 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000078c0 con 0x7fad080b4f60 2024-08-17T02:50:12.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.636+0000 7fad0da00640 1 -- 172.21.15.5:0/627698649 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad080b4f60 msgr2=0x7fad080ceef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.636+0000 7fad0da00640 1 --2- 172.21.15.5:0/627698649 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad080b4f60 0x7fad080ceef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad00009e90 tx=0x7fad00009780 comp rx=0 tx=0).stop 2024-08-17T02:50:12.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.636+0000 7fad0da00640 1 -- 172.21.15.5:0/627698649 shutdown_connections 2024-08-17T02:50:12.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.636+0000 7fad0da00640 1 --2- 172.21.15.5:0/627698649 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad080b4f60 0x7fad080ceef0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.636+0000 7fad0da00640 1 -- 172.21.15.5:0/627698649 >> 172.21.15.5:0/627698649 conn(0x7fad08087a80 msgr2=0x7fad0806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:12.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.636+0000 7fad0da00640 1 -- 172.21.15.5:0/627698649 shutdown_connections 2024-08-17T02:50:12.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.636+0000 7fad0da00640 1 -- 172.21.15.5:0/627698649 wait complete. 2024-08-17T02:50:12.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.637+0000 7fad0da00640 1 Processor -- start 2024-08-17T02:50:12.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.637+0000 7fad0da00640 1 -- start start 2024-08-17T02:50:12.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.638+0000 7fad0da00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad080b4f60 0x7fad0814f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.638+0000 7fad0da00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad081589f0 0x7fad08168f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.638+0000 7fad0da00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad08158dc0 0x7fad081694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.638+0000 7fad0da00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad08159b30 con 0x7fad08158dc0 2024-08-17T02:50:12.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.638+0000 7fad0da00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad08151e10 con 0x7fad080b4f60 2024-08-17T02:50:12.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.638+0000 7fad0da00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad081520f0 con 0x7fad081589f0 2024-08-17T02:50:12.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.638+0000 7fad0d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad08158dc0 0x7fad081694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.639+0000 7fad0d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad08158dc0 0x7fad081694b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58376/0 (socket says 172.21.15.5:58376) 2024-08-17T02:50:12.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.639+0000 7fad0d000640 1 -- 172.21.15.5:0/2402141230 learned_addr learned my addr 172.21.15.5:0/2402141230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:12.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.639+0000 7facffe00640 1 --2- 172.21.15.5:0/2402141230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad081589f0 0x7fad08168f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.639+0000 7fad07e00640 1 --2- 172.21.15.5:0/2402141230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad080b4f60 0x7fad0814f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.639+0000 7fad0d000640 1 -- 172.21.15.5:0/2402141230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad081589f0 msgr2=0x7fad08168f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.639+0000 7fad0d000640 1 --2- 172.21.15.5:0/2402141230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad081589f0 0x7fad08168f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.639+0000 7fad0d000640 1 -- 172.21.15.5:0/2402141230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad080b4f60 msgr2=0x7fad0814f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.639+0000 7fad0d000640 1 --2- 172.21.15.5:0/2402141230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad080b4f60 0x7fad0814f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.639+0000 7fad0d000640 1 -- 172.21.15.5:0/2402141230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad00009a20 con 0x7fad08158dc0 2024-08-17T02:50:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.639+0000 7fad0d000640 1 --2- 172.21.15.5:0/2402141230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad08158dc0 0x7fad081694b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fad00009de0 tx=0x7fad00037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.640+0000 7facff400640 1 -- 172.21.15.5:0/2402141230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000318b0 con 0x7fad08158dc0 2024-08-17T02:50:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.640+0000 7facff400640 1 -- 172.21.15.5:0/2402141230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad00040070 con 0x7fad08158dc0 2024-08-17T02:50:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.640+0000 7facff400640 1 -- 172.21.15.5:0/2402141230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad00031c60 con 0x7fad08158dc0 2024-08-17T02:50:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.640+0000 7fad0da00640 1 -- 172.21.15.5:0/2402141230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad081523d0 con 0x7fad08158dc0 2024-08-17T02:50:12.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.640+0000 7fad0da00640 1 -- 172.21.15.5:0/2402141230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad080b2250 con 0x7fad08158dc0 2024-08-17T02:50:12.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.641+0000 7fad0da00640 1 -- 172.21.15.5:0/2402141230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad08159ce0 con 0x7fad08158dc0 2024-08-17T02:50:12.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.642+0000 7facff400640 1 -- 172.21.15.5:0/2402141230 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fad00042030 con 0x7fad08158dc0 2024-08-17T02:50:12.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.642+0000 7facff400640 1 --2- 172.21.15.5:0/2402141230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7face4065150 0x7face4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.642+0000 7facff400640 1 -- 172.21.15.5:0/2402141230 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6251+0+0 (secure 0 0 0) 0x7fad000a3b50 con 0x7fad08158dc0 2024-08-17T02:50:12.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.643+0000 7fad07e00640 1 --2- 172.21.15.5:0/2402141230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7face4065150 0x7face4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.643+0000 7fad07e00640 1 --2- 172.21.15.5:0/2402141230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7face4065150 0x7face4067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7facf8000c00 tx=0x7facf8007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:12.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.647+0000 7facff400640 1 -- 172.21.15.5:0/2402141230 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fad08159ce0 con 0x7fad08158dc0 2024-08-17T02:50:12.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:12.833+0000 7fad0da00640 1 -- 172.21.15.5:0/2402141230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fad08063f10 con 0x7fad08158dc0 2024-08-17T02:50:13.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.459+0000 7facff400640 1 -- 172.21.15.5:0/2402141230 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7fad000755f0 con 0x7fad08158dc0 2024-08-17T02:50:13.461 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-17T02:50:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.464+0000 7fad0da00640 1 -- 172.21.15.5:0/2402141230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7face4065150 msgr2=0x7face4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.464+0000 7fad0da00640 1 --2- 172.21.15.5:0/2402141230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7face4065150 0x7face4067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7facf8000c00 tx=0x7facf8007ca0 comp rx=0 tx=0).stop 2024-08-17T02:50:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.464+0000 7fad0da00640 1 -- 172.21.15.5:0/2402141230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad08158dc0 msgr2=0x7fad081694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.464+0000 7fad0da00640 1 --2- 172.21.15.5:0/2402141230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad08158dc0 0x7fad081694b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fad00009de0 tx=0x7fad00037000 comp rx=0 tx=0).stop 2024-08-17T02:50:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.464+0000 7fad0da00640 1 -- 172.21.15.5:0/2402141230 shutdown_connections 2024-08-17T02:50:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.464+0000 7fad0da00640 1 --2- 172.21.15.5:0/2402141230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7face4065150 0x7face4067600 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.464+0000 7fad0da00640 1 --2- 172.21.15.5:0/2402141230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad08158dc0 0x7fad081694b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.464+0000 7fad0da00640 1 --2- 172.21.15.5:0/2402141230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad081589f0 0x7fad08168f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.464+0000 7fad0da00640 1 --2- 172.21.15.5:0/2402141230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad080b4f60 0x7fad0814f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.464+0000 7fad0da00640 1 -- 172.21.15.5:0/2402141230 >> 172.21.15.5:0/2402141230 conn(0x7fad08087a80 msgr2=0x7fad080ceb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.465+0000 7fad0da00640 1 -- 172.21.15.5:0/2402141230 shutdown_connections 2024-08-17T02:50:13.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.465+0000 7fad0da00640 1 -- 172.21.15.5:0/2402141230 wait complete. 2024-08-17T02:50:13.486 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:50:13.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.641+0000 7fea1ee00640 1 Processor -- start 2024-08-17T02:50:13.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.641+0000 7fea1ee00640 1 -- start start 2024-08-17T02:50:13.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.642+0000 7fea1ee00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea18158c60 0x7fea1815a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:13.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.642+0000 7fea1ee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea18159030 0x7fea180ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:13.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.642+0000 7fea1ee00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1815b6b0 con 0x7fea18159420 2024-08-17T02:50:13.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.642+0000 7fea1ee00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180b0540 con 0x7fea18158c60 2024-08-17T02:50:13.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.642+0000 7fea1ee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1815aac0 con 0x7fea18159030 2024-08-17T02:50:13.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.642+0000 7fea1da00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea18158c60 0x7fea1815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:13.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.642+0000 7fea1e400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fea18159420 0x7fea180b1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56750/0 (socket says 172.21.15.5:56750) 2024-08-17T02:50:13.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.642+0000 7fea1e400640 1 -- 172.21.15.5:0/1968963025 learned_addr learned my addr 172.21.15.5:0/1968963025 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:13.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.642+0000 7fea1d000640 1 --2- 172.21.15.5:0/1968963025 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea18159030 0x7fea180ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:13.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.643+0000 7fea1da00640 1 -- 172.21.15.5:0/1968963025 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea18159030 msgr2=0x7fea180ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:13.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.643+0000 7fea1da00640 1 --2- 172.21.15.5:0/1968963025 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea18159030 0x7fea180ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:13.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.643+0000 7fea1da00640 1 -- 172.21.15.5:0/1968963025 >> v1:172.21.15.5:6789/0 conn(0x7fea18159420 legacy=0x7fea180b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:13.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.643+0000 7fea1da00640 1 -- 172.21.15.5:0/1968963025 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1815ad80 con 0x7fea18158c60 2024-08-17T02:50:13.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.643+0000 7fea1d000640 1 --2- 172.21.15.5:0/1968963025 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea18159030 0x7fea180ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:13.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.643+0000 7fea17e00640 1 -- 172.21.15.5:0/1968963025 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969157772 0 0) 0x7fea1815b6b0 con 0x7fea18159420 2024-08-17T02:50:13.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.644+0000 7fea1da00640 1 --2- 172.21.15.5:0/1968963025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea18158c60 0x7fea1815a490 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009850 tx=0x7fea0c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7636467ef1c51f36 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:13.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.644+0000 7fea17e00640 1 -- 172.21.15.5:0/1968963025 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c02ad00 con 0x7fea18158c60 2024-08-17T02:50:13.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.644+0000 7fea17e00640 1 -- 172.21.15.5:0/1968963025 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c02ae60 con 0x7fea18158c60 2024-08-17T02:50:13.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.644+0000 7fea17e00640 1 -- 172.21.15.5:0/1968963025 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c032670 con 0x7fea18158c60 2024-08-17T02:50:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.644+0000 7fea1ee00640 1 -- 172.21.15.5:0/1968963025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea18158c60 msgr2=0x7fea1815a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.644+0000 7fea1ee00640 1 --2- 172.21.15.5:0/1968963025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea18158c60 0x7fea1815a490 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009850 tx=0x7fea0c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.645+0000 7fea1ee00640 1 -- 172.21.15.5:0/1968963025 shutdown_connections 2024-08-17T02:50:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.645+0000 7fea1ee00640 1 --2- 172.21.15.5:0/1968963025 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea18159030 0x7fea180ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.645+0000 7fea1ee00640 1 --2- 172.21.15.5:0/1968963025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea18158c60 0x7fea1815a490 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.645+0000 7fea1ee00640 1 -- 172.21.15.5:0/1968963025 >> 172.21.15.5:0/1968963025 conn(0x7fea1806e590 msgr2=0x7fea1806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.645+0000 7fea1ee00640 1 -- 172.21.15.5:0/1968963025 shutdown_connections 2024-08-17T02:50:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.645+0000 7fea1ee00640 1 -- 172.21.15.5:0/1968963025 wait complete. 2024-08-17T02:50:13.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.646+0000 7fea1ee00640 1 Processor -- start 2024-08-17T02:50:13.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.646+0000 7fea1ee00640 1 -- start start 2024-08-17T02:50:13.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.647+0000 7fea1ee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea18158c60 0x7fea180cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:13.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.647+0000 7fea1ee00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea18159030 0x7fea180c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.647+0000 7fea1ee00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea18159420 0x7fea180c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.647+0000 7fea1ee00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea180c6070 con 0x7fea18159030 2024-08-17T02:50:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.647+0000 7fea1ee00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea180c45e0 con 0x7fea18159420 2024-08-17T02:50:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.647+0000 7fea1ee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea180c4830 con 0x7fea18158c60 2024-08-17T02:50:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.647+0000 7fea1d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea18159030 0x7fea180c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.647+0000 7fea1d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea18159030 0x7fea180c55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58388/0 (socket says 172.21.15.5:58388) 2024-08-17T02:50:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.647+0000 7fea1d000640 1 -- 172.21.15.5:0/2875865098 learned_addr learned my addr 172.21.15.5:0/2875865098 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.648+0000 7fea1da00640 1 --2- 172.21.15.5:0/2875865098 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea18158c60 0x7fea180cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.648+0000 7fea1e400640 1 --2- 172.21.15.5:0/2875865098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea18159420 0x7fea180c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.648+0000 7fea1d000640 1 -- 172.21.15.5:0/2875865098 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea18158c60 msgr2=0x7fea180cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.648+0000 7fea1d000640 1 --2- 172.21.15.5:0/2875865098 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea18158c60 0x7fea180cfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.648+0000 7fea1d000640 1 -- 172.21.15.5:0/2875865098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea18159420 msgr2=0x7fea180c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.648+0000 7fea1d000640 1 --2- 172.21.15.5:0/2875865098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea18159420 0x7fea180c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.648+0000 7fea1d000640 1 -- 172.21.15.5:0/2875865098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c009390 con 0x7fea18159030 2024-08-17T02:50:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.648+0000 7fea1e400640 1 --2- 172.21.15.5:0/2875865098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea18159420 0x7fea180c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.648+0000 7fea1d000640 1 --2- 172.21.15.5:0/2875865098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea18159030 0x7fea180c55f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fea0400d890 tx=0x7fea04008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.648+0000 7fea14c00640 1 -- 172.21.15.5:0/2875865098 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0400de80 con 0x7fea18159030 2024-08-17T02:50:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.648+0000 7fea14c00640 1 -- 172.21.15.5:0/2875865098 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0400b8d0 con 0x7fea18159030 2024-08-17T02:50:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.648+0000 7fea14c00640 1 -- 172.21.15.5:0/2875865098 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0400bc90 con 0x7fea18159030 2024-08-17T02:50:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.648+0000 7fea1ee00640 1 -- 172.21.15.5:0/2875865098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea180c4b10 con 0x7fea18159030 2024-08-17T02:50:13.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.649+0000 7fea1ee00640 1 -- 172.21.15.5:0/2875865098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea180c50d0 con 0x7fea18159030 2024-08-17T02:50:13.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.650+0000 7fea1ee00640 1 -- 172.21.15.5:0/2875865098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea18070720 con 0x7fea18159030 2024-08-17T02:50:13.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.650+0000 7fea14c00640 1 -- 172.21.15.5:0/2875865098 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fea0401e460 con 0x7fea18159030 2024-08-17T02:50:13.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.651+0000 7fea14c00640 1 --2- 172.21.15.5:0/2875865098 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe9f8065150 0x7fe9f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:13.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.651+0000 7fea14c00640 1 -- 172.21.15.5:0/2875865098 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fea04082c50 con 0x7fea18159030 2024-08-17T02:50:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.651+0000 7fea1da00640 1 --2- 172.21.15.5:0/2875865098 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe9f8065150 0x7fe9f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.652+0000 7fea1da00640 1 --2- 172.21.15.5:0/2875865098 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe9f8065150 0x7fe9f8067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fea0c034000 tx=0x7fea0c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:13.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.655+0000 7fea14c00640 1 -- 172.21.15.5:0/2875865098 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fea04050bf0 con 0x7fea18159030 2024-08-17T02:50:13.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.837+0000 7fea1ee00640 1 -- 172.21.15.5:0/2875865098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea180afb60 con 0x7fea18159030 2024-08-17T02:50:13.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.838+0000 7fea14c00640 1 -- 172.21.15.5:0/2875865098 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15460 (secure 0 0 0) 0x7fea04054210 con 0x7fea18159030 2024-08-17T02:50:13.840 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:13.840 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:50:13.454281+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000724543.meta","create_time":"2024-08-17T02:48:00.937205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000724543"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000724543.data","create_time":"2024-08-17T02:48:01.789476+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000724543"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6836/723455700":"2024-08-18T02:50:10.445560+0000","172.21.15.5:6834/723455700":"2024-08-18T02:50:10.445560+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:50:13.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.841+0000 7fea1ee00640 1 -- 172.21.15.5:0/2875865098 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe9f8065150 msgr2=0x7fe9f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:13.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.841+0000 7fea1ee00640 1 --2- 172.21.15.5:0/2875865098 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe9f8065150 0x7fe9f8067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fea0c034000 tx=0x7fea0c032000 comp rx=0 tx=0).stop 2024-08-17T02:50:13.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.841+0000 7fea1ee00640 1 -- 172.21.15.5:0/2875865098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea18159030 msgr2=0x7fea180c55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:13.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.841+0000 7fea1ee00640 1 --2- 172.21.15.5:0/2875865098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea18159030 0x7fea180c55f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fea0400d890 tx=0x7fea04008040 comp rx=0 tx=0).stop 2024-08-17T02:50:13.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.841+0000 7fea1ee00640 1 -- 172.21.15.5:0/2875865098 shutdown_connections 2024-08-17T02:50:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.841+0000 7fea1ee00640 1 --2- 172.21.15.5:0/2875865098 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe9f8065150 0x7fe9f8067600 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.841+0000 7fea1ee00640 1 --2- 172.21.15.5:0/2875865098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea18159420 0x7fea180c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.841+0000 7fea1ee00640 1 --2- 172.21.15.5:0/2875865098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea18159030 0x7fea180c55f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.841+0000 7fea1ee00640 1 --2- 172.21.15.5:0/2875865098 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea18158c60 0x7fea180cfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.841+0000 7fea1ee00640 1 -- 172.21.15.5:0/2875865098 >> 172.21.15.5:0/2875865098 conn(0x7fea1806e590 msgr2=0x7fea18068e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.841+0000 7fea1ee00640 1 -- 172.21.15.5:0/2875865098 shutdown_connections 2024-08-17T02:50:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:13.841+0000 7fea1ee00640 1 -- 172.21.15.5:0/2875865098 wait complete. 2024-08-17T02:50:13.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:47.106425+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000724543.meta', 'create_time': '2024-08-17T02:48:00.937205+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000724543'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000724543.data', 'create_time': '2024-08-17T02:48:01.789476+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000724543'}}}] 2024-08-17T02:50:13.858 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:50:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.010+0000 7f6c76e00640 1 Processor -- start 2024-08-17T02:50:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.010+0000 7f6c76e00640 1 -- start start 2024-08-17T02:50:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.011+0000 7f6c76e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c70067570 0x7f6c700afef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.011+0000 7f6c76e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6c700aef70 0x7f6c70154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.011+0000 7f6c76e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c700c8be0 con 0x7f6c700b0430 2024-08-17T02:50:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.011+0000 7f6c76e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c700ad880 con 0x7f6c70067570 2024-08-17T02:50:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.011+0000 7f6c76e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c700af440 con 0x7f6c700aef70 2024-08-17T02:50:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.011+0000 7f6c6fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c70067570 0x7f6c700afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.011+0000 7f6c6fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c70067570 0x7f6c700afef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58398/0 (socket says 172.21.15.5:58398) 2024-08-17T02:50:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.011+0000 7f6c6fe00640 1 -- 172.21.15.5:0/3838476868 learned_addr learned my addr 172.21.15.5:0/3838476868 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.011+0000 7f6c74e00640 1 --2- 172.21.15.5:0/3838476868 >> v2:172.21.15.107:3300/0 conn(0x7f6c700aef70 0x7f6c70154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.012+0000 7f6c6fe00640 1 -- 172.21.15.5:0/3838476868 >> v2:172.21.15.107:3300/0 conn(0x7f6c700aef70 msgr2=0x7f6c70154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.012+0000 7f6c6fe00640 1 --2- 172.21.15.5:0/3838476868 >> v2:172.21.15.107:3300/0 conn(0x7f6c700aef70 0x7f6c70154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.012+0000 7f6c6fe00640 1 -- 172.21.15.5:0/3838476868 >> v1:172.21.15.107:6789/0 conn(0x7f6c700b0430 legacy=0x7f6c700ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:14.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.012+0000 7f6c6fe00640 1 -- 172.21.15.5:0/3838476868 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c700af720 con 0x7f6c70067570 2024-08-17T02:50:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.013+0000 7f6c6fe00640 1 --2- 172.21.15.5:0/3838476868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c70067570 0x7f6c700afef0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6c700c8b50 tx=0x7f6c600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac858fd0b73601ec server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.013+0000 7f6c6f400640 1 -- 172.21.15.5:0/3838476868 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6002add0 con 0x7f6c70067570 2024-08-17T02:50:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.013+0000 7f6c6f400640 1 -- 172.21.15.5:0/3838476868 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c60032440 con 0x7f6c70067570 2024-08-17T02:50:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.013+0000 7f6c6f400640 1 -- 172.21.15.5:0/3838476868 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c60032820 con 0x7f6c70067570 2024-08-17T02:50:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.013+0000 7f6c76e00640 1 -- 172.21.15.5:0/3838476868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c70067570 msgr2=0x7f6c700afef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.013+0000 7f6c76e00640 1 --2- 172.21.15.5:0/3838476868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c70067570 0x7f6c700afef0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6c700c8b50 tx=0x7f6c600091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.014+0000 7f6c76e00640 1 -- 172.21.15.5:0/3838476868 shutdown_connections 2024-08-17T02:50:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.014+0000 7f6c76e00640 1 --2- 172.21.15.5:0/3838476868 >> v2:172.21.15.107:3300/0 conn(0x7f6c700aef70 0x7f6c70154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.014+0000 7f6c76e00640 1 --2- 172.21.15.5:0/3838476868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c70067570 0x7f6c700afef0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.014+0000 7f6c76e00640 1 -- 172.21.15.5:0/3838476868 >> 172.21.15.5:0/3838476868 conn(0x7f6c700cc390 msgr2=0x7f6c70066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.014+0000 7f6c76e00640 1 -- 172.21.15.5:0/3838476868 shutdown_connections 2024-08-17T02:50:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.014+0000 7f6c76e00640 1 -- 172.21.15.5:0/3838476868 wait complete. 2024-08-17T02:50:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.015+0000 7f6c76e00640 1 Processor -- start 2024-08-17T02:50:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.015+0000 7f6c76e00640 1 -- start start 2024-08-17T02:50:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.016+0000 7f6c76e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c70067570 0x7f6c700a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.016+0000 7f6c76e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c700aef70 0x7f6c70149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.016+0000 7f6c76e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c700b0430 0x7f6c700c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.016+0000 7f6c76e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700a6430 con 0x7f6c700b0430 2024-08-17T02:50:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.016+0000 7f6c76e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700a52c0 con 0x7f6c70067570 2024-08-17T02:50:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.016+0000 7f6c76e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700a5820 con 0x7f6c700aef70 2024-08-17T02:50:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.016+0000 7f6c74e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c700b0430 0x7f6c700c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.017+0000 7f6c74e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c700b0430 0x7f6c700c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58402/0 (socket says 172.21.15.5:58402) 2024-08-17T02:50:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.017+0000 7f6c74e00640 1 -- 172.21.15.5:0/2827175239 learned_addr learned my addr 172.21.15.5:0/2827175239 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.017+0000 7f6c6fe00640 1 --2- 172.21.15.5:0/2827175239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c70067570 0x7f6c700a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.017+0000 7f6c67400640 1 --2- 172.21.15.5:0/2827175239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c700aef70 0x7f6c70149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.017+0000 7f6c74e00640 1 -- 172.21.15.5:0/2827175239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c700aef70 msgr2=0x7f6c70149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.017+0000 7f6c74e00640 1 --2- 172.21.15.5:0/2827175239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c700aef70 0x7f6c70149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.017+0000 7f6c74e00640 1 -- 172.21.15.5:0/2827175239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c70067570 msgr2=0x7f6c700a4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.017+0000 7f6c74e00640 1 --2- 172.21.15.5:0/2827175239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c70067570 0x7f6c700a4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.017+0000 7f6c74e00640 1 -- 172.21.15.5:0/2827175239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60009450 con 0x7f6c700b0430 2024-08-17T02:50:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.017+0000 7f6c6fe00640 1 --2- 172.21.15.5:0/2827175239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c70067570 0x7f6c700a4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.017+0000 7f6c74e00640 1 --2- 172.21.15.5:0/2827175239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c700b0430 0x7f6c700c7660 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6c68007f30 tx=0x7f6c680098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.017+0000 7f6c67e00640 1 -- 172.21.15.5:0/2827175239 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6800ee30 con 0x7f6c700b0430 2024-08-17T02:50:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.018+0000 7f6c67e00640 1 -- 172.21.15.5:0/2827175239 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c68014420 con 0x7f6c700b0430 2024-08-17T02:50:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.018+0000 7f6c67e00640 1 -- 172.21.15.5:0/2827175239 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c680147e0 con 0x7f6c700b0430 2024-08-17T02:50:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.018+0000 7f6c76e00640 1 -- 172.21.15.5:0/2827175239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c700a5b00 con 0x7f6c700b0430 2024-08-17T02:50:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.018+0000 7f6c76e00640 1 -- 172.21.15.5:0/2827175239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c700a60c0 con 0x7f6c700b0430 2024-08-17T02:50:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.019+0000 7f6c76e00640 1 -- 172.21.15.5:0/2827175239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c700a65a0 con 0x7f6c700b0430 2024-08-17T02:50:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.019+0000 7f6c67e00640 1 -- 172.21.15.5:0/2827175239 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6c68014b90 con 0x7f6c700b0430 2024-08-17T02:50:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.020+0000 7f6c67e00640 1 --2- 172.21.15.5:0/2827175239 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6c4c065180 0x7f6c4c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.020+0000 7f6c67e00640 1 -- 172.21.15.5:0/2827175239 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f6c68082d10 con 0x7f6c700b0430 2024-08-17T02:50:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.021+0000 7f6c6fe00640 1 --2- 172.21.15.5:0/2827175239 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6c4c065180 0x7f6c4c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.021+0000 7f6c6fe00640 1 --2- 172.21.15.5:0/2827175239 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6c4c065180 0x7f6c4c067630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6c60034000 tx=0x7f6c60032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.024+0000 7f6c67e00640 1 -- 172.21.15.5:0/2827175239 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6c68088020 con 0x7f6c700b0430 2024-08-17T02:50:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.208+0000 7f6c76e00640 1 -- 172.21.15.5:0/2827175239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c70063fb0 con 0x7f6c700b0430 2024-08-17T02:50:14.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.208+0000 7f6c67e00640 1 -- 172.21.15.5:0/2827175239 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c68054740 con 0x7f6c700b0430 2024-08-17T02:50:14.210 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-17T02:50:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.210+0000 7f6c76e00640 1 -- 172.21.15.5:0/2827175239 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6c4c065180 msgr2=0x7f6c4c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.210+0000 7f6c76e00640 1 --2- 172.21.15.5:0/2827175239 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6c4c065180 0x7f6c4c067630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6c60034000 tx=0x7f6c60032000 comp rx=0 tx=0).stop 2024-08-17T02:50:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.210+0000 7f6c76e00640 1 -- 172.21.15.5:0/2827175239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c700b0430 msgr2=0x7f6c700c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.210+0000 7f6c76e00640 1 --2- 172.21.15.5:0/2827175239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c700b0430 0x7f6c700c7660 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6c68007f30 tx=0x7f6c680098e0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.210+0000 7f6c76e00640 1 -- 172.21.15.5:0/2827175239 shutdown_connections 2024-08-17T02:50:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.210+0000 7f6c76e00640 1 --2- 172.21.15.5:0/2827175239 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6c4c065180 0x7f6c4c067630 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.210+0000 7f6c76e00640 1 --2- 172.21.15.5:0/2827175239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c700b0430 0x7f6c700c7660 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.210+0000 7f6c76e00640 1 --2- 172.21.15.5:0/2827175239 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6c700aef70 0x7f6c70149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.210+0000 7f6c76e00640 1 --2- 172.21.15.5:0/2827175239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c70067570 0x7f6c700a4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.210+0000 7f6c76e00640 1 -- 172.21.15.5:0/2827175239 >> 172.21.15.5:0/2827175239 conn(0x7f6c700cc390 msgr2=0x7f6c70158c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.211+0000 7f6c76e00640 1 -- 172.21.15.5:0/2827175239 shutdown_connections 2024-08-17T02:50:14.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.211+0000 7f6c76e00640 1 -- 172.21.15.5:0/2827175239 wait complete. 2024-08-17T02:50:14.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000724543.meta pg_num 2024-08-17T02:50:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.379+0000 7f4006000640 1 Processor -- start 2024-08-17T02:50:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.379+0000 7f4006000640 1 -- start start 2024-08-17T02:50:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.380+0000 7f4006000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f400006dee0 0x7f40000b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.380+0000 7f4006000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40000aff30 con 0x7f400015cdc0 2024-08-17T02:50:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.381+0000 7f4006000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40000af320 con 0x7f40000b03c0 2024-08-17T02:50:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.381+0000 7f4006000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40000af600 con 0x7f400006dee0 2024-08-17T02:50:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.381+0000 7f3fff400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f400015cdc0 0x7f40000ae860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56758/0 (socket says 172.21.15.5:56758) 2024-08-17T02:50:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.381+0000 7f3fff400640 1 -- 172.21.15.5:0/3799738782 learned_addr learned my addr 172.21.15.5:0/3799738782 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.381+0000 7f3fffe00640 1 --2- 172.21.15.5:0/3799738782 >> v2:172.21.15.107:3300/0 conn(0x7f400006dee0 0x7f40000b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.381+0000 7f3ffea00640 1 -- 172.21.15.5:0/3799738782 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469822506 0 0) 0x7f40000aff30 con 0x7f400015cdc0 2024-08-17T02:50:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.381+0000 7f3ffea00640 1 -- 172.21.15.5:0/3799738782 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fe40034e0 con 0x7f400015cdc0 2024-08-17T02:50:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3ffea00640 1 -- 172.21.15.5:0/3799738782 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 581850795 0 0) 0x7f3fe40034e0 con 0x7f400015cdc0 2024-08-17T02:50:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3ffea00640 1 -- 172.21.15.5:0/3799738782 >> v2:172.21.15.107:3300/0 conn(0x7f400006dee0 msgr2=0x7f40000b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3ffea00640 1 --2- 172.21.15.5:0/3799738782 >> v2:172.21.15.107:3300/0 conn(0x7f400006dee0 0x7f40000b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3ffea00640 1 -- 172.21.15.5:0/3799738782 >> v1:172.21.15.107:6789/0 conn(0x7f40000b03c0 legacy=0x7f400006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3ffea00640 1 -- 172.21.15.5:0/3799738782 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40000af8e0 con 0x7f400015cdc0 2024-08-17T02:50:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3ffea00640 1 -- 172.21.15.5:0/3799738782 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7f3ff0001470 con 0x7f400015cdc0 2024-08-17T02:50:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3ffea00640 1 -- 172.21.15.5:0/3799738782 >> v1:172.21.15.5:6789/0 conn(0x7f400015cdc0 legacy=0x7f40000ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3ffea00640 1 --2- 172.21.15.5:0/3799738782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe4003a20 0x7f3fe4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3ffea00640 1 --2- 172.21.15.5:0/3799738782 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fe4004780 0x7f3fe4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3ffea00640 1 --2- 172.21.15.5:0/3799738782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fe4005180 0x7f3fe400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3ffea00640 1 -- 172.21.15.5:0/3799738782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40000af600 con 0x7f3fe4003a20 2024-08-17T02:50:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3ffea00640 1 -- 172.21.15.5:0/3799738782 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe400c120 con 0x7f3fe4005180 2024-08-17T02:50:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3ffea00640 1 -- 172.21.15.5:0/3799738782 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe400c2e0 con 0x7f3fe4004780 2024-08-17T02:50:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3fff400640 1 --2- 172.21.15.5:0/3799738782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe4003a20 0x7f3fe4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3fffe00640 1 --2- 172.21.15.5:0/3799738782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fe4005180 0x7f3fe400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3ff7e00640 1 --2- 172.21.15.5:0/3799738782 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fe4004780 0x7f3fe4004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3fff400640 1 -- 172.21.15.5:0/3799738782 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fe4004780 msgr2=0x7f3fe4004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3fff400640 1 --2- 172.21.15.5:0/3799738782 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fe4004780 0x7f3fe4004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3fff400640 1 -- 172.21.15.5:0/3799738782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fe4005180 msgr2=0x7f3fe400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3fff400640 1 --2- 172.21.15.5:0/3799738782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fe4005180 0x7f3fe400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3fff400640 1 -- 172.21.15.5:0/3799738782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe40034e0 con 0x7f3fe4003a20 2024-08-17T02:50:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3fffe00640 1 -- 172.21.15.5:0/3799738782 reap_dead start 2024-08-17T02:50:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.382+0000 7f3ff7e00640 1 --2- 172.21.15.5:0/3799738782 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3fe4004780 0x7f3fe4004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:14.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.383+0000 7f3fff400640 1 --2- 172.21.15.5:0/3799738782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe4003a20 0x7f3fe4003e30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000c190 tx=0x7f3ff0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676c41d6cafd7dd5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.384+0000 7f3ffea00640 1 -- 172.21.15.5:0/3799738782 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0005890 con 0x7f3fe4003a20 2024-08-17T02:50:14.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.384+0000 7f3ffea00640 1 -- 172.21.15.5:0/3799738782 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff002d070 con 0x7f3fe4003a20 2024-08-17T02:50:14.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.384+0000 7f3ffea00640 1 -- 172.21.15.5:0/3799738782 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0005a50 con 0x7f3fe4003a20 2024-08-17T02:50:14.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.384+0000 7f4006000640 1 -- 172.21.15.5:0/3799738782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe4003a20 msgr2=0x7f3fe4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.384+0000 7f4006000640 1 --2- 172.21.15.5:0/3799738782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe4003a20 0x7f3fe4003e30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3ff000c190 tx=0x7f3ff0001d80 comp rx=0 tx=0).stop 2024-08-17T02:50:14.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.384+0000 7f4006000640 1 -- 172.21.15.5:0/3799738782 shutdown_connections 2024-08-17T02:50:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.384+0000 7f4006000640 1 --2- 172.21.15.5:0/3799738782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fe4003a20 0x7f3fe4003e30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.384+0000 7f4006000640 1 -- 172.21.15.5:0/3799738782 >> 172.21.15.5:0/3799738782 conn(0x7f4000066e60 msgr2=0x7f4000067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.384+0000 7f4006000640 1 -- 172.21.15.5:0/3799738782 shutdown_connections 2024-08-17T02:50:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.384+0000 7f4006000640 1 -- 172.21.15.5:0/3799738782 wait complete. 2024-08-17T02:50:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.386+0000 7f4006000640 1 Processor -- start 2024-08-17T02:50:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.386+0000 7f4006000640 1 -- start start 2024-08-17T02:50:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f4006000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fe4003a20 0x7f40001528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f4006000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f400016e060 0x7f40001429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f4006000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4000158420 0x7f40001588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f4006000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4000158de0 con 0x7f4000158420 2024-08-17T02:50:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f4006000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40001531c0 con 0x7f3fe4003a20 2024-08-17T02:50:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f4006000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40001534a0 con 0x7f400016e060 2024-08-17T02:50:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f3fffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4000158420 0x7f40001588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f3fffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4000158420 0x7f40001588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58412/0 (socket says 172.21.15.5:58412) 2024-08-17T02:50:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f3fffe00640 1 -- 172.21.15.5:0/3356107321 learned_addr learned my addr 172.21.15.5:0/3356107321 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f3fff400640 1 --2- 172.21.15.5:0/3356107321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fe4003a20 0x7f40001528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f3ff7e00640 1 --2- 172.21.15.5:0/3356107321 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f400016e060 0x7f40001429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f3fffe00640 1 -- 172.21.15.5:0/3356107321 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f400016e060 msgr2=0x7f40001429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f3fffe00640 1 --2- 172.21.15.5:0/3356107321 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f400016e060 0x7f40001429d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f3fffe00640 1 -- 172.21.15.5:0/3356107321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fe4003a20 msgr2=0x7f40001528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f3fffe00640 1 --2- 172.21.15.5:0/3356107321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fe4003a20 0x7f40001528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f3fffe00640 1 -- 172.21.15.5:0/3356107321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4000153780 con 0x7f4000158420 2024-08-17T02:50:14.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.387+0000 7f3fffe00640 1 --2- 172.21.15.5:0/3356107321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4000158420 0x7f40001588a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80094d0 tx=0x7f3ff800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.388+0000 7f3ff6a00640 1 -- 172.21.15.5:0/3356107321 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800e040 con 0x7f4000158420 2024-08-17T02:50:14.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.388+0000 7f3ff6a00640 1 -- 172.21.15.5:0/3356107321 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff800f040 con 0x7f4000158420 2024-08-17T02:50:14.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.388+0000 7f3ff6a00640 1 -- 172.21.15.5:0/3356107321 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8015920 con 0x7f4000158420 2024-08-17T02:50:14.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.388+0000 7f4006000640 1 -- 172.21.15.5:0/3356107321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4000153a60 con 0x7f4000158420 2024-08-17T02:50:14.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.388+0000 7f4006000640 1 -- 172.21.15.5:0/3356107321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4000154260 con 0x7f4000158420 2024-08-17T02:50:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.389+0000 7f4006000640 1 -- 172.21.15.5:0/3356107321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4000153f60 con 0x7f4000158420 2024-08-17T02:50:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.390+0000 7f3ff6a00640 1 -- 172.21.15.5:0/3356107321 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3ff8015c90 con 0x7f4000158420 2024-08-17T02:50:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.391+0000 7f3ff6a00640 1 --2- 172.21.15.5:0/3356107321 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3fdc065180 0x7f3fdc067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.391+0000 7f3ff6a00640 1 -- 172.21.15.5:0/3356107321 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f3ff8082690 con 0x7f4000158420 2024-08-17T02:50:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.391+0000 7f3fff400640 1 --2- 172.21.15.5:0/3356107321 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3fdc065180 0x7f3fdc067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.392+0000 7f3fff400640 1 --2- 172.21.15.5:0/3356107321 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3fdc065180 0x7f3fdc067630 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0032000 tx=0x7f3ff0033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.395+0000 7f3ff6a00640 1 -- 172.21.15.5:0/3356107321 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3ff80540c0 con 0x7f4000158420 2024-08-17T02:50:14.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.579+0000 7f4006000640 1 -- 172.21.15.5:0/3356107321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000724543.meta", "var": "pg_num"} v 0) v1 -- 0x7f4000063fb0 con 0x7f4000158420 2024-08-17T02:50:14.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.579+0000 7f3ff6a00640 1 -- 172.21.15.5:0/3356107321 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000724543.meta", "var": "pg_num"}]=0 v40) v1 ==== 124+0+11 (secure 0 0 0) 0x7f3ff8053c50 con 0x7f4000158420 2024-08-17T02:50:14.581 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:50:14.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.581+0000 7f4006000640 1 -- 172.21.15.5:0/3356107321 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3fdc065180 msgr2=0x7f3fdc067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.581+0000 7f4006000640 1 --2- 172.21.15.5:0/3356107321 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3fdc065180 0x7f3fdc067630 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0032000 tx=0x7f3ff0033000 comp rx=0 tx=0).stop 2024-08-17T02:50:14.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.581+0000 7f4006000640 1 -- 172.21.15.5:0/3356107321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4000158420 msgr2=0x7f40001588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.581+0000 7f4006000640 1 --2- 172.21.15.5:0/3356107321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4000158420 0x7f40001588a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80094d0 tx=0x7f3ff800b040 comp rx=0 tx=0).stop 2024-08-17T02:50:14.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.581+0000 7f4006000640 1 -- 172.21.15.5:0/3356107321 shutdown_connections 2024-08-17T02:50:14.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.581+0000 7f4006000640 1 --2- 172.21.15.5:0/3356107321 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3fdc065180 0x7f3fdc067630 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.581+0000 7f4006000640 1 --2- 172.21.15.5:0/3356107321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4000158420 0x7f40001588a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.581+0000 7f4006000640 1 --2- 172.21.15.5:0/3356107321 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f400016e060 0x7f40001429d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.581+0000 7f4006000640 1 --2- 172.21.15.5:0/3356107321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3fe4003a20 0x7f40001528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.581+0000 7f4006000640 1 -- 172.21.15.5:0/3356107321 >> 172.21.15.5:0/3356107321 conn(0x7f4000066e60 msgr2=0x7f40000ae910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:14.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.582+0000 7f4006000640 1 -- 172.21.15.5:0/3356107321 shutdown_connections 2024-08-17T02:50:14.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.582+0000 7f4006000640 1 -- 172.21.15.5:0/3356107321 wait complete. 2024-08-17T02:50:14.598 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000724543.data pg_num 2024-08-17T02:50:14.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.750+0000 7ff883200640 1 Processor -- start 2024-08-17T02:50:14.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.751+0000 7ff883200640 1 -- start start 2024-08-17T02:50:14.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.752+0000 7ff883200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8840aa620 0x7ff8840aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.752+0000 7ff883200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8840b2100 0x7ff8841605a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.752+0000 7ff883200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff884156fc0 con 0x7ff8840aaf30 2024-08-17T02:50:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.752+0000 7ff883200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff884158450 con 0x7ff8840aa620 2024-08-17T02:50:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.752+0000 7ff883200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8841586f0 con 0x7ff8840b2100 2024-08-17T02:50:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.752+0000 7ff881e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8840aa620 0x7ff8840aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.752+0000 7ff881e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8840aa620 0x7ff8840aa9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58416/0 (socket says 172.21.15.5:58416) 2024-08-17T02:50:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.752+0000 7ff881e00640 1 -- 172.21.15.5:0/1358320989 learned_addr learned my addr 172.21.15.5:0/1358320989 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.752+0000 7ff882800640 1 --2- 172.21.15.5:0/1358320989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8840b2100 0x7ff8841605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.752+0000 7ff881e00640 1 -- 172.21.15.5:0/1358320989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8840b2100 msgr2=0x7ff8841605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.752+0000 7ff881e00640 1 --2- 172.21.15.5:0/1358320989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8840b2100 0x7ff8841605a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.752+0000 7ff881e00640 1 -- 172.21.15.5:0/1358320989 >> v1:172.21.15.107:6789/0 conn(0x7ff8840aaf30 legacy=0x7ff8840b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.753+0000 7ff881e00640 1 -- 172.21.15.5:0/1358320989 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8840b2a20 con 0x7ff8840aa620 2024-08-17T02:50:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.754+0000 7ff881e00640 1 --2- 172.21.15.5:0/1358320989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8840aa620 0x7ff8840aa9f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff874009910 tx=0x7ff8740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c8541782f30e96 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.754+0000 7ff880a00640 1 -- 172.21.15.5:0/1358320989 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87402ae40 con 0x7ff8840aa620 2024-08-17T02:50:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.754+0000 7ff880a00640 1 -- 172.21.15.5:0/1358320989 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff874032440 con 0x7ff8840aa620 2024-08-17T02:50:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.754+0000 7ff880a00640 1 -- 172.21.15.5:0/1358320989 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874032820 con 0x7ff8840aa620 2024-08-17T02:50:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.754+0000 7ff883200640 1 -- 172.21.15.5:0/1358320989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8840aa620 msgr2=0x7ff8840aa9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.754+0000 7ff883200640 1 --2- 172.21.15.5:0/1358320989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8840aa620 0x7ff8840aa9f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff874009910 tx=0x7ff8740091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.754+0000 7ff883200640 1 -- 172.21.15.5:0/1358320989 shutdown_connections 2024-08-17T02:50:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.755+0000 7ff883200640 1 --2- 172.21.15.5:0/1358320989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8840b2100 0x7ff8841605a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.755+0000 7ff883200640 1 --2- 172.21.15.5:0/1358320989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8840aa620 0x7ff8840aa9f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.755+0000 7ff883200640 1 -- 172.21.15.5:0/1358320989 >> 172.21.15.5:0/1358320989 conn(0x7ff8840ce400 msgr2=0x7ff884095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.755+0000 7ff883200640 1 -- 172.21.15.5:0/1358320989 shutdown_connections 2024-08-17T02:50:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.755+0000 7ff883200640 1 -- 172.21.15.5:0/1358320989 wait complete. 2024-08-17T02:50:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.756+0000 7ff883200640 1 Processor -- start 2024-08-17T02:50:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.756+0000 7ff883200640 1 -- start start 2024-08-17T02:50:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.757+0000 7ff883200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8840aa620 0x7ff884067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.757+0000 7ff883200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8840aaf30 0x7ff8840ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.757+0000 7ff883200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8840b2100 0x7ff8840aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.757+0000 7ff883200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8840abf80 con 0x7ff8840aa620 2024-08-17T02:50:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.757+0000 7ff883200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8840685e0 con 0x7ff8840b2100 2024-08-17T02:50:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.757+0000 7ff883200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8840688c0 con 0x7ff8840aaf30 2024-08-17T02:50:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.757+0000 7ff881e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8840aa620 0x7ff884067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.757+0000 7ff881e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8840aa620 0x7ff884067f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58418/0 (socket says 172.21.15.5:58418) 2024-08-17T02:50:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.757+0000 7ff881e00640 1 -- 172.21.15.5:0/2779432079 learned_addr learned my addr 172.21.15.5:0/2779432079 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.757+0000 7ff882800640 1 --2- 172.21.15.5:0/2779432079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8840b2100 0x7ff8840aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.757+0000 7ff881400640 1 --2- 172.21.15.5:0/2779432079 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8840aaf30 0x7ff8840ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.758+0000 7ff881e00640 1 -- 172.21.15.5:0/2779432079 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8840aaf30 msgr2=0x7ff8840ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.758+0000 7ff881e00640 1 --2- 172.21.15.5:0/2779432079 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8840aaf30 0x7ff8840ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.758+0000 7ff881e00640 1 -- 172.21.15.5:0/2779432079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8840b2100 msgr2=0x7ff8840aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.758+0000 7ff881e00640 1 --2- 172.21.15.5:0/2779432079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8840b2100 0x7ff8840aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.758+0000 7ff881e00640 1 -- 172.21.15.5:0/2779432079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff874009450 con 0x7ff8840aa620 2024-08-17T02:50:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.758+0000 7ff881e00640 1 --2- 172.21.15.5:0/2779432079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8840aa620 0x7ff884067f70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff874035040 tx=0x7ff874032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.758+0000 7ff879600640 1 -- 172.21.15.5:0/2779432079 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874031bb0 con 0x7ff8840aa620 2024-08-17T02:50:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.758+0000 7ff879600640 1 -- 172.21.15.5:0/2779432079 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff874031d30 con 0x7ff8840aa620 2024-08-17T02:50:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.758+0000 7ff883200640 1 -- 172.21.15.5:0/2779432079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff884068ba0 con 0x7ff8840aa620 2024-08-17T02:50:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.758+0000 7ff879600640 1 -- 172.21.15.5:0/2779432079 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874031ea0 con 0x7ff8840aa620 2024-08-17T02:50:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.758+0000 7ff883200640 1 -- 172.21.15.5:0/2779432079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff884069160 con 0x7ff8840aa620 2024-08-17T02:50:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.759+0000 7ff883200640 1 -- 172.21.15.5:0/2779432079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff884069350 con 0x7ff8840aa620 2024-08-17T02:50:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.760+0000 7ff879600640 1 -- 172.21.15.5:0/2779432079 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff874039040 con 0x7ff8840aa620 2024-08-17T02:50:14.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.761+0000 7ff879600640 1 --2- 172.21.15.5:0/2779432079 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff864065150 0x7ff864067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:14.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.761+0000 7ff879600640 1 -- 172.21.15.5:0/2779432079 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7ff87402ae40 con 0x7ff8840aa620 2024-08-17T02:50:14.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.761+0000 7ff881400640 1 --2- 172.21.15.5:0/2779432079 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff864065150 0x7ff864067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:14.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.762+0000 7ff881400640 1 --2- 172.21.15.5:0/2779432079 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff864065150 0x7ff864067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff8840cd770 tx=0x7ff870009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.765+0000 7ff879600640 1 -- 172.21.15.5:0/2779432079 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff8740707a0 con 0x7ff8840aa620 2024-08-17T02:50:14.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.948+0000 7ff883200640 1 -- 172.21.15.5:0/2779432079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000724543.data", "var": "pg_num"} v 0) v1 -- 0x7ff884070720 con 0x7ff8840aa620 2024-08-17T02:50:14.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.948+0000 7ff879600640 1 -- 172.21.15.5:0/2779432079 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000724543.data", "var": "pg_num"}]=0 v40) v1 ==== 124+0+11 (secure 0 0 0) 0x7ff874073dc0 con 0x7ff8840aa620 2024-08-17T02:50:14.950 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-17T02:50:14.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.950+0000 7ff883200640 1 -- 172.21.15.5:0/2779432079 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff864065150 msgr2=0x7ff864067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.950+0000 7ff883200640 1 --2- 172.21.15.5:0/2779432079 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff864065150 0x7ff864067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff8840cd770 tx=0x7ff870009040 comp rx=0 tx=0).stop 2024-08-17T02:50:14.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.950+0000 7ff883200640 1 -- 172.21.15.5:0/2779432079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8840aa620 msgr2=0x7ff884067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:14.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.950+0000 7ff883200640 1 --2- 172.21.15.5:0/2779432079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8840aa620 0x7ff884067f70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff874035040 tx=0x7ff874032000 comp rx=0 tx=0).stop 2024-08-17T02:50:14.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.950+0000 7ff883200640 1 -- 172.21.15.5:0/2779432079 shutdown_connections 2024-08-17T02:50:14.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.950+0000 7ff883200640 1 --2- 172.21.15.5:0/2779432079 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff864065150 0x7ff864067600 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.950+0000 7ff883200640 1 --2- 172.21.15.5:0/2779432079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8840b2100 0x7ff8840aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.950+0000 7ff883200640 1 --2- 172.21.15.5:0/2779432079 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff8840aaf30 0x7ff8840ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.950+0000 7ff883200640 1 --2- 172.21.15.5:0/2779432079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8840aa620 0x7ff884067f70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:14.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.950+0000 7ff883200640 1 -- 172.21.15.5:0/2779432079 >> 172.21.15.5:0/2779432079 conn(0x7ff8840ce400 msgr2=0x7ff88414f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:14.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.951+0000 7ff883200640 1 -- 172.21.15.5:0/2779432079 shutdown_connections 2024-08-17T02:50:14.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:14.951+0000 7ff883200640 1 -- 172.21.15.5:0/2779432079 wait complete. 2024-08-17T02:50:14.967 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:50:15.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.117+0000 7f9cda400640 1 Processor -- start 2024-08-17T02:50:15.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.117+0000 7f9cda400640 1 -- start start 2024-08-17T02:50:15.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.118+0000 7f9cda400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9cd4158b10 0x7f9cd40b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.118+0000 7f9cda400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd40b25c0 0x7f9cd4066e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.118+0000 7f9cda400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cd4158ee0 0x7f9cd40673a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.118+0000 7f9cda400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd40a9620 con 0x7f9cd4158ee0 2024-08-17T02:50:15.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.118+0000 7f9cda400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd40aa420 con 0x7f9cd4158b10 2024-08-17T02:50:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.118+0000 7f9cda400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd40a9850 con 0x7f9cd40b25c0 2024-08-17T02:50:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.118+0000 7f9cd9a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cd4158ee0 0x7f9cd40673a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.118+0000 7f9cd9a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cd4158ee0 0x7f9cd40673a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58428/0 (socket says 172.21.15.5:58428) 2024-08-17T02:50:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.118+0000 7f9cd9a00640 1 -- 172.21.15.5:0/4223140574 learned_addr learned my addr 172.21.15.5:0/4223140574 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.119+0000 7f9cd9000640 1 --2- 172.21.15.5:0/4223140574 >> v2:172.21.15.107:3300/0 conn(0x7f9cd4158b10 0x7f9cd40b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.119+0000 7f9cd3e00640 1 --2- 172.21.15.5:0/4223140574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd40b25c0 0x7f9cd4066e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.119+0000 7f9cd9a00640 1 -- 172.21.15.5:0/4223140574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd40b25c0 msgr2=0x7f9cd4066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.119+0000 7f9cd9a00640 1 --2- 172.21.15.5:0/4223140574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd40b25c0 0x7f9cd4066e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.119+0000 7f9cd9a00640 1 -- 172.21.15.5:0/4223140574 >> v2:172.21.15.107:3300/0 conn(0x7f9cd4158b10 msgr2=0x7f9cd40b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.119+0000 7f9cd9a00640 1 --2- 172.21.15.5:0/4223140574 >> v2:172.21.15.107:3300/0 conn(0x7f9cd4158b10 0x7f9cd40b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.119+0000 7f9cd9a00640 1 -- 172.21.15.5:0/4223140574 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd4067c40 con 0x7f9cd4158ee0 2024-08-17T02:50:15.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.120+0000 7f9cd9a00640 1 --2- 172.21.15.5:0/4223140574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd4158ee0 0x7f9cd40673a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009f20 tx=0x7f9ccc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66e48120ac5c9b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.120+0000 7f9cd3400640 1 -- 172.21.15.5:0/4223140574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc031400 con 0x7f9cd4158ee0 2024-08-17T02:50:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.120+0000 7f9cd3400640 1 -- 172.21.15.5:0/4223140574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ccc02d050 con 0x7f9cd4158ee0 2024-08-17T02:50:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.120+0000 7f9cd3400640 1 -- 172.21.15.5:0/4223140574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc0317d0 con 0x7f9cd4158ee0 2024-08-17T02:50:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.121+0000 7f9cda400640 1 -- 172.21.15.5:0/4223140574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd4158ee0 msgr2=0x7f9cd40673a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.121+0000 7f9cda400640 1 --2- 172.21.15.5:0/4223140574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd4158ee0 0x7f9cd40673a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009f20 tx=0x7f9ccc009840 comp rx=0 tx=0).stop 2024-08-17T02:50:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.121+0000 7f9cda400640 1 -- 172.21.15.5:0/4223140574 shutdown_connections 2024-08-17T02:50:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.121+0000 7f9cda400640 1 --2- 172.21.15.5:0/4223140574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd4158ee0 0x7f9cd40673a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.121+0000 7f9cda400640 1 --2- 172.21.15.5:0/4223140574 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd40b25c0 0x7f9cd4066e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.121+0000 7f9cda400640 1 --2- 172.21.15.5:0/4223140574 >> v2:172.21.15.107:3300/0 conn(0x7f9cd4158b10 0x7f9cd40b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.121+0000 7f9cda400640 1 -- 172.21.15.5:0/4223140574 >> 172.21.15.5:0/4223140574 conn(0x7f9cd4095a70 msgr2=0x7f9cd4095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.121+0000 7f9cda400640 1 -- 172.21.15.5:0/4223140574 shutdown_connections 2024-08-17T02:50:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.121+0000 7f9cda400640 1 -- 172.21.15.5:0/4223140574 wait complete. 2024-08-17T02:50:15.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.122+0000 7f9cda400640 1 Processor -- start 2024-08-17T02:50:15.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.122+0000 7f9cda400640 1 -- start start 2024-08-17T02:50:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.123+0000 7f9cda400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd40b25c0 0x7f9cd414e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.123+0000 7f9cda400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd4158b10 0x7f9cd4151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.123+0000 7f9cda400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cd4158ee0 0x7f9cd4154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.123+0000 7f9cda400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd41523a0 con 0x7f9cd4158b10 2024-08-17T02:50:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.123+0000 7f9cda400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd41599e0 con 0x7f9cd4158ee0 2024-08-17T02:50:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.123+0000 7f9cda400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd414e690 con 0x7f9cd40b25c0 2024-08-17T02:50:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.124+0000 7f9cd3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd4158b10 0x7f9cd4151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.124+0000 7f9cd3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd4158b10 0x7f9cd4151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58430/0 (socket says 172.21.15.5:58430) 2024-08-17T02:50:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.124+0000 7f9cd3e00640 1 -- 172.21.15.5:0/3912101112 learned_addr learned my addr 172.21.15.5:0/3912101112 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.124+0000 7f9cd9000640 1 --2- 172.21.15.5:0/3912101112 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd40b25c0 0x7f9cd414e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.124+0000 7f9cd9a00640 1 --2- 172.21.15.5:0/3912101112 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cd4158ee0 0x7f9cd4154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.124+0000 7f9cd3e00640 1 -- 172.21.15.5:0/3912101112 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd40b25c0 msgr2=0x7f9cd414e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.124+0000 7f9cd3e00640 1 --2- 172.21.15.5:0/3912101112 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd40b25c0 0x7f9cd414e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.124+0000 7f9cd3e00640 1 -- 172.21.15.5:0/3912101112 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cd4158ee0 msgr2=0x7f9cd4154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.124+0000 7f9cd3e00640 1 --2- 172.21.15.5:0/3912101112 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cd4158ee0 0x7f9cd4154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.124+0000 7f9cd3e00640 1 -- 172.21.15.5:0/3912101112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ccc009ae0 con 0x7f9cd4158b10 2024-08-17T02:50:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.124+0000 7f9cd9a00640 1 --2- 172.21.15.5:0/3912101112 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cd4158ee0 0x7f9cd4154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.124+0000 7f9cd3e00640 1 --2- 172.21.15.5:0/3912101112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd4158b10 0x7f9cd4151560 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000ea20 tx=0x7f9cc00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.125+0000 7f9cc7e00640 1 -- 172.21.15.5:0/3912101112 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc000ca10 con 0x7f9cd4158b10 2024-08-17T02:50:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.125+0000 7f9cc7e00640 1 -- 172.21.15.5:0/3912101112 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc000cb70 con 0x7f9cd4158b10 2024-08-17T02:50:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.125+0000 7f9cc7e00640 1 -- 172.21.15.5:0/3912101112 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0013470 con 0x7f9cd4158b10 2024-08-17T02:50:15.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.125+0000 7f9cda400640 1 -- 172.21.15.5:0/3912101112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd4151de0 con 0x7f9cd4158b10 2024-08-17T02:50:15.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.125+0000 7f9cda400640 1 -- 172.21.15.5:0/3912101112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd4159670 con 0x7f9cd4158b10 2024-08-17T02:50:15.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.126+0000 7f9cda400640 1 -- 172.21.15.5:0/3912101112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd41594d0 con 0x7f9cd4158b10 2024-08-17T02:50:15.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.126+0000 7f9cc7e00640 1 -- 172.21.15.5:0/3912101112 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9cc0013860 con 0x7f9cd4158b10 2024-08-17T02:50:15.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.128+0000 7f9cc7e00640 1 --2- 172.21.15.5:0/3912101112 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9cb4065180 0x7f9cb4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.128+0000 7f9cc7e00640 1 -- 172.21.15.5:0/3912101112 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f9cc0082870 con 0x7f9cd4158b10 2024-08-17T02:50:15.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.128+0000 7f9cd9000640 1 --2- 172.21.15.5:0/3912101112 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9cb4065180 0x7f9cb4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.129+0000 7f9cd9000640 1 --2- 172.21.15.5:0/3912101112 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9cb4065180 0x7f9cb4067630 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009cb0 tx=0x7f9cc8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.132+0000 7f9cc7e00640 1 -- 172.21.15.5:0/3912101112 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9cd41594d0 con 0x7f9cd4158b10 2024-08-17T02:50:15.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.351+0000 7f9cda400640 1 -- 172.21.15.5:0/3912101112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cd41594d0 con 0x7f9cd4158b10 2024-08-17T02:50:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.352+0000 7f9cc7e00640 1 -- 172.21.15.5:0/3912101112 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4615 (secure 0 0 0) 0x7f9cd41594d0 con 0x7f9cd4158b10 2024-08-17T02:50:15.353 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:15.353 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2464391944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2464391944},{"type":"v1","addr":"172.21.15.107:6835","nonce":2464391944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2049823505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2049823505},{"type":"v1","addr":"172.21.15.107:6834","nonce":2049823505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/4240118786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4240118786},{"type":"v1","addr":"172.21.15.5:6836","nonce":4240118786}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:48:02.750931+0000","modified":"2024-08-17T02:48:04.145198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4691},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4691":{"gid":4691,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.5:6837/1768626934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1768626934},{"type":"v1","addr":"172.21.15.5:6837","nonce":1768626934}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000724543","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:50:15.354 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 21 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.354+0000 7f9cda400640 1 -- 172.21.15.5:0/3912101112 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9cb4065180 msgr2=0x7f9cb4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.354+0000 7f9cda400640 1 --2- 172.21.15.5:0/3912101112 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9cb4065180 0x7f9cb4067630 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009cb0 tx=0x7f9cc8008040 comp rx=0 tx=0).stop 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.354+0000 7f9cda400640 1 -- 172.21.15.5:0/3912101112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd4158b10 msgr2=0x7f9cd4151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.354+0000 7f9cda400640 1 --2- 172.21.15.5:0/3912101112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd4158b10 0x7f9cd4151560 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000ea20 tx=0x7f9cc00090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.354+0000 7f9cda400640 1 -- 172.21.15.5:0/3912101112 shutdown_connections 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.354+0000 7f9cda400640 1 --2- 172.21.15.5:0/3912101112 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9cb4065180 0x7f9cb4067630 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.354+0000 7f9cda400640 1 --2- 172.21.15.5:0/3912101112 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cd4158ee0 0x7f9cd4154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.354+0000 7f9cda400640 1 --2- 172.21.15.5:0/3912101112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd4158b10 0x7f9cd4151560 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.354+0000 7f9cda400640 1 --2- 172.21.15.5:0/3912101112 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9cd40b25c0 0x7f9cd414e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.354+0000 7f9cda400640 1 -- 172.21.15.5:0/3912101112 >> 172.21.15.5:0/3912101112 conn(0x7f9cd4095a70 msgr2=0x7f9cd406bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.354+0000 7f9cda400640 1 -- 172.21.15.5:0/3912101112 shutdown_connections 2024-08-17T02:50:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.354+0000 7f9cda400640 1 -- 172.21.15.5:0/3912101112 wait complete. 2024-08-17T02:50:15.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:50:15.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.522+0000 7f617d800640 1 Processor -- start 2024-08-17T02:50:15.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.522+0000 7f617d800640 1 -- start start 2024-08-17T02:50:15.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.524+0000 7f617d800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f61780acf10 0x7f61780b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.524+0000 7f617d800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61780c92b0 con 0x7f61780afca0 2024-08-17T02:50:15.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.524+0000 7f617d800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61780ad480 con 0x7f61781590b0 2024-08-17T02:50:15.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.524+0000 7f617d800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61780b0980 con 0x7f61780acf10 2024-08-17T02:50:15.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.524+0000 7f6176a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f61780afca0 0x7f61781589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56760/0 (socket says 172.21.15.5:56760) 2024-08-17T02:50:15.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.524+0000 7f6176a00640 1 -- 172.21.15.5:0/2279076330 learned_addr learned my addr 172.21.15.5:0/2279076330 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:15.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.524+0000 7f6177400640 1 --2- 172.21.15.5:0/2279076330 >> v2:172.21.15.5:3300/0 conn(0x7f61780acf10 0x7f61780b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.524+0000 7f6177400640 1 -- 172.21.15.5:0/2279076330 >> v1:172.21.15.107:6789/0 conn(0x7f61781590b0 legacy=0x7f61780c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.524+0000 7f6175600640 1 -- 172.21.15.5:0/2279076330 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220121893 0 0) 0x7f61780c92b0 con 0x7f61780afca0 2024-08-17T02:50:15.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.524+0000 7f6177400640 1 -- 172.21.15.5:0/2279076330 >> v1:172.21.15.5:6789/0 conn(0x7f61780afca0 legacy=0x7f61781589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.524+0000 7f6177400640 1 -- 172.21.15.5:0/2279076330 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61780ad760 con 0x7f61780acf10 2024-08-17T02:50:15.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.525+0000 7f6177400640 1 --2- 172.21.15.5:0/2279076330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61780acf10 0x7f61780b0070 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6170009e60 tx=0x7f6170009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89e0c27fdeb6a3f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.526+0000 7f6175600640 1 -- 172.21.15.5:0/2279076330 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170007550 con 0x7f61780acf10 2024-08-17T02:50:15.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.526+0000 7f6175600640 1 -- 172.21.15.5:0/2279076330 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617002d050 con 0x7f61780acf10 2024-08-17T02:50:15.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.526+0000 7f6175600640 1 -- 172.21.15.5:0/2279076330 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170007900 con 0x7f61780acf10 2024-08-17T02:50:15.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.526+0000 7f617d800640 1 -- 172.21.15.5:0/2279076330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61780acf10 msgr2=0x7f61780b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.526+0000 7f617d800640 1 --2- 172.21.15.5:0/2279076330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61780acf10 0x7f61780b0070 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6170009e60 tx=0x7f6170009780 comp rx=0 tx=0).stop 2024-08-17T02:50:15.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.526+0000 7f617d800640 1 -- 172.21.15.5:0/2279076330 shutdown_connections 2024-08-17T02:50:15.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.526+0000 7f617d800640 1 --2- 172.21.15.5:0/2279076330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61780acf10 0x7f61780b0070 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.526+0000 7f617d800640 1 -- 172.21.15.5:0/2279076330 >> 172.21.15.5:0/2279076330 conn(0x7f6178066e60 msgr2=0x7f6178067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:15.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.526+0000 7f617d800640 1 -- 172.21.15.5:0/2279076330 shutdown_connections 2024-08-17T02:50:15.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.526+0000 7f617d800640 1 -- 172.21.15.5:0/2279076330 wait complete. 2024-08-17T02:50:15.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.528+0000 7f617d800640 1 Processor -- start 2024-08-17T02:50:15.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.528+0000 7f617d800640 1 -- start start 2024-08-17T02:50:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.528+0000 7f617d800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61780acf10 0x7f6178165f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.529+0000 7f617d800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61780afca0 0x7f6178150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.529+0000 7f617d800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61781590b0 0x7f61780c1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.529+0000 7f617d800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61780c2180 con 0x7f61780afca0 2024-08-17T02:50:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.529+0000 7f617d800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6178156e20 con 0x7f61780acf10 2024-08-17T02:50:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.529+0000 7f617d800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61781566f0 con 0x7f61781590b0 2024-08-17T02:50:15.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.529+0000 7f6176000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61780afca0 0x7f6178150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.529+0000 7f6176000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61780afca0 0x7f6178150ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58450/0 (socket says 172.21.15.5:58450) 2024-08-17T02:50:15.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.529+0000 7f6176000640 1 -- 172.21.15.5:0/698072476 learned_addr learned my addr 172.21.15.5:0/698072476 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:15.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.529+0000 7f6176000640 1 -- 172.21.15.5:0/698072476 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61781590b0 msgr2=0x7f61780c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.529+0000 7f6176000640 1 --2- 172.21.15.5:0/698072476 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61781590b0 0x7f61780c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.529+0000 7f6176000640 1 -- 172.21.15.5:0/698072476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61780acf10 msgr2=0x7f6178165f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.529+0000 7f6176000640 1 --2- 172.21.15.5:0/698072476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61780acf10 0x7f6178165f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.529+0000 7f6176000640 1 -- 172.21.15.5:0/698072476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6170009a20 con 0x7f61780afca0 2024-08-17T02:50:15.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.529+0000 7f6176000640 1 --2- 172.21.15.5:0/698072476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61780afca0 0x7f6178150ea0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f616400c490 tx=0x7f6164007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.530+0000 7f616e000640 1 -- 172.21.15.5:0/698072476 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164011590 con 0x7f61780afca0 2024-08-17T02:50:15.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.530+0000 7f616e000640 1 -- 172.21.15.5:0/698072476 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6164011710 con 0x7f61780afca0 2024-08-17T02:50:15.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.530+0000 7f616e000640 1 -- 172.21.15.5:0/698072476 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164011b10 con 0x7f61780afca0 2024-08-17T02:50:15.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.530+0000 7f617d800640 1 -- 172.21.15.5:0/698072476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61780c1bc0 con 0x7f61780afca0 2024-08-17T02:50:15.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.530+0000 7f617d800640 1 -- 172.21.15.5:0/698072476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6178156ab0 con 0x7f61780afca0 2024-08-17T02:50:15.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.531+0000 7f617d800640 1 -- 172.21.15.5:0/698072476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61780acd70 con 0x7f61780afca0 2024-08-17T02:50:15.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.532+0000 7f616e000640 1 -- 172.21.15.5:0/698072476 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f616401b3b0 con 0x7f61780afca0 2024-08-17T02:50:15.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.533+0000 7f616e000640 1 --2- 172.21.15.5:0/698072476 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6158065180 0x7f6158067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.533+0000 7f616e000640 1 -- 172.21.15.5:0/698072476 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f61640818e0 con 0x7f61780afca0 2024-08-17T02:50:15.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.533+0000 7f6176a00640 1 --2- 172.21.15.5:0/698072476 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6158065180 0x7f6158067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.534+0000 7f6176a00640 1 --2- 172.21.15.5:0/698072476 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6158065180 0x7f6158067630 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f61680011e0 tx=0x7f6168007940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.537+0000 7f616e000640 1 -- 172.21.15.5:0/698072476 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f61780acd70 con 0x7f61780afca0 2024-08-17T02:50:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.723+0000 7f617d800640 1 -- 172.21.15.5:0/698072476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61780acd70 con 0x7f61780afca0 2024-08-17T02:50:15.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.724+0000 7f616e000640 1 -- 172.21.15.5:0/698072476 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15460 (secure 0 0 0) 0x7f61780acd70 con 0x7f61780afca0 2024-08-17T02:50:15.725 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:15.725 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:50:13.454281+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000724543.meta","create_time":"2024-08-17T02:48:00.937205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000724543"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000724543.data","create_time":"2024-08-17T02:48:01.789476+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000724543"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6836/723455700":"2024-08-18T02:50:10.445560+0000","172.21.15.5:6834/723455700":"2024-08-18T02:50:10.445560+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:50:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.726+0000 7f617d800640 1 -- 172.21.15.5:0/698072476 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6158065180 msgr2=0x7f6158067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.726+0000 7f617d800640 1 --2- 172.21.15.5:0/698072476 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6158065180 0x7f6158067630 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f61680011e0 tx=0x7f6168007940 comp rx=0 tx=0).stop 2024-08-17T02:50:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.726+0000 7f617d800640 1 -- 172.21.15.5:0/698072476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61780afca0 msgr2=0x7f6178150ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.726+0000 7f617d800640 1 --2- 172.21.15.5:0/698072476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61780afca0 0x7f6178150ea0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f616400c490 tx=0x7f6164007ec0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.726+0000 7f617d800640 1 -- 172.21.15.5:0/698072476 shutdown_connections 2024-08-17T02:50:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.726+0000 7f617d800640 1 --2- 172.21.15.5:0/698072476 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6158065180 0x7f6158067630 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.726+0000 7f617d800640 1 --2- 172.21.15.5:0/698072476 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61781590b0 0x7f61780c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.726+0000 7f617d800640 1 --2- 172.21.15.5:0/698072476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61780afca0 0x7f6178150ea0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.726+0000 7f617d800640 1 --2- 172.21.15.5:0/698072476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61780acf10 0x7f6178165f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.726+0000 7f617d800640 1 -- 172.21.15.5:0/698072476 >> 172.21.15.5:0/698072476 conn(0x7f6178066e60 msgr2=0x7f61780699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.726+0000 7f617d800640 1 -- 172.21.15.5:0/698072476 shutdown_connections 2024-08-17T02:50:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.726+0000 7f617d800640 1 -- 172.21.15.5:0/698072476 wait complete. 2024-08-17T02:50:15.743 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000724543 and related pools 2024-08-17T02:50:15.743 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:50:15.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.894+0000 7f61ebc00640 1 Processor -- start 2024-08-17T02:50:15.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.894+0000 7f61ebc00640 1 -- start start 2024-08-17T02:50:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.895+0000 7f61ebc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61e40ca050 0x7f61e4156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.895+0000 7f61ebc00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e40cb160 con 0x7f61e40add30 2024-08-17T02:50:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.896+0000 7f61ebc00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e40b0d10 con 0x7f61e40ad960 2024-08-17T02:50:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.896+0000 7f61ebc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40ca550 con 0x7f61e40ca050 2024-08-17T02:50:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.896+0000 7f61e9c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f61e40add30 0x7f61e40aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51326/0 (socket says 172.21.15.5:51326) 2024-08-17T02:50:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.896+0000 7f61e9c00640 1 -- 172.21.15.5:0/2184219969 learned_addr learned my addr 172.21.15.5:0/2184219969 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:15.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.896+0000 7f61dbe00640 1 --2- 172.21.15.5:0/2184219969 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61e40ca050 0x7f61e4156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.896+0000 7f61e3e00640 1 -- 172.21.15.5:0/2184219969 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484731337 0 0) 0x7f61e40cb160 con 0x7f61e40add30 2024-08-17T02:50:15.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.896+0000 7f61e3e00640 1 -- 172.21.15.5:0/2184219969 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c80034e0 con 0x7f61e40add30 2024-08-17T02:50:15.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.897+0000 7f61e3e00640 1 -- 172.21.15.5:0/2184219969 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946939820 0 0) 0x7f61e40b0d10 con 0x7f61e40ad960 2024-08-17T02:50:15.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.897+0000 7f61e3e00640 1 -- 172.21.15.5:0/2184219969 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e40cb160 con 0x7f61e40ad960 2024-08-17T02:50:15.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.897+0000 7f61e3e00640 1 -- 172.21.15.5:0/2184219969 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 125525268 0 0) 0x7f61c80034e0 con 0x7f61e40add30 2024-08-17T02:50:15.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.897+0000 7f61dbe00640 1 -- 172.21.15.5:0/2184219969 >> v1:172.21.15.107:6789/0 conn(0x7f61e40ad960 legacy=0x7f61e4156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.897+0000 7f61dbe00640 1 -- 172.21.15.5:0/2184219969 >> v1:172.21.15.5:6789/0 conn(0x7f61e40add30 legacy=0x7f61e40aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.897+0000 7f61dbe00640 1 -- 172.21.15.5:0/2184219969 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e40ca830 con 0x7f61e40ca050 2024-08-17T02:50:15.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.898+0000 7f61dbe00640 1 --2- 172.21.15.5:0/2184219969 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61e40ca050 0x7f61e4156b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009880 tx=0x7f61cc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e550f2083543cbab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.898+0000 7f61e3e00640 1 -- 172.21.15.5:0/2184219969 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc0017f0 con 0x7f61e40ca050 2024-08-17T02:50:15.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.898+0000 7f61e3e00640 1 -- 172.21.15.5:0/2184219969 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc02ab50 con 0x7f61e40ca050 2024-08-17T02:50:15.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.898+0000 7f61e3e00640 1 -- 172.21.15.5:0/2184219969 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc032440 con 0x7f61e40ca050 2024-08-17T02:50:15.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.899+0000 7f61ebc00640 1 -- 172.21.15.5:0/2184219969 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61e40ca050 msgr2=0x7f61e4156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.899+0000 7f61ebc00640 1 --2- 172.21.15.5:0/2184219969 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61e40ca050 0x7f61e4156b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009880 tx=0x7f61cc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.899+0000 7f61ebc00640 1 -- 172.21.15.5:0/2184219969 shutdown_connections 2024-08-17T02:50:15.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.899+0000 7f61ebc00640 1 --2- 172.21.15.5:0/2184219969 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61e40ca050 0x7f61e4156b30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.899+0000 7f61ebc00640 1 -- 172.21.15.5:0/2184219969 >> 172.21.15.5:0/2184219969 conn(0x7f61e4066e60 msgr2=0x7f61e4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:15.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.899+0000 7f61ebc00640 1 -- 172.21.15.5:0/2184219969 shutdown_connections 2024-08-17T02:50:15.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.899+0000 7f61ebc00640 1 -- 172.21.15.5:0/2184219969 wait complete. 2024-08-17T02:50:15.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.900+0000 7f61ebc00640 1 Processor -- start 2024-08-17T02:50:15.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.900+0000 7f61ebc00640 1 -- start start 2024-08-17T02:50:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.901+0000 7f61ebc00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61e40ad960 0x7f61e40c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.901+0000 7f61ebc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e40add30 0x7f61e40a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.901+0000 7f61ebc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61e40ca050 0x7f61e40ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.901+0000 7f61ebc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40ab290 con 0x7f61e40ca050 2024-08-17T02:50:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.901+0000 7f61ebc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40aa710 con 0x7f61e40add30 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.901+0000 7f61ebc00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e40aa9f0 con 0x7f61e40ad960 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.901+0000 7f61e9c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61e40ca050 0x7f61e40ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.901+0000 7f61e9c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61e40ca050 0x7f61e40ac490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36502/0 (socket says 172.21.15.5:36502) 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.901+0000 7f61e9c00640 1 -- 172.21.15.5:0/1857610442 learned_addr learned my addr 172.21.15.5:0/1857610442 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.902+0000 7f61dbe00640 1 --2- 172.21.15.5:0/1857610442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e40add30 0x7f61e40a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.902+0000 7f61e9200640 1 --2- 172.21.15.5:0/1857610442 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61e40ad960 0x7f61e40c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.902+0000 7f61e9c00640 1 -- 172.21.15.5:0/1857610442 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61e40ad960 msgr2=0x7f61e40c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.902+0000 7f61e9c00640 1 --2- 172.21.15.5:0/1857610442 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61e40ad960 0x7f61e40c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.902+0000 7f61e9c00640 1 -- 172.21.15.5:0/1857610442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e40add30 msgr2=0x7f61e40a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.902+0000 7f61e9c00640 1 --2- 172.21.15.5:0/1857610442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e40add30 0x7f61e40a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.902+0000 7f61e9c00640 1 -- 172.21.15.5:0/1857610442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc009390 con 0x7f61e40ca050 2024-08-17T02:50:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.902+0000 7f61e9200640 1 --2- 172.21.15.5:0/1857610442 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61e40ad960 0x7f61e40c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:15.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.902+0000 7f61e9c00640 1 --2- 172.21.15.5:0/1857610442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61e40ca050 0x7f61e40ac490 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00cc70 tx=0x7f61dc007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.902+0000 7f61e0c00640 1 -- 172.21.15.5:0/1857610442 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc00ce90 con 0x7f61e40ca050 2024-08-17T02:50:15.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.903+0000 7f61e0c00640 1 -- 172.21.15.5:0/1857610442 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc004d30 con 0x7f61e40ca050 2024-08-17T02:50:15.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.903+0000 7f61e0c00640 1 -- 172.21.15.5:0/1857610442 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc004ea0 con 0x7f61e40ca050 2024-08-17T02:50:15.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.903+0000 7f61ebc00640 1 -- 172.21.15.5:0/1857610442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e40aacd0 con 0x7f61e40ca050 2024-08-17T02:50:15.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.903+0000 7f61ebc00640 1 -- 172.21.15.5:0/1857610442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e40a8ae0 con 0x7f61e40ca050 2024-08-17T02:50:15.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.904+0000 7f61ebc00640 1 -- 172.21.15.5:0/1857610442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e41571e0 con 0x7f61e40ca050 2024-08-17T02:50:15.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.904+0000 7f61e0c00640 1 -- 172.21.15.5:0/1857610442 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f61dc007150 con 0x7f61e40ca050 2024-08-17T02:50:15.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.906+0000 7f61e0c00640 1 --2- 172.21.15.5:0/1857610442 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f61c0065150 0x7f61c0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:15.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.906+0000 7f61e0c00640 1 -- 172.21.15.5:0/1857610442 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f61dc082160 con 0x7f61e40ca050 2024-08-17T02:50:15.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.906+0000 7f61e9200640 1 --2- 172.21.15.5:0/1857610442 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f61c0065150 0x7f61c0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:15.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.906+0000 7f61e9200640 1 --2- 172.21.15.5:0/1857610442 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f61c0065150 0x7f61c0067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f61d4003900 tx=0x7f61d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:15.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:15.910+0000 7f61e0c00640 1 -- 172.21.15.5:0/1857610442 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f61dc050230 con 0x7f61e40ca050 2024-08-17T02:50:16.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.129+0000 7f61ebc00640 1 -- 172.21.15.5:0/1857610442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61e4063fb0 con 0x7f61e40ca050 2024-08-17T02:50:16.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.129+0000 7f61e0c00640 1 -- 172.21.15.5:0/1857610442 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4615 (secure 0 0 0) 0x7f61dc053850 con 0x7f61e40ca050 2024-08-17T02:50:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:16.131 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2464391944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2464391944},{"type":"v1","addr":"172.21.15.107:6835","nonce":2464391944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2049823505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2049823505},{"type":"v1","addr":"172.21.15.107:6834","nonce":2049823505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/4240118786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4240118786},{"type":"v1","addr":"172.21.15.5:6836","nonce":4240118786}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:48:02.750931+0000","modified":"2024-08-17T02:48:04.145198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4691},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4691":{"gid":4691,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.5:6837/1768626934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1768626934},{"type":"v1","addr":"172.21.15.5:6837","nonce":1768626934}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000724543","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:50:16.131 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 21 2024-08-17T02:50:16.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.131+0000 7f61ebc00640 1 -- 172.21.15.5:0/1857610442 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f61c0065150 msgr2=0x7f61c0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.131+0000 7f61ebc00640 1 --2- 172.21.15.5:0/1857610442 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f61c0065150 0x7f61c0067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f61d4003900 tx=0x7f61d4009040 comp rx=0 tx=0).stop 2024-08-17T02:50:16.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.131+0000 7f61ebc00640 1 -- 172.21.15.5:0/1857610442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61e40ca050 msgr2=0x7f61e40ac490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.131+0000 7f61ebc00640 1 --2- 172.21.15.5:0/1857610442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61e40ca050 0x7f61e40ac490 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00cc70 tx=0x7f61dc007d80 comp rx=0 tx=0).stop 2024-08-17T02:50:16.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.131+0000 7f61ebc00640 1 -- 172.21.15.5:0/1857610442 shutdown_connections 2024-08-17T02:50:16.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.131+0000 7f61ebc00640 1 --2- 172.21.15.5:0/1857610442 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f61c0065150 0x7f61c0067600 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.131+0000 7f61ebc00640 1 --2- 172.21.15.5:0/1857610442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61e40ca050 0x7f61e40ac490 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.131+0000 7f61ebc00640 1 --2- 172.21.15.5:0/1857610442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e40add30 0x7f61e40a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.131+0000 7f61ebc00640 1 --2- 172.21.15.5:0/1857610442 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f61e40ad960 0x7f61e40c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.131+0000 7f61ebc00640 1 -- 172.21.15.5:0/1857610442 >> 172.21.15.5:0/1857610442 conn(0x7f61e4066e60 msgr2=0x7f61e4154bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:16.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.132+0000 7f61ebc00640 1 -- 172.21.15.5:0/1857610442 shutdown_connections 2024-08-17T02:50:16.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.132+0000 7f61ebc00640 1 -- 172.21.15.5:0/1857610442 wait complete. 2024-08-17T02:50:16.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:50:16.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.298+0000 7f8723800640 1 Processor -- start 2024-08-17T02:50:16.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.298+0000 7f8723800640 1 -- start start 2024-08-17T02:50:16.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.299+0000 7f8723800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f871c0ca050 0x7f871c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.299+0000 7f8723800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f871c0add30 0x7f871c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.299+0000 7f8723800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871c15b5e0 con 0x7f871c0ad960 2024-08-17T02:50:16.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.300+0000 7f8723800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871c0cb160 con 0x7f871c0add30 2024-08-17T02:50:16.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.300+0000 7f8723800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c0b0d10 con 0x7f871c0ca050 2024-08-17T02:50:16.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.300+0000 7f8721800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f871c0add30 0x7f871c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.300+0000 7f8721800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f871c0add30 0x7f871c15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36510/0 (socket says 172.21.15.5:36510) 2024-08-17T02:50:16.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.300+0000 7f8721800640 1 -- 172.21.15.5:0/3867710702 learned_addr learned my addr 172.21.15.5:0/3867710702 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:16.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.300+0000 7f871be00640 1 --2- 172.21.15.5:0/3867710702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f871c0ca050 0x7f871c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.300+0000 7f8721800640 1 -- 172.21.15.5:0/3867710702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f871c0ca050 msgr2=0x7f871c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:16.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.300+0000 7f8721800640 1 --2- 172.21.15.5:0/3867710702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f871c0ca050 0x7f871c156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.300+0000 7f8721800640 1 -- 172.21.15.5:0/3867710702 >> v1:172.21.15.107:6789/0 conn(0x7f871c0ad960 legacy=0x7f871c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.300+0000 7f8721800640 1 -- 172.21.15.5:0/3867710702 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c0ca550 con 0x7f871c0add30 2024-08-17T02:50:16.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.300+0000 7f871be00640 1 --2- 172.21.15.5:0/3867710702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f871c0ca050 0x7f871c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:16.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.301+0000 7f8721800640 1 --2- 172.21.15.5:0/3867710702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f871c0add30 0x7f871c15b0a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8714009f20 tx=0x7f8714009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d434493a18a50ec server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.302+0000 7f871b400640 1 -- 172.21.15.5:0/3867710702 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714032450 con 0x7f871c0add30 2024-08-17T02:50:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.302+0000 7f871b400640 1 -- 172.21.15.5:0/3867710702 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87140325b0 con 0x7f871c0add30 2024-08-17T02:50:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.302+0000 7f871b400640 1 -- 172.21.15.5:0/3867710702 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714032990 con 0x7f871c0add30 2024-08-17T02:50:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.302+0000 7f8723800640 1 -- 172.21.15.5:0/3867710702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f871c0add30 msgr2=0x7f871c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.302+0000 7f8723800640 1 --2- 172.21.15.5:0/3867710702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f871c0add30 0x7f871c15b0a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8714009f20 tx=0x7f8714009840 comp rx=0 tx=0).stop 2024-08-17T02:50:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.302+0000 7f8723800640 1 -- 172.21.15.5:0/3867710702 shutdown_connections 2024-08-17T02:50:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.302+0000 7f8723800640 1 --2- 172.21.15.5:0/3867710702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f871c0add30 0x7f871c15b0a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.302+0000 7f8723800640 1 --2- 172.21.15.5:0/3867710702 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f871c0ca050 0x7f871c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.302+0000 7f8723800640 1 -- 172.21.15.5:0/3867710702 >> 172.21.15.5:0/3867710702 conn(0x7f871c066e60 msgr2=0x7f871c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.302+0000 7f8723800640 1 -- 172.21.15.5:0/3867710702 shutdown_connections 2024-08-17T02:50:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.302+0000 7f8723800640 1 -- 172.21.15.5:0/3867710702 wait complete. 2024-08-17T02:50:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.304+0000 7f8723800640 1 Processor -- start 2024-08-17T02:50:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.304+0000 7f8723800640 1 -- start start 2024-08-17T02:50:16.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.305+0000 7f8723800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f871c0ad960 0x7f871c157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.305+0000 7f8723800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f871c0add30 0x7f871c14b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.305+0000 7f8723800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f871c0ca050 0x7f871c159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.305+0000 7f8723800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c14ba40 con 0x7f871c0ca050 2024-08-17T02:50:16.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.305+0000 7f8723800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c157ca0 con 0x7f871c0ad960 2024-08-17T02:50:16.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.305+0000 7f8723800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c14c220 con 0x7f871c0add30 2024-08-17T02:50:16.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.305+0000 7f8721800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f871c0ca050 0x7f871c159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.305+0000 7f8721800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f871c0ca050 0x7f871c159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36518/0 (socket says 172.21.15.5:36518) 2024-08-17T02:50:16.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.305+0000 7f8721800640 1 -- 172.21.15.5:0/2259588719 learned_addr learned my addr 172.21.15.5:0/2259588719 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:16.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.305+0000 7f8720e00640 1 --2- 172.21.15.5:0/2259588719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f871c0ad960 0x7f871c157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.305+0000 7f8721800640 1 -- 172.21.15.5:0/2259588719 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f871c0add30 msgr2=0x7f871c14b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.305+0000 7f8721800640 1 --2- 172.21.15.5:0/2259588719 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f871c0add30 0x7f871c14b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.305+0000 7f8721800640 1 -- 172.21.15.5:0/2259588719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f871c0ad960 msgr2=0x7f871c157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.305+0000 7f8721800640 1 --2- 172.21.15.5:0/2259588719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f871c0ad960 0x7f871c157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.305+0000 7f8721800640 1 -- 172.21.15.5:0/2259588719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8714009ae0 con 0x7f871c0ca050 2024-08-17T02:50:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.306+0000 7f8721800640 1 --2- 172.21.15.5:0/2259588719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f871c0ca050 0x7f871c159e30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8714009f80 tx=0x7f8714037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.306+0000 7f870fe00640 1 -- 172.21.15.5:0/2259588719 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714032450 con 0x7f871c0ca050 2024-08-17T02:50:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.306+0000 7f870fe00640 1 -- 172.21.15.5:0/2259588719 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8714007170 con 0x7f871c0ca050 2024-08-17T02:50:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.306+0000 7f870fe00640 1 -- 172.21.15.5:0/2259588719 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871403c640 con 0x7f871c0ca050 2024-08-17T02:50:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.306+0000 7f8723800640 1 -- 172.21.15.5:0/2259588719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871c1576e0 con 0x7f871c0ca050 2024-08-17T02:50:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.306+0000 7f8723800640 1 -- 172.21.15.5:0/2259588719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871c14beb0 con 0x7f871c0ca050 2024-08-17T02:50:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.307+0000 7f8723800640 1 -- 172.21.15.5:0/2259588719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871c063fb0 con 0x7f871c0ca050 2024-08-17T02:50:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.308+0000 7f870fe00640 1 -- 172.21.15.5:0/2259588719 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8714039050 con 0x7f871c0ca050 2024-08-17T02:50:16.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.309+0000 7f870fe00640 1 --2- 172.21.15.5:0/2259588719 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f86fc065150 0x7f86fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.310+0000 7f870fe00640 1 -- 172.21.15.5:0/2259588719 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f871402e050 con 0x7f871c0ca050 2024-08-17T02:50:16.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.310+0000 7f8720e00640 1 --2- 172.21.15.5:0/2259588719 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f86fc065150 0x7f86fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.310+0000 7f8720e00640 1 --2- 172.21.15.5:0/2259588719 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f86fc065150 0x7f86fc067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8710007fd0 tx=0x7f8710007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.313+0000 7f870fe00640 1 -- 172.21.15.5:0/2259588719 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8714071450 con 0x7f871c0ca050 2024-08-17T02:50:16.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.534+0000 7f8723800640 1 -- 172.21.15.5:0/2259588719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f871c14c360 con 0x7f871c0ca050 2024-08-17T02:50:16.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.535+0000 7f870fe00640 1 -- 172.21.15.5:0/2259588719 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4615 (secure 0 0 0) 0x7f8714074a70 con 0x7f871c0ca050 2024-08-17T02:50:16.536 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:16.537 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2464391944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2464391944},{"type":"v1","addr":"172.21.15.107:6835","nonce":2464391944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2049823505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2049823505},{"type":"v1","addr":"172.21.15.107:6834","nonce":2049823505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/4240118786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4240118786},{"type":"v1","addr":"172.21.15.5:6836","nonce":4240118786}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:48:02.750931+0000","modified":"2024-08-17T02:48:04.145198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4691},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4691":{"gid":4691,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.5:6837/1768626934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":1768626934},{"type":"v1","addr":"172.21.15.5:6837","nonce":1768626934}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000724543","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:50:16.537 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 21 2024-08-17T02:50:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.537+0000 7f8723800640 1 -- 172.21.15.5:0/2259588719 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f86fc065150 msgr2=0x7f86fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.538+0000 7f8723800640 1 --2- 172.21.15.5:0/2259588719 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f86fc065150 0x7f86fc067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8710007fd0 tx=0x7f8710007e30 comp rx=0 tx=0).stop 2024-08-17T02:50:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.538+0000 7f8723800640 1 -- 172.21.15.5:0/2259588719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f871c0ca050 msgr2=0x7f871c159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.538+0000 7f8723800640 1 --2- 172.21.15.5:0/2259588719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f871c0ca050 0x7f871c159e30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8714009f80 tx=0x7f8714037000 comp rx=0 tx=0).stop 2024-08-17T02:50:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.538+0000 7f8723800640 1 -- 172.21.15.5:0/2259588719 shutdown_connections 2024-08-17T02:50:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.538+0000 7f8723800640 1 --2- 172.21.15.5:0/2259588719 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f86fc065150 0x7f86fc067600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.538+0000 7f8723800640 1 --2- 172.21.15.5:0/2259588719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f871c0ca050 0x7f871c159e30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.538+0000 7f8723800640 1 --2- 172.21.15.5:0/2259588719 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f871c0add30 0x7f871c14b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.538+0000 7f8723800640 1 --2- 172.21.15.5:0/2259588719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f871c0ad960 0x7f871c157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.538+0000 7f8723800640 1 -- 172.21.15.5:0/2259588719 >> 172.21.15.5:0/2259588719 conn(0x7f871c066e60 msgr2=0x7f871c153fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.538+0000 7f8723800640 1 -- 172.21.15.5:0/2259588719 shutdown_connections 2024-08-17T02:50:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.538+0000 7f8723800640 1 -- 172.21.15.5:0/2259588719 wait complete. 2024-08-17T02:50:16.555 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:50:16.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.704+0000 7f898b400640 1 Processor -- start 2024-08-17T02:50:16.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.704+0000 7f898b400640 1 -- start start 2024-08-17T02:50:16.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.705+0000 7f898b400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f89840ad960 0x7f898415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.705+0000 7f898b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89840ca050 0x7f8984156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.705+0000 7f898b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89840add30 0x7f8984156960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.705+0000 7f898b400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898415b5e0 con 0x7f89840add30 2024-08-17T02:50:16.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.705+0000 7f898b400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89840cb160 con 0x7f89840ad960 2024-08-17T02:50:16.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.705+0000 7f898b400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89840b0d10 con 0x7f89840ca050 2024-08-17T02:50:16.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.706+0000 7f8989400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89840add30 0x7f8984156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.706+0000 7f8989400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89840add30 0x7f8984156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36520/0 (socket says 172.21.15.5:36520) 2024-08-17T02:50:16.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.706+0000 7f8989400640 1 -- 172.21.15.5:0/2803643230 learned_addr learned my addr 172.21.15.5:0/2803643230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:16.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.706+0000 7f8989400640 1 -- 172.21.15.5:0/2803643230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89840ca050 msgr2=0x7f8984156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:16.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.706+0000 7f8989400640 1 --2- 172.21.15.5:0/2803643230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89840ca050 0x7f8984156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.706+0000 7f8989400640 1 -- 172.21.15.5:0/2803643230 >> v2:172.21.15.107:3300/0 conn(0x7f89840ad960 msgr2=0x7f898415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:16.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.706+0000 7f8988a00640 1 --2- 172.21.15.5:0/2803643230 >> v2:172.21.15.107:3300/0 conn(0x7f89840ad960 0x7f898415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.706+0000 7f8989400640 1 --2- 172.21.15.5:0/2803643230 >> v2:172.21.15.107:3300/0 conn(0x7f89840ad960 0x7f898415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.706+0000 7f8989400640 1 -- 172.21.15.5:0/2803643230 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89840ca550 con 0x7f89840add30 2024-08-17T02:50:16.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.706+0000 7f8988a00640 1 --2- 172.21.15.5:0/2803643230 >> v2:172.21.15.107:3300/0 conn(0x7f89840ad960 0x7f898415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:16.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.707+0000 7f8989400640 1 --2- 172.21.15.5:0/2803643230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89840add30 0x7f8984156960 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f89840cc910 tx=0x7f897c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3ee7f85ae5a325 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.707+0000 7f8983400640 1 -- 172.21.15.5:0/2803643230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c031400 con 0x7f89840add30 2024-08-17T02:50:16.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.707+0000 7f8983400640 1 -- 172.21.15.5:0/2803643230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897c02d050 con 0x7f89840add30 2024-08-17T02:50:16.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.707+0000 7f8983400640 1 -- 172.21.15.5:0/2803643230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c0317d0 con 0x7f89840add30 2024-08-17T02:50:16.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.708+0000 7f898b400640 1 -- 172.21.15.5:0/2803643230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89840add30 msgr2=0x7f8984156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.708+0000 7f898b400640 1 --2- 172.21.15.5:0/2803643230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89840add30 0x7f8984156960 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f89840cc910 tx=0x7f897c009840 comp rx=0 tx=0).stop 2024-08-17T02:50:16.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.708+0000 7f898b400640 1 -- 172.21.15.5:0/2803643230 shutdown_connections 2024-08-17T02:50:16.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.708+0000 7f898b400640 1 --2- 172.21.15.5:0/2803643230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89840add30 0x7f8984156960 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.708+0000 7f898b400640 1 --2- 172.21.15.5:0/2803643230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89840ca050 0x7f8984156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.708+0000 7f898b400640 1 --2- 172.21.15.5:0/2803643230 >> v2:172.21.15.107:3300/0 conn(0x7f89840ad960 0x7f898415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.708+0000 7f898b400640 1 -- 172.21.15.5:0/2803643230 >> 172.21.15.5:0/2803643230 conn(0x7f8984066e60 msgr2=0x7f8984067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:16.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.708+0000 7f898b400640 1 -- 172.21.15.5:0/2803643230 shutdown_connections 2024-08-17T02:50:16.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.708+0000 7f898b400640 1 -- 172.21.15.5:0/2803643230 wait complete. 2024-08-17T02:50:16.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.709+0000 7f898b400640 1 Processor -- start 2024-08-17T02:50:16.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.709+0000 7f898b400640 1 -- start start 2024-08-17T02:50:16.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.710+0000 7f898b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89840ad960 0x7f898413f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.710+0000 7f898b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89840add30 0x7f89840a7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.710+0000 7f898b400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89840ca050 0x7f89840a7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.710+0000 7f898b400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898413fce0 con 0x7f89840add30 2024-08-17T02:50:16.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.710+0000 7f898b400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8984158a70 con 0x7f89840ad960 2024-08-17T02:50:16.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.710+0000 7f898b400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89840a92f0 con 0x7f89840ca050 2024-08-17T02:50:16.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.711+0000 7f8983e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89840add30 0x7f89840a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.711+0000 7f8983e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89840add30 0x7f89840a7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36530/0 (socket says 172.21.15.5:36530) 2024-08-17T02:50:16.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.711+0000 7f8983e00640 1 -- 172.21.15.5:0/1744648159 learned_addr learned my addr 172.21.15.5:0/1744648159 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:16.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.711+0000 7f8988a00640 1 --2- 172.21.15.5:0/1744648159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89840ad960 0x7f898413f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.711+0000 7f8989400640 1 --2- 172.21.15.5:0/1744648159 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89840ca050 0x7f89840a7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.711+0000 7f8983e00640 1 -- 172.21.15.5:0/1744648159 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89840ca050 msgr2=0x7f89840a7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.711+0000 7f8983e00640 1 --2- 172.21.15.5:0/1744648159 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89840ca050 0x7f89840a7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.711+0000 7f8983e00640 1 -- 172.21.15.5:0/1744648159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89840ad960 msgr2=0x7f898413f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.711+0000 7f8983e00640 1 --2- 172.21.15.5:0/1744648159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89840ad960 0x7f898413f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.711+0000 7f8983e00640 1 -- 172.21.15.5:0/1744648159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c009ae0 con 0x7f89840add30 2024-08-17T02:50:16.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.711+0000 7f8983e00640 1 --2- 172.21.15.5:0/1744648159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89840add30 0x7f89840a7120 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f897000b600 tx=0x7f89700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.711+0000 7f8977e00640 1 -- 172.21.15.5:0/1744648159 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897000f5f0 con 0x7f89840add30 2024-08-17T02:50:16.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.712+0000 7f8977e00640 1 -- 172.21.15.5:0/1744648159 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897000f770 con 0x7f89840add30 2024-08-17T02:50:16.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.712+0000 7f8977e00640 1 -- 172.21.15.5:0/1744648159 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897000fb30 con 0x7f89840add30 2024-08-17T02:50:16.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.712+0000 7f898b400640 1 -- 172.21.15.5:0/1744648159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89840a95d0 con 0x7f89840add30 2024-08-17T02:50:16.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.712+0000 7f898b400640 1 -- 172.21.15.5:0/1744648159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89840a9b90 con 0x7f89840add30 2024-08-17T02:50:16.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.713+0000 7f898b400640 1 -- 172.21.15.5:0/1744648159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8984063fb0 con 0x7f89840add30 2024-08-17T02:50:16.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.714+0000 7f8977e00640 1 -- 172.21.15.5:0/1744648159 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8970010480 con 0x7f89840add30 2024-08-17T02:50:16.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.714+0000 7f8977e00640 1 --2- 172.21.15.5:0/1744648159 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8964065150 0x7f8964067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:16.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.715+0000 7f8977e00640 1 -- 172.21.15.5:0/1744648159 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f8970082430 con 0x7f89840add30 2024-08-17T02:50:16.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.715+0000 7f8988a00640 1 --2- 172.21.15.5:0/1744648159 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8964065150 0x7f8964067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:16.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.715+0000 7f8988a00640 1 --2- 172.21.15.5:0/1744648159 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8964065150 0x7f8964067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8978006fd0 tx=0x7f8978008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:16.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.718+0000 7f8977e00640 1 -- 172.21.15.5:0/1744648159 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8970050450 con 0x7f89840add30 2024-08-17T02:50:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.900+0000 7f898b400640 1 -- 172.21.15.5:0/1744648159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89841551c0 con 0x7f89840add30 2024-08-17T02:50:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.901+0000 7f8977e00640 1 -- 172.21.15.5:0/1744648159 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15460 (secure 0 0 0) 0x7f8970053a70 con 0x7f89840add30 2024-08-17T02:50:16.903 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:16.903 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:50:13.454281+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000724543.meta","create_time":"2024-08-17T02:48:00.937205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000724543"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000724543.data","create_time":"2024-08-17T02:48:01.789476+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000724543"}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6836/723455700":"2024-08-18T02:50:10.445560+0000","172.21.15.5:6834/723455700":"2024-08-18T02:50:10.445560+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:50:16.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.904+0000 7f898b400640 1 -- 172.21.15.5:0/1744648159 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8964065150 msgr2=0x7f8964067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.904+0000 7f898b400640 1 --2- 172.21.15.5:0/1744648159 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8964065150 0x7f8964067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8978006fd0 tx=0x7f8978008040 comp rx=0 tx=0).stop 2024-08-17T02:50:16.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.904+0000 7f898b400640 1 -- 172.21.15.5:0/1744648159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89840add30 msgr2=0x7f89840a7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:16.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.904+0000 7f898b400640 1 --2- 172.21.15.5:0/1744648159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89840add30 0x7f89840a7120 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f897000b600 tx=0x7f89700091a0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.904+0000 7f898b400640 1 -- 172.21.15.5:0/1744648159 shutdown_connections 2024-08-17T02:50:16.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.904+0000 7f898b400640 1 --2- 172.21.15.5:0/1744648159 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8964065150 0x7f8964067600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.904+0000 7f898b400640 1 --2- 172.21.15.5:0/1744648159 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f89840ca050 0x7f89840a7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.904+0000 7f898b400640 1 --2- 172.21.15.5:0/1744648159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89840add30 0x7f89840a7120 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.904+0000 7f898b400640 1 --2- 172.21.15.5:0/1744648159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89840ad960 0x7f898413f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:16.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.904+0000 7f898b400640 1 -- 172.21.15.5:0/1744648159 >> 172.21.15.5:0/1744648159 conn(0x7f8984066e60 msgr2=0x7f898406d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:16.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.904+0000 7f898b400640 1 -- 172.21.15.5:0/1744648159 shutdown_connections 2024-08-17T02:50:16.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:16.904+0000 7f898b400640 1 -- 172.21.15.5:0/1744648159 wait complete. 2024-08-17T02:50:16.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000724543 2024-08-17T02:50:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.071+0000 7fae37a00640 1 Processor -- start 2024-08-17T02:50:17.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.071+0000 7fae37a00640 1 -- start start 2024-08-17T02:50:17.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.073+0000 7fae37a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fae300afca0 0x7fae300b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.073+0000 7fae37a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae301590b0 0x7fae30159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.073+0000 7fae37a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3015a4e0 con 0x7fae300acf10 2024-08-17T02:50:17.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.073+0000 7fae37a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae300b0980 con 0x7fae301590b0 2024-08-17T02:50:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.073+0000 7fae37a00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae300c92b0 con 0x7fae300afca0 2024-08-17T02:50:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.073+0000 7fae35a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae301590b0 0x7fae30159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.073+0000 7fae35a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae301590b0 0x7fae30159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36546/0 (socket says 172.21.15.5:36546) 2024-08-17T02:50:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.073+0000 7fae2fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fae300acf10 0x7fae301589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51342/0 (socket says 172.21.15.5:51342) 2024-08-17T02:50:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.073+0000 7fae35a00640 1 -- 172.21.15.5:0/2094259906 learned_addr learned my addr 172.21.15.5:0/2094259906 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.073+0000 7fae35000640 1 --2- 172.21.15.5:0/2094259906 >> v2:172.21.15.107:3300/0 conn(0x7fae300afca0 0x7fae300b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.073+0000 7fae35a00640 1 -- 172.21.15.5:0/2094259906 >> v2:172.21.15.107:3300/0 conn(0x7fae300afca0 msgr2=0x7fae300b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.073+0000 7fae35a00640 1 --2- 172.21.15.5:0/2094259906 >> v2:172.21.15.107:3300/0 conn(0x7fae300afca0 0x7fae300b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.073+0000 7fae35a00640 1 -- 172.21.15.5:0/2094259906 >> v1:172.21.15.5:6789/0 conn(0x7fae300acf10 legacy=0x7fae301589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.073+0000 7fae35a00640 1 -- 172.21.15.5:0/2094259906 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae300ad480 con 0x7fae301590b0 2024-08-17T02:50:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.074+0000 7fae35a00640 1 --2- 172.21.15.5:0/2094259906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae301590b0 0x7fae30159fa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fae30067e40 tx=0x7fae28009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0243a3ad44d5bd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.075+0000 7fae2f400640 1 -- 172.21.15.5:0/2094259906 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28032400 con 0x7fae301590b0 2024-08-17T02:50:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.075+0000 7fae2f400640 1 -- 172.21.15.5:0/2094259906 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2802e050 con 0x7fae301590b0 2024-08-17T02:50:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.075+0000 7fae2f400640 1 -- 172.21.15.5:0/2094259906 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae280327f0 con 0x7fae301590b0 2024-08-17T02:50:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.075+0000 7fae37a00640 1 -- 172.21.15.5:0/2094259906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae301590b0 msgr2=0x7fae30159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.075+0000 7fae37a00640 1 --2- 172.21.15.5:0/2094259906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae301590b0 0x7fae30159fa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fae30067e40 tx=0x7fae28009840 comp rx=0 tx=0).stop 2024-08-17T02:50:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.075+0000 7fae37a00640 1 -- 172.21.15.5:0/2094259906 shutdown_connections 2024-08-17T02:50:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.075+0000 7fae37a00640 1 --2- 172.21.15.5:0/2094259906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae301590b0 0x7fae30159fa0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.075+0000 7fae37a00640 1 --2- 172.21.15.5:0/2094259906 >> v2:172.21.15.107:3300/0 conn(0x7fae300afca0 0x7fae300b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.075+0000 7fae37a00640 1 -- 172.21.15.5:0/2094259906 >> 172.21.15.5:0/2094259906 conn(0x7fae30066e60 msgr2=0x7fae30067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.075+0000 7fae37a00640 1 -- 172.21.15.5:0/2094259906 shutdown_connections 2024-08-17T02:50:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.075+0000 7fae37a00640 1 -- 172.21.15.5:0/2094259906 wait complete. 2024-08-17T02:50:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.077+0000 7fae37a00640 1 Processor -- start 2024-08-17T02:50:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.077+0000 7fae37a00640 1 -- start start 2024-08-17T02:50:17.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.078+0000 7fae37a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae300acf10 0x7fae3014f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.078+0000 7fae37a00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae300afca0 0x7fae3014cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.078+0000 7fae37a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae301590b0 0x7fae3014a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.078+0000 7fae37a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3014e090 con 0x7fae301590b0 2024-08-17T02:50:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.078+0000 7fae37a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3014d1d0 con 0x7fae300acf10 2024-08-17T02:50:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.078+0000 7fae37a00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3014d480 con 0x7fae300afca0 2024-08-17T02:50:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.078+0000 7fae35a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae301590b0 0x7fae3014a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.078+0000 7fae35a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae301590b0 0x7fae3014a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36556/0 (socket says 172.21.15.5:36556) 2024-08-17T02:50:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.078+0000 7fae35a00640 1 -- 172.21.15.5:0/1645947508 learned_addr learned my addr 172.21.15.5:0/1645947508 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.078+0000 7fae35000640 1 --2- 172.21.15.5:0/1645947508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae300acf10 0x7fae3014f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.078+0000 7fae2fe00640 1 --2- 172.21.15.5:0/1645947508 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae300afca0 0x7fae3014cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.079+0000 7fae35a00640 1 -- 172.21.15.5:0/1645947508 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae300afca0 msgr2=0x7fae3014cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.079+0000 7fae35a00640 1 --2- 172.21.15.5:0/1645947508 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae300afca0 0x7fae3014cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.079+0000 7fae35a00640 1 -- 172.21.15.5:0/1645947508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae300acf10 msgr2=0x7fae3014f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.079+0000 7fae35a00640 1 --2- 172.21.15.5:0/1645947508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae300acf10 0x7fae3014f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.079+0000 7fae35a00640 1 -- 172.21.15.5:0/1645947508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae28009ae0 con 0x7fae301590b0 2024-08-17T02:50:17.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.079+0000 7fae35a00640 1 --2- 172.21.15.5:0/1645947508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae301590b0 0x7fae3014a3f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fae28009880 tx=0x7fae28037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.079+0000 7fae23e00640 1 -- 172.21.15.5:0/1645947508 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae280078e0 con 0x7fae301590b0 2024-08-17T02:50:17.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.079+0000 7fae23e00640 1 -- 172.21.15.5:0/1645947508 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae28007a40 con 0x7fae301590b0 2024-08-17T02:50:17.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.079+0000 7fae23e00640 1 -- 172.21.15.5:0/1645947508 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28007e00 con 0x7fae301590b0 2024-08-17T02:50:17.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.079+0000 7fae37a00640 1 -- 172.21.15.5:0/1645947508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3014d760 con 0x7fae301590b0 2024-08-17T02:50:17.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.079+0000 7fae37a00640 1 -- 172.21.15.5:0/1645947508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3014dd20 con 0x7fae301590b0 2024-08-17T02:50:17.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.081+0000 7fae37a00640 1 -- 172.21.15.5:0/1645947508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3014e240 con 0x7fae301590b0 2024-08-17T02:50:17.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.081+0000 7fae23e00640 1 -- 172.21.15.5:0/1645947508 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fae28003040 con 0x7fae301590b0 2024-08-17T02:50:17.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.082+0000 7fae23e00640 1 --2- 172.21.15.5:0/1645947508 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fae10065150 0x7fae10067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.082+0000 7fae23e00640 1 -- 172.21.15.5:0/1645947508 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fae280a2a30 con 0x7fae301590b0 2024-08-17T02:50:17.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.082+0000 7fae35000640 1 --2- 172.21.15.5:0/1645947508 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fae10065150 0x7fae10067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.083+0000 7fae35000640 1 --2- 172.21.15.5:0/1645947508 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fae10065150 0x7fae10067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae24007ba0 tx=0x7fae24008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.086+0000 7fae23e00640 1 -- 172.21.15.5:0/1645947508 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fae3014e240 con 0x7fae301590b0 2024-08-17T02:50:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.311+0000 7fae37a00640 1 -- 172.21.15.5:0/1645947508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000724543"} v 0) v1 -- 0x7fae30063fb0 con 0x7fae301590b0 2024-08-17T02:50:17.313 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-17T02:50:17.312+0000 7f4dd2600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:50:17.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.317+0000 7fae23e00640 1 -- 172.21.15.5:0/1645947508 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000724543"}]=0 volume_0000000000724543 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 195+0+0 (secure 0 0 0) 0x7fae28070b20 con 0x7fae301590b0 2024-08-17T02:50:17.318 INFO:teuthology.orchestra.run.smithi005.stderr:volume_0000000000724543 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:50:17.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.319+0000 7fae37a00640 1 -- 172.21.15.5:0/1645947508 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fae10065150 msgr2=0x7fae10067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.319+0000 7fae37a00640 1 --2- 172.21.15.5:0/1645947508 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fae10065150 0x7fae10067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae24007ba0 tx=0x7fae24008040 comp rx=0 tx=0).stop 2024-08-17T02:50:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.319+0000 7fae37a00640 1 -- 172.21.15.5:0/1645947508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae301590b0 msgr2=0x7fae3014a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.319+0000 7fae37a00640 1 --2- 172.21.15.5:0/1645947508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae301590b0 0x7fae3014a3f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fae28009880 tx=0x7fae28037000 comp rx=0 tx=0).stop 2024-08-17T02:50:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.319+0000 7fae37a00640 1 -- 172.21.15.5:0/1645947508 shutdown_connections 2024-08-17T02:50:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.319+0000 7fae37a00640 1 --2- 172.21.15.5:0/1645947508 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fae10065150 0x7fae10067600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.319+0000 7fae37a00640 1 --2- 172.21.15.5:0/1645947508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae301590b0 0x7fae3014a3f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.319+0000 7fae37a00640 1 --2- 172.21.15.5:0/1645947508 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae300afca0 0x7fae3014cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.319+0000 7fae37a00640 1 --2- 172.21.15.5:0/1645947508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae300acf10 0x7fae3014f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.319+0000 7fae37a00640 1 -- 172.21.15.5:0/1645947508 >> 172.21.15.5:0/1645947508 conn(0x7fae30066e60 msgr2=0x7fae300caa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.319+0000 7fae37a00640 1 -- 172.21.15.5:0/1645947508 shutdown_connections 2024-08-17T02:50:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.320+0000 7fae37a00640 1 -- 172.21.15.5:0/1645947508 wait complete. 2024-08-17T02:50:17.337 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000724543 --yes-i-really-mean-it 2024-08-17T02:50:17.366 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-17T02:50:17.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.490+0000 7fe091200640 1 Processor -- start 2024-08-17T02:50:17.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.490+0000 7fe091200640 1 -- start start 2024-08-17T02:50:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.491+0000 7fe091200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe08c158bf0 0x7fe08c0a9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.492+0000 7fe091200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08c0a88e0 con 0x7fe08c0aa430 2024-08-17T02:50:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.492+0000 7fe091200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08c0a9180 con 0x7fe08c0aa880 2024-08-17T02:50:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.492+0000 7fe091200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c15a0e0 con 0x7fe08c158bf0 2024-08-17T02:50:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.492+0000 7fe083e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe08c0aa430 0x7fe08c15a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51350/0 (socket says 172.21.15.5:51350) 2024-08-17T02:50:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.492+0000 7fe083e00640 1 -- 172.21.15.5:0/2996150824 learned_addr learned my addr 172.21.15.5:0/2996150824 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.492+0000 7fe089e00640 1 --2- 172.21.15.5:0/2996150824 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe08c158bf0 0x7fe08c0a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.492+0000 7fe089400640 1 -- 172.21.15.5:0/2996150824 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048000031 0 0) 0x7fe08c0a88e0 con 0x7fe08c0aa430 2024-08-17T02:50:17.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.492+0000 7fe089400640 1 -- 172.21.15.5:0/2996150824 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0700034e0 con 0x7fe08c0aa430 2024-08-17T02:50:17.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.492+0000 7fe089400640 1 -- 172.21.15.5:0/2996150824 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595618979 0 0) 0x7fe08c0a9180 con 0x7fe08c0aa880 2024-08-17T02:50:17.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.492+0000 7fe089400640 1 -- 172.21.15.5:0/2996150824 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe08c0a88e0 con 0x7fe08c0aa880 2024-08-17T02:50:17.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.492+0000 7fe089e00640 1 -- 172.21.15.5:0/2996150824 >> v1:172.21.15.107:6789/0 conn(0x7fe08c0aa880 legacy=0x7fe08c15abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.492+0000 7fe089e00640 1 -- 172.21.15.5:0/2996150824 >> v1:172.21.15.5:6789/0 conn(0x7fe08c0aa430 legacy=0x7fe08c15a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.492+0000 7fe089e00640 1 -- 172.21.15.5:0/2996150824 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c0a8b30 con 0x7fe08c158bf0 2024-08-17T02:50:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.494+0000 7fe089e00640 1 --2- 172.21.15.5:0/2996150824 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe08c158bf0 0x7fe08c0a9610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009880 tx=0x7fe07c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d91250231e60ebd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.494+0000 7fe089400640 1 -- 172.21.15.5:0/2996150824 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c02ae10 con 0x7fe08c158bf0 2024-08-17T02:50:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.494+0000 7fe089400640 1 -- 172.21.15.5:0/2996150824 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c032440 con 0x7fe08c158bf0 2024-08-17T02:50:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.494+0000 7fe089400640 1 -- 172.21.15.5:0/2996150824 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0327e0 con 0x7fe08c158bf0 2024-08-17T02:50:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.494+0000 7fe091200640 1 -- 172.21.15.5:0/2996150824 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe08c158bf0 msgr2=0x7fe08c0a9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.494+0000 7fe091200640 1 --2- 172.21.15.5:0/2996150824 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe08c158bf0 0x7fe08c0a9610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009880 tx=0x7fe07c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.494+0000 7fe091200640 1 -- 172.21.15.5:0/2996150824 shutdown_connections 2024-08-17T02:50:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.494+0000 7fe091200640 1 --2- 172.21.15.5:0/2996150824 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe08c158bf0 0x7fe08c0a9610 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.494+0000 7fe091200640 1 -- 172.21.15.5:0/2996150824 >> 172.21.15.5:0/2996150824 conn(0x7fe08c066e60 msgr2=0x7fe08c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:17.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.495+0000 7fe091200640 1 -- 172.21.15.5:0/2996150824 shutdown_connections 2024-08-17T02:50:17.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.495+0000 7fe091200640 1 -- 172.21.15.5:0/2996150824 wait complete. 2024-08-17T02:50:17.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.496+0000 7fe091200640 1 Processor -- start 2024-08-17T02:50:17.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.496+0000 7fe091200640 1 -- start start 2024-08-17T02:50:17.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.497+0000 7fe091200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe08c0aa430 0x7fe08c13d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.497+0000 7fe091200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe08c0aa880 0x7fe08c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.497+0000 7fe091200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe08c158bf0 0x7fe08c0cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.497+0000 7fe091200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c13d780 con 0x7fe08c158bf0 2024-08-17T02:50:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.497+0000 7fe091200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c0cb820 con 0x7fe08c0aa430 2024-08-17T02:50:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.497+0000 7fe091200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c0acad0 con 0x7fe08c0aa880 2024-08-17T02:50:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.497+0000 7fe08a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe08c158bf0 0x7fe08c0cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.497+0000 7fe08a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe08c158bf0 0x7fe08c0cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36582/0 (socket says 172.21.15.5:36582) 2024-08-17T02:50:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.497+0000 7fe08a800640 1 -- 172.21.15.5:0/434271983 learned_addr learned my addr 172.21.15.5:0/434271983 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.497+0000 7fe083e00640 1 --2- 172.21.15.5:0/434271983 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe08c0aa880 0x7fe08c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.497+0000 7fe089e00640 1 --2- 172.21.15.5:0/434271983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe08c0aa430 0x7fe08c13d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.498+0000 7fe08a800640 1 -- 172.21.15.5:0/434271983 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe08c0aa880 msgr2=0x7fe08c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.498+0000 7fe08a800640 1 --2- 172.21.15.5:0/434271983 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe08c0aa880 0x7fe08c0ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.498+0000 7fe08a800640 1 -- 172.21.15.5:0/434271983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe08c0aa430 msgr2=0x7fe08c13d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.498+0000 7fe08a800640 1 --2- 172.21.15.5:0/434271983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe08c0aa430 0x7fe08c13d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.498+0000 7fe08a800640 1 -- 172.21.15.5:0/434271983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c009390 con 0x7fe08c158bf0 2024-08-17T02:50:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.498+0000 7fe08a800640 1 --2- 172.21.15.5:0/434271983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe08c158bf0 0x7fe08c0cac70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe08400c910 tx=0x7fe0840026f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.498+0000 7fe081600640 1 -- 172.21.15.5:0/434271983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08400cea0 con 0x7fe08c158bf0 2024-08-17T02:50:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.498+0000 7fe081600640 1 -- 172.21.15.5:0/434271983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08400a850 con 0x7fe08c158bf0 2024-08-17T02:50:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.498+0000 7fe081600640 1 -- 172.21.15.5:0/434271983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08400ac70 con 0x7fe08c158bf0 2024-08-17T02:50:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.498+0000 7fe091200640 1 -- 172.21.15.5:0/434271983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08c0cb260 con 0x7fe08c158bf0 2024-08-17T02:50:17.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.498+0000 7fe091200640 1 -- 172.21.15.5:0/434271983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08c0ac760 con 0x7fe08c158bf0 2024-08-17T02:50:17.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.500+0000 7fe091200640 1 -- 172.21.15.5:0/434271983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe08c0acc40 con 0x7fe08c158bf0 2024-08-17T02:50:17.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.500+0000 7fe081600640 1 -- 172.21.15.5:0/434271983 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe084012630 con 0x7fe08c158bf0 2024-08-17T02:50:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.501+0000 7fe081600640 1 --2- 172.21.15.5:0/434271983 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe068065150 0x7fe068067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.502+0000 7fe081600640 1 -- 172.21.15.5:0/434271983 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5923+0+0 (secure 0 0 0) 0x7fe0840827e0 con 0x7fe08c158bf0 2024-08-17T02:50:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.502+0000 7fe089e00640 1 --2- 172.21.15.5:0/434271983 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe068065150 0x7fe068067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.503+0000 7fe089e00640 1 --2- 172.21.15.5:0/434271983 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe068065150 0x7fe068067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe07c034000 tx=0x7fe07c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:17.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.505+0000 7fe081600640 1 -- 172.21.15.5:0/434271983 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe0840507d0 con 0x7fe08c158bf0 2024-08-17T02:50:17.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:17.724+0000 7fe091200640 1 -- 172.21.15.5:0/434271983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000724543", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe08c063fb0 con 0x7fe08c158bf0 2024-08-17T02:50:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.319+0000 7fe081600640 1 -- 172.21.15.5:0/434271983 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000724543", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 121+0+0 (secure 0 0 0) 0x7fe084053df0 con 0x7fe08c158bf0 2024-08-17T02:50:18.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.322+0000 7fe091200640 1 -- 172.21.15.5:0/434271983 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe068065150 msgr2=0x7fe068067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.322+0000 7fe091200640 1 --2- 172.21.15.5:0/434271983 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe068065150 0x7fe068067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe07c034000 tx=0x7fe07c032000 comp rx=0 tx=0).stop 2024-08-17T02:50:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.322+0000 7fe091200640 1 -- 172.21.15.5:0/434271983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe08c158bf0 msgr2=0x7fe08c0cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.322+0000 7fe091200640 1 --2- 172.21.15.5:0/434271983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe08c158bf0 0x7fe08c0cac70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe08400c910 tx=0x7fe0840026f0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.322+0000 7fe091200640 1 -- 172.21.15.5:0/434271983 shutdown_connections 2024-08-17T02:50:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.322+0000 7fe091200640 1 --2- 172.21.15.5:0/434271983 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fe068065150 0x7fe068067600 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.322+0000 7fe091200640 1 --2- 172.21.15.5:0/434271983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe08c158bf0 0x7fe08c0cac70 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.322+0000 7fe091200640 1 --2- 172.21.15.5:0/434271983 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe08c0aa880 0x7fe08c0ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.322+0000 7fe091200640 1 --2- 172.21.15.5:0/434271983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe08c0aa430 0x7fe08c13d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.322+0000 7fe091200640 1 -- 172.21.15.5:0/434271983 >> 172.21.15.5:0/434271983 conn(0x7fe08c066e60 msgr2=0x7fe08c156d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.322+0000 7fe091200640 1 -- 172.21.15.5:0/434271983 shutdown_connections 2024-08-17T02:50:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.322+0000 7fe091200640 1 -- 172.21.15.5:0/434271983 wait complete. 2024-08-17T02:50:18.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000724543.meta cephfs.volume_0000000000724543.meta --yes-i-really-really-mean-it 2024-08-17T02:50:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.542+0000 7fbcd7200640 1 Processor -- start 2024-08-17T02:50:18.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.542+0000 7fbcd7200640 1 -- start start 2024-08-17T02:50:18.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.543+0000 7fbcd7200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbcd00add70 0x7fbcd00ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.544+0000 7fbcd7200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd01582b0 con 0x7fbcd0156a90 2024-08-17T02:50:18.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.544+0000 7fbcd7200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd00ca110 con 0x7fbcd00aed30 2024-08-17T02:50:18.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.544+0000 7fbcd7200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd00c9f80 con 0x7fbcd00add70 2024-08-17T02:50:18.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.544+0000 7fbccfe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbcd0156a90 0x7fbcd00ad660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51362/0 (socket says 172.21.15.5:51362) 2024-08-17T02:50:18.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.544+0000 7fbccfe00640 1 -- 172.21.15.5:0/3823350144 learned_addr learned my addr 172.21.15.5:0/3823350144 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:18.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.544+0000 7fbcc7e00640 1 --2- 172.21.15.5:0/3823350144 >> v2:172.21.15.107:3300/0 conn(0x7fbcd00add70 0x7fbcd00ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.544+0000 7fbccf400640 1 -- 172.21.15.5:0/3823350144 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217241171 0 0) 0x7fbcd01582b0 con 0x7fbcd0156a90 2024-08-17T02:50:18.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.544+0000 7fbccf400640 1 -- 172.21.15.5:0/3823350144 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcb40034e0 con 0x7fbcd0156a90 2024-08-17T02:50:18.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbccf400640 1 -- 172.21.15.5:0/3823350144 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952370120 0 0) 0x7fbcd00ca110 con 0x7fbcd00aed30 2024-08-17T02:50:18.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbccf400640 1 -- 172.21.15.5:0/3823350144 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd01582b0 con 0x7fbcd00aed30 2024-08-17T02:50:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbccf400640 1 -- 172.21.15.5:0/3823350144 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1141852918 0 0) 0x7fbcb40034e0 con 0x7fbcd0156a90 2024-08-17T02:50:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbccf400640 1 -- 172.21.15.5:0/3823350144 >> v2:172.21.15.107:3300/0 conn(0x7fbcd00add70 msgr2=0x7fbcd00ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbccf400640 1 --2- 172.21.15.5:0/3823350144 >> v2:172.21.15.107:3300/0 conn(0x7fbcd00add70 0x7fbcd00ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbccf400640 1 -- 172.21.15.5:0/3823350144 >> v1:172.21.15.107:6789/0 conn(0x7fbcd00aed30 legacy=0x7fbcd00ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbccf400640 1 -- 172.21.15.5:0/3823350144 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd00af4b0 con 0x7fbcd0156a90 2024-08-17T02:50:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbccf400640 1 -- 172.21.15.5:0/3823350144 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7fbcc00013f0 con 0x7fbcd0156a90 2024-08-17T02:50:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbccf400640 1 -- 172.21.15.5:0/3823350144 >> v1:172.21.15.5:6789/0 conn(0x7fbcd0156a90 legacy=0x7fbcd00ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbccf400640 1 --2- 172.21.15.5:0/3823350144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbcb4003bb0 0x7fbcb4003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbccf400640 1 --2- 172.21.15.5:0/3823350144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb4004780 0x7fbcb4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbccf400640 1 --2- 172.21.15.5:0/3823350144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb4005180 0x7fbcb400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbccf400640 1 -- 172.21.15.5:0/3823350144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd00c9f80 con 0x7fbcb4004780 2024-08-17T02:50:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbccf400640 1 -- 172.21.15.5:0/3823350144 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb400c0a0 con 0x7fbcb4005180 2024-08-17T02:50:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbccf400640 1 -- 172.21.15.5:0/3823350144 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb400c230 con 0x7fbcb4003bb0 2024-08-17T02:50:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbcc7e00640 1 --2- 172.21.15.5:0/3823350144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb4004780 0x7fbcb4004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbcd5200640 1 --2- 172.21.15.5:0/3823350144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb4005180 0x7fbcb400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.545+0000 7fbccfe00640 1 --2- 172.21.15.5:0/3823350144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbcb4003bb0 0x7fbcb4003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.546+0000 7fbcc7e00640 1 -- 172.21.15.5:0/3823350144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbcb4003bb0 msgr2=0x7fbcb4003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:18.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.546+0000 7fbcc7e00640 1 --2- 172.21.15.5:0/3823350144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbcb4003bb0 0x7fbcb4003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.546+0000 7fbcc7e00640 1 -- 172.21.15.5:0/3823350144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb4005180 msgr2=0x7fbcb400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.546+0000 7fbcc7e00640 1 --2- 172.21.15.5:0/3823350144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb4005180 0x7fbcb400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.546+0000 7fbcc7e00640 1 -- 172.21.15.5:0/3823350144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb40034e0 con 0x7fbcb4004780 2024-08-17T02:50:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.546+0000 7fbccfe00640 1 --2- 172.21.15.5:0/3823350144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbcb4003bb0 0x7fbcb4003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.546+0000 7fbcd5200640 1 --2- 172.21.15.5:0/3823350144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb4005180 0x7fbcb400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.546+0000 7fbcd5200640 1 -- 172.21.15.5:0/3823350144 reap_dead start 2024-08-17T02:50:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.547+0000 7fbcc7e00640 1 --2- 172.21.15.5:0/3823350144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb4004780 0x7fbcb4004bf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8009ba0 tx=0x7fbcb80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fed18522dfbb229 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.547+0000 7fbccf400640 1 -- 172.21.15.5:0/3823350144 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8031400 con 0x7fbcb4004780 2024-08-17T02:50:18.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.547+0000 7fbccf400640 1 -- 172.21.15.5:0/3823350144 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb802d050 con 0x7fbcb4004780 2024-08-17T02:50:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.547+0000 7fbccf400640 1 -- 172.21.15.5:0/3823350144 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8031790 con 0x7fbcb4004780 2024-08-17T02:50:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.547+0000 7fbcd7200640 1 -- 172.21.15.5:0/3823350144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb4004780 msgr2=0x7fbcb4004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.547+0000 7fbcd7200640 1 --2- 172.21.15.5:0/3823350144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb4004780 0x7fbcb4004bf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8009ba0 tx=0x7fbcb80090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.547+0000 7fbcd7200640 1 -- 172.21.15.5:0/3823350144 shutdown_connections 2024-08-17T02:50:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.547+0000 7fbcd7200640 1 --2- 172.21.15.5:0/3823350144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb4004780 0x7fbcb4004bf0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.547+0000 7fbcd7200640 1 -- 172.21.15.5:0/3823350144 >> 172.21.15.5:0/3823350144 conn(0x7fbcd0066e60 msgr2=0x7fbcd0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.548+0000 7fbcd7200640 1 -- 172.21.15.5:0/3823350144 shutdown_connections 2024-08-17T02:50:18.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.548+0000 7fbcd7200640 1 -- 172.21.15.5:0/3823350144 wait complete. 2024-08-17T02:50:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.549+0000 7fbcd7200640 1 Processor -- start 2024-08-17T02:50:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.549+0000 7fbcd7200640 1 -- start start 2024-08-17T02:50:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.550+0000 7fbcd7200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb4004780 0x7fbcd00c1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.550+0000 7fbcd7200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbcd016a520 0x7fbcd0169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.550+0000 7fbcd7200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcd016bd50 0x7fbcd01554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.550+0000 7fbcd7200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd016a020 con 0x7fbcd016bd50 2024-08-17T02:50:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.550+0000 7fbcd7200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd00c16f0 con 0x7fbcb4004780 2024-08-17T02:50:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.550+0000 7fbcd7200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd00ab920 con 0x7fbcd016a520 2024-08-17T02:50:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.550+0000 7fbcd5200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcd016bd50 0x7fbcd01554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.550+0000 7fbcd5200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcd016bd50 0x7fbcd01554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36602/0 (socket says 172.21.15.5:36602) 2024-08-17T02:50:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.550+0000 7fbcd5200640 1 -- 172.21.15.5:0/4006116717 learned_addr learned my addr 172.21.15.5:0/4006116717 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.550+0000 7fbcc7e00640 1 --2- 172.21.15.5:0/4006116717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbcd016a520 0x7fbcd0169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.550+0000 7fbccfe00640 1 --2- 172.21.15.5:0/4006116717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb4004780 0x7fbcd00c1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.551+0000 7fbcd5200640 1 -- 172.21.15.5:0/4006116717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbcd016a520 msgr2=0x7fbcd0169ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.551+0000 7fbcd5200640 1 --2- 172.21.15.5:0/4006116717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbcd016a520 0x7fbcd0169ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.551+0000 7fbcd5200640 1 -- 172.21.15.5:0/4006116717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb4004780 msgr2=0x7fbcd00c1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.551+0000 7fbcd5200640 1 --2- 172.21.15.5:0/4006116717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb4004780 0x7fbcd00c1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.551+0000 7fbcd5200640 1 -- 172.21.15.5:0/4006116717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd00abc00 con 0x7fbcd016bd50 2024-08-17T02:50:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.551+0000 7fbcd5200640 1 --2- 172.21.15.5:0/4006116717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcd016bd50 0x7fbcd01554d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbcd006e860 tx=0x7fbcc8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.551+0000 7fbcc7400640 1 -- 172.21.15.5:0/4006116717 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc800edf0 con 0x7fbcd016bd50 2024-08-17T02:50:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.551+0000 7fbcc7400640 1 -- 172.21.15.5:0/4006116717 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc80030d0 con 0x7fbcd016bd50 2024-08-17T02:50:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.551+0000 7fbcc7400640 1 -- 172.21.15.5:0/4006116717 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8003470 con 0x7fbcd016bd50 2024-08-17T02:50:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.551+0000 7fbcd7200640 1 -- 172.21.15.5:0/4006116717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd00abee0 con 0x7fbcd016bd50 2024-08-17T02:50:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.551+0000 7fbcd7200640 1 -- 172.21.15.5:0/4006116717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd016c1d0 con 0x7fbcd016bd50 2024-08-17T02:50:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.552+0000 7fbcd7200640 1 -- 172.21.15.5:0/4006116717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd016c3c0 con 0x7fbcd016bd50 2024-08-17T02:50:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.553+0000 7fbcc7400640 1 -- 172.21.15.5:0/4006116717 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbcc80018f0 con 0x7fbcd016bd50 2024-08-17T02:50:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.554+0000 7fbcc7400640 1 --2- 172.21.15.5:0/4006116717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbcac065180 0x7fbcac067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:18.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.554+0000 7fbcc7400640 1 -- 172.21.15.5:0/4006116717 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5923+0+0 (secure 0 0 0) 0x7fbcc8081610 con 0x7fbcd016bd50 2024-08-17T02:50:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.554+0000 7fbccfe00640 1 --2- 172.21.15.5:0/4006116717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbcac065180 0x7fbcac067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.555+0000 7fbccfe00640 1 --2- 172.21.15.5:0/4006116717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbcac065180 0x7fbcac067630 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0001ed0 tx=0x7fbcc0007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:18.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.558+0000 7fbcc7400640 1 -- 172.21.15.5:0/4006116717 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbcc804f600 con 0x7fbcd016bd50 2024-08-17T02:50:18.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:18.746+0000 7fbcd7200640 1 -- 172.21.15.5:0/4006116717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000724543.meta", "pool2": "cephfs.volume_0000000000724543.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbcd0063fb0 con 0x7fbcd016bd50 2024-08-17T02:50:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.485+0000 7fbcc7400640 1 -- 172.21.15.5:0/4006116717 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000724543.meta", "pool2": "cephfs.volume_0000000000724543.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000724543.meta' removed v42) v1 ==== 241+0+0 (secure 0 0 0) 0x7fbcc8052c20 con 0x7fbcd016bd50 2024-08-17T02:50:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs.volume_0000000000724543.meta' removed 2024-08-17T02:50:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.488+0000 7fbcd7200640 1 -- 172.21.15.5:0/4006116717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbcac065180 msgr2=0x7fbcac067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.488+0000 7fbcd7200640 1 --2- 172.21.15.5:0/4006116717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbcac065180 0x7fbcac067630 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0001ed0 tx=0x7fbcc0007040 comp rx=0 tx=0).stop 2024-08-17T02:50:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.488+0000 7fbcd7200640 1 -- 172.21.15.5:0/4006116717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcd016bd50 msgr2=0x7fbcd01554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.488+0000 7fbcd7200640 1 --2- 172.21.15.5:0/4006116717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcd016bd50 0x7fbcd01554d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbcd006e860 tx=0x7fbcc8009040 comp rx=0 tx=0).stop 2024-08-17T02:50:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.488+0000 7fbcd7200640 1 -- 172.21.15.5:0/4006116717 shutdown_connections 2024-08-17T02:50:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.488+0000 7fbcd7200640 1 --2- 172.21.15.5:0/4006116717 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fbcac065180 0x7fbcac067630 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.488+0000 7fbcd7200640 1 --2- 172.21.15.5:0/4006116717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcd016bd50 0x7fbcd01554d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.488+0000 7fbcd7200640 1 --2- 172.21.15.5:0/4006116717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbcd016a520 0x7fbcd0169ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.488+0000 7fbcd7200640 1 --2- 172.21.15.5:0/4006116717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb4004780 0x7fbcd00c1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.488+0000 7fbcd7200640 1 -- 172.21.15.5:0/4006116717 >> 172.21.15.5:0/4006116717 conn(0x7fbcd0066e60 msgr2=0x7fbcd006ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.488+0000 7fbcd7200640 1 -- 172.21.15.5:0/4006116717 shutdown_connections 2024-08-17T02:50:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.488+0000 7fbcd7200640 1 -- 172.21.15.5:0/4006116717 wait complete. 2024-08-17T02:50:19.508 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000724543.data cephfs.volume_0000000000724543.data --yes-i-really-really-mean-it 2024-08-17T02:50:19.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.665+0000 7f707fe00640 1 Processor -- start 2024-08-17T02:50:19.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.665+0000 7f707fe00640 1 -- start start 2024-08-17T02:50:19.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.666+0000 7f707fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70800ad780 0x7f70800adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:19.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.666+0000 7f707fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f70800cae20 0x7f70800ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:19.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.666+0000 7f707fe00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70800ca060 con 0x7f70800af6c0 2024-08-17T02:50:19.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.666+0000 7f707fe00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70800ca340 con 0x7f70800ad780 2024-08-17T02:50:19.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.666+0000 7f707fe00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70800ca620 con 0x7f70800cae20 2024-08-17T02:50:19.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.666+0000 7f707ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70800ad780 0x7f70800adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:19.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.666+0000 7f707ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70800ad780 0x7f70800adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36616/0 (socket says 172.21.15.5:36616) 2024-08-17T02:50:19.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.666+0000 7f707ea00640 1 -- 172.21.15.5:0/3452534779 learned_addr learned my addr 172.21.15.5:0/3452534779 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:19.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.667+0000 7f707ea00640 1 -- 172.21.15.5:0/3452534779 >> v2:172.21.15.107:3300/0 conn(0x7f70800cae20 msgr2=0x7f70800ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:19.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.667+0000 7f7077e00640 1 --2- 172.21.15.5:0/3452534779 >> v2:172.21.15.107:3300/0 conn(0x7f70800cae20 0x7f70800ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:19.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.667+0000 7f707ea00640 1 --2- 172.21.15.5:0/3452534779 >> v2:172.21.15.107:3300/0 conn(0x7f70800cae20 0x7f70800ae6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:19.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.667+0000 7f707ea00640 1 -- 172.21.15.5:0/3452534779 >> v1:172.21.15.107:6789/0 conn(0x7f70800af6c0 legacy=0x7f7080157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:19.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.667+0000 7f707ea00640 1 -- 172.21.15.5:0/3452534779 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70800ca900 con 0x7f70800ad780 2024-08-17T02:50:19.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.667+0000 7f7077e00640 1 --2- 172.21.15.5:0/3452534779 >> v2:172.21.15.107:3300/0 conn(0x7f70800cae20 0x7f70800ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:19.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.668+0000 7f707ea00640 1 --2- 172.21.15.5:0/3452534779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70800ad780 0x7f70800adb50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f708015a5b0 tx=0x7f70700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2622e142df5acf23 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:19.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.668+0000 7f707e000640 1 -- 172.21.15.5:0/3452534779 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707002add0 con 0x7f70800ad780 2024-08-17T02:50:19.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.668+0000 7f707e000640 1 -- 172.21.15.5:0/3452534779 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7070032440 con 0x7f70800ad780 2024-08-17T02:50:19.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.668+0000 7f707e000640 1 -- 172.21.15.5:0/3452534779 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7070032820 con 0x7f70800ad780 2024-08-17T02:50:19.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.669+0000 7f707fe00640 1 -- 172.21.15.5:0/3452534779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70800ad780 msgr2=0x7f70800adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:19.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.669+0000 7f707fe00640 1 --2- 172.21.15.5:0/3452534779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70800ad780 0x7f70800adb50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f708015a5b0 tx=0x7f70700091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:19.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.669+0000 7f707fe00640 1 -- 172.21.15.5:0/3452534779 shutdown_connections 2024-08-17T02:50:19.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.669+0000 7f707fe00640 1 --2- 172.21.15.5:0/3452534779 >> v2:172.21.15.107:3300/0 conn(0x7f70800cae20 0x7f70800ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:19.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.669+0000 7f707fe00640 1 --2- 172.21.15.5:0/3452534779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70800ad780 0x7f70800adb50 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:19.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.669+0000 7f707fe00640 1 -- 172.21.15.5:0/3452534779 >> 172.21.15.5:0/3452534779 conn(0x7f7080066e60 msgr2=0x7f7080067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:19.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.669+0000 7f707fe00640 1 -- 172.21.15.5:0/3452534779 shutdown_connections 2024-08-17T02:50:19.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.669+0000 7f707fe00640 1 -- 172.21.15.5:0/3452534779 wait complete. 2024-08-17T02:50:19.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.670+0000 7f707fe00640 1 Processor -- start 2024-08-17T02:50:19.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.670+0000 7f707fe00640 1 -- start start 2024-08-17T02:50:19.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.671+0000 7f707fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70800ad780 0x7f70800a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:19.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.671+0000 7f707fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70800af6c0 0x7f708016d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:19.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.671+0000 7f707fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70800cae20 0x7f70801503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:19.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.671+0000 7f707fe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708014ddc0 con 0x7f70800af6c0 2024-08-17T02:50:19.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.671+0000 7f707fe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708016d750 con 0x7f70800ad780 2024-08-17T02:50:19.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.671+0000 7f707fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70800c1030 con 0x7f70800cae20 2024-08-17T02:50:19.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.671+0000 7f7077e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70800af6c0 0x7f708016d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:19.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.672+0000 7f7077e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70800af6c0 0x7f708016d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36618/0 (socket says 172.21.15.5:36618) 2024-08-17T02:50:19.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.672+0000 7f7077e00640 1 -- 172.21.15.5:0/18444689 learned_addr learned my addr 172.21.15.5:0/18444689 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:19.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.672+0000 7f707ea00640 1 --2- 172.21.15.5:0/18444689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70800ad780 0x7f70800a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:19.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.672+0000 7f707f400640 1 --2- 172.21.15.5:0/18444689 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70800cae20 0x7f70801503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:19.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.672+0000 7f7077e00640 1 -- 172.21.15.5:0/18444689 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70800cae20 msgr2=0x7f70801503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:19.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.672+0000 7f7077e00640 1 --2- 172.21.15.5:0/18444689 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70800cae20 0x7f70801503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:19.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.672+0000 7f7077e00640 1 -- 172.21.15.5:0/18444689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70800ad780 msgr2=0x7f70800a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:19.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.672+0000 7f7077e00640 1 --2- 172.21.15.5:0/18444689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70800ad780 0x7f70800a93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:19.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.672+0000 7f7077e00640 1 -- 172.21.15.5:0/18444689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7070009450 con 0x7f70800af6c0 2024-08-17T02:50:19.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.672+0000 7f7077e00640 1 --2- 172.21.15.5:0/18444689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70800af6c0 0x7f708016d210 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f706800c880 tx=0x7f7068008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:19.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.672+0000 7f7076000640 1 -- 172.21.15.5:0/18444689 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706800ce10 con 0x7f70800af6c0 2024-08-17T02:50:19.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.672+0000 7f7076000640 1 -- 172.21.15.5:0/18444689 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7068007890 con 0x7f70800af6c0 2024-08-17T02:50:19.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.672+0000 7f707fe00640 1 -- 172.21.15.5:0/18444689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70800c1280 con 0x7f70800af6c0 2024-08-17T02:50:19.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.673+0000 7f7076000640 1 -- 172.21.15.5:0/18444689 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068007c10 con 0x7f70800af6c0 2024-08-17T02:50:19.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.673+0000 7f707fe00640 1 -- 172.21.15.5:0/18444689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70800a8960 con 0x7f70800af6c0 2024-08-17T02:50:19.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.674+0000 7f707fe00640 1 -- 172.21.15.5:0/18444689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7080063f10 con 0x7f70800af6c0 2024-08-17T02:50:19.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.674+0000 7f7076000640 1 -- 172.21.15.5:0/18444689 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f70680113f0 con 0x7f70800af6c0 2024-08-17T02:50:19.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.676+0000 7f7076000640 1 --2- 172.21.15.5:0/18444689 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f705c065150 0x7f705c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:19.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.676+0000 7f7076000640 1 -- 172.21.15.5:0/18444689 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5448+0+0 (secure 0 0 0) 0x7f7068082300 con 0x7f70800af6c0 2024-08-17T02:50:19.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.676+0000 7f707ea00640 1 --2- 172.21.15.5:0/18444689 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f705c065150 0x7f705c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:19.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.677+0000 7f707ea00640 1 --2- 172.21.15.5:0/18444689 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f705c065150 0x7f705c067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7070034000 tx=0x7f7070032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:19.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.680+0000 7f7076000640 1 -- 172.21.15.5:0/18444689 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7068053f60 con 0x7f70800af6c0 2024-08-17T02:50:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:19.863+0000 7f707fe00640 1 -- 172.21.15.5:0/18444689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000724543.data", "pool2": "cephfs.volume_0000000000724543.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f70800635f0 con 0x7f70800af6c0 2024-08-17T02:50:20.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.494+0000 7f7076000640 1 -- 172.21.15.5:0/18444689 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000724543.data", "pool2": "cephfs.volume_0000000000724543.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000724543.data' removed v43) v1 ==== 241+0+0 (secure 0 0 0) 0x7f7068053af0 con 0x7f70800af6c0 2024-08-17T02:50:20.496 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs.volume_0000000000724543.data' removed 2024-08-17T02:50:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.497+0000 7f707fe00640 1 -- 172.21.15.5:0/18444689 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f705c065150 msgr2=0x7f705c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.497+0000 7f707fe00640 1 --2- 172.21.15.5:0/18444689 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f705c065150 0x7f705c067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7070034000 tx=0x7f7070032000 comp rx=0 tx=0).stop 2024-08-17T02:50:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.497+0000 7f707fe00640 1 -- 172.21.15.5:0/18444689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70800af6c0 msgr2=0x7f708016d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.497+0000 7f707fe00640 1 --2- 172.21.15.5:0/18444689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70800af6c0 0x7f708016d210 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f706800c880 tx=0x7f7068008040 comp rx=0 tx=0).stop 2024-08-17T02:50:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.498+0000 7f707fe00640 1 -- 172.21.15.5:0/18444689 shutdown_connections 2024-08-17T02:50:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.498+0000 7f707fe00640 1 --2- 172.21.15.5:0/18444689 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f705c065150 0x7f705c067600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.498+0000 7f707fe00640 1 --2- 172.21.15.5:0/18444689 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70800cae20 0x7f70801503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.498+0000 7f707fe00640 1 --2- 172.21.15.5:0/18444689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70800af6c0 0x7f708016d210 secure :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f706800c880 tx=0x7f7068008040 comp rx=0 tx=0).stop 2024-08-17T02:50:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.498+0000 7f707fe00640 1 --2- 172.21.15.5:0/18444689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70800ad780 0x7f70800a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.498+0000 7f707fe00640 1 -- 172.21.15.5:0/18444689 >> 172.21.15.5:0/18444689 conn(0x7f7080066e60 msgr2=0x7f7080154570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.498+0000 7f707fe00640 1 -- 172.21.15.5:0/18444689 shutdown_connections 2024-08-17T02:50:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.498+0000 7f707fe00640 1 -- 172.21.15.5:0/18444689 wait complete. 2024-08-17T02:50:20.520 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:50:20.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.674+0000 7f6de4000640 1 Processor -- start 2024-08-17T02:50:20.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.674+0000 7f6de4000640 1 -- start start 2024-08-17T02:50:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.675+0000 7f6de4000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6ddc1589e0 0x7f6ddc158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.675+0000 7f6de4000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ddc0af9a0 con 0x7f6ddc0ce140 2024-08-17T02:50:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.675+0000 7f6de4000640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ddc0ce740 con 0x7f6ddc0ca9c0 2024-08-17T02:50:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.675+0000 7f6de4000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ddc0af810 con 0x7f6ddc1589e0 2024-08-17T02:50:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.675+0000 7f6de2000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6ddc0ce140 0x7f6ddc0afe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51378/0 (socket says 172.21.15.5:51378) 2024-08-17T02:50:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.675+0000 7f6de2000640 1 -- 172.21.15.5:0/101786155 learned_addr learned my addr 172.21.15.5:0/101786155 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6de1600640 1 --2- 172.21.15.5:0/101786155 >> v2:172.21.15.107:3300/0 conn(0x7f6ddc1589e0 0x7f6ddc158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6ddbe00640 1 -- 172.21.15.5:0/101786155 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092376982 0 0) 0x7f6ddc0af9a0 con 0x7f6ddc0ce140 2024-08-17T02:50:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6ddbe00640 1 -- 172.21.15.5:0/101786155 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dc40034e0 con 0x7f6ddc0ce140 2024-08-17T02:50:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6ddbe00640 1 -- 172.21.15.5:0/101786155 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3392748865 0 0) 0x7f6dc40034e0 con 0x7f6ddc0ce140 2024-08-17T02:50:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6ddbe00640 1 -- 172.21.15.5:0/101786155 >> v2:172.21.15.107:3300/0 conn(0x7f6ddc1589e0 msgr2=0x7f6ddc158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6ddbe00640 1 --2- 172.21.15.5:0/101786155 >> v2:172.21.15.107:3300/0 conn(0x7f6ddc1589e0 0x7f6ddc158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6ddbe00640 1 -- 172.21.15.5:0/101786155 >> v1:172.21.15.107:6789/0 conn(0x7f6ddc0ca9c0 legacy=0x7f6ddc0cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6ddbe00640 1 -- 172.21.15.5:0/101786155 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc0cea00 con 0x7f6ddc0ce140 2024-08-17T02:50:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6ddbe00640 1 -- 172.21.15.5:0/101786155 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7f6dd40017f0 con 0x7f6ddc0ce140 2024-08-17T02:50:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6de1600640 1 --2- 172.21.15.5:0/101786155 >> v2:172.21.15.107:3300/0 conn(0x7f6ddc1589e0 0x7f6ddc158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6ddbe00640 1 -- 172.21.15.5:0/101786155 >> v1:172.21.15.5:6789/0 conn(0x7f6ddc0ce140 legacy=0x7f6ddc0afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6ddbe00640 1 --2- 172.21.15.5:0/101786155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc4003a20 0x7f6dc4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6ddbe00640 1 --2- 172.21.15.5:0/101786155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6dc4004780 0x7f6dc4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6ddbe00640 1 --2- 172.21.15.5:0/101786155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc4005180 0x7f6dc400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6ddbe00640 1 -- 172.21.15.5:0/101786155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0af810 con 0x7f6dc4003a20 2024-08-17T02:50:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6ddbe00640 1 -- 172.21.15.5:0/101786155 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc400c0a0 con 0x7f6dc4005180 2024-08-17T02:50:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.676+0000 7f6ddbe00640 1 -- 172.21.15.5:0/101786155 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc400c260 con 0x7f6dc4004780 2024-08-17T02:50:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.677+0000 7f6de1600640 1 --2- 172.21.15.5:0/101786155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc4003a20 0x7f6dc4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.677+0000 7f6de0c00640 1 --2- 172.21.15.5:0/101786155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6dc4004780 0x7f6dc4004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.677+0000 7f6de2000640 1 --2- 172.21.15.5:0/101786155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc4005180 0x7f6dc400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.677+0000 7f6de1600640 1 -- 172.21.15.5:0/101786155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6dc4004780 msgr2=0x7f6dc4004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.677+0000 7f6de1600640 1 --2- 172.21.15.5:0/101786155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6dc4004780 0x7f6dc4004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.677+0000 7f6de1600640 1 -- 172.21.15.5:0/101786155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc4005180 msgr2=0x7f6dc400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.677+0000 7f6de1600640 1 --2- 172.21.15.5:0/101786155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc4005180 0x7f6dc400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.677+0000 7f6de1600640 1 -- 172.21.15.5:0/101786155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc40034e0 con 0x7f6dc4003a20 2024-08-17T02:50:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.677+0000 7f6de2000640 1 --2- 172.21.15.5:0/101786155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc4005180 0x7f6dc400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.677+0000 7f6de2000640 1 -- 172.21.15.5:0/101786155 reap_dead start 2024-08-17T02:50:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.678+0000 7f6de1600640 1 --2- 172.21.15.5:0/101786155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc4003a20 0x7f6dc4003e30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009d60 tx=0x7f6dd00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b56bf8fcb4fc44 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.679+0000 7f6ddbe00640 1 -- 172.21.15.5:0/101786155 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0031400 con 0x7f6dc4003a20 2024-08-17T02:50:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.679+0000 7f6ddbe00640 1 -- 172.21.15.5:0/101786155 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd002d050 con 0x7f6dc4003a20 2024-08-17T02:50:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.679+0000 7f6ddbe00640 1 -- 172.21.15.5:0/101786155 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0031770 con 0x7f6dc4003a20 2024-08-17T02:50:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.679+0000 7f6de4000640 1 -- 172.21.15.5:0/101786155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc4003a20 msgr2=0x7f6dc4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.679+0000 7f6de4000640 1 --2- 172.21.15.5:0/101786155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc4003a20 0x7f6dc4003e30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009d60 tx=0x7f6dd00090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.679+0000 7f6de4000640 1 -- 172.21.15.5:0/101786155 shutdown_connections 2024-08-17T02:50:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.679+0000 7f6de4000640 1 --2- 172.21.15.5:0/101786155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc4003a20 0x7f6dc4003e30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.679+0000 7f6de4000640 1 -- 172.21.15.5:0/101786155 >> 172.21.15.5:0/101786155 conn(0x7f6ddc06e590 msgr2=0x7f6ddc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.679+0000 7f6de4000640 1 -- 172.21.15.5:0/101786155 shutdown_connections 2024-08-17T02:50:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.679+0000 7f6de4000640 1 -- 172.21.15.5:0/101786155 wait complete. 2024-08-17T02:50:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.681+0000 7f6de4000640 1 Processor -- start 2024-08-17T02:50:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.681+0000 7f6de4000640 1 -- start start 2024-08-17T02:50:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.682+0000 7f6de4000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc4003a20 0x7f6ddc0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.682+0000 7f6de4000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ddc0b3290 0x7f6ddc14b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.682+0000 7f6de4000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc0b0b20 0x7f6ddc0b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.682+0000 7f6de4000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0b1500 con 0x7f6ddc0b0b20 2024-08-17T02:50:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.682+0000 7f6de4000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0c9960 con 0x7f6dc4003a20 2024-08-17T02:50:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.682+0000 7f6de4000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0c8d50 con 0x7f6ddc0b3290 2024-08-17T02:50:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.682+0000 7f6de2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc0b0b20 0x7f6ddc0b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.682+0000 7f6de2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc0b0b20 0x7f6ddc0b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36638/0 (socket says 172.21.15.5:36638) 2024-08-17T02:50:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.682+0000 7f6de2000640 1 -- 172.21.15.5:0/3480854978 learned_addr learned my addr 172.21.15.5:0/3480854978 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.682+0000 7f6de0c00640 1 --2- 172.21.15.5:0/3480854978 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ddc0b3290 0x7f6ddc14b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.682+0000 7f6de1600640 1 --2- 172.21.15.5:0/3480854978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc4003a20 0x7f6ddc0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.682+0000 7f6de2000640 1 -- 172.21.15.5:0/3480854978 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ddc0b3290 msgr2=0x7f6ddc14b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.682+0000 7f6de2000640 1 --2- 172.21.15.5:0/3480854978 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ddc0b3290 0x7f6ddc14b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.682+0000 7f6de2000640 1 -- 172.21.15.5:0/3480854978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc4003a20 msgr2=0x7f6ddc0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.682+0000 7f6de2000640 1 --2- 172.21.15.5:0/3480854978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc4003a20 0x7f6ddc0c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.682+0000 7f6de2000640 1 -- 172.21.15.5:0/3480854978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc0c9030 con 0x7f6ddc0b0b20 2024-08-17T02:50:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.683+0000 7f6de2000640 1 --2- 172.21.15.5:0/3480854978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc0b0b20 0x7f6ddc0b0fc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc066dc0 tx=0x7f6ddc0ce8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.683+0000 7f6dd8c00640 1 -- 172.21.15.5:0/3480854978 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4012590 con 0x7f6ddc0b0b20 2024-08-17T02:50:20.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.683+0000 7f6dd8c00640 1 -- 172.21.15.5:0/3480854978 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd40126f0 con 0x7f6ddc0b0b20 2024-08-17T02:50:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.683+0000 7f6dd8c00640 1 -- 172.21.15.5:0/3480854978 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4012a70 con 0x7f6ddc0b0b20 2024-08-17T02:50:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.683+0000 7f6de4000640 1 -- 172.21.15.5:0/3480854978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc0c9310 con 0x7f6ddc0b0b20 2024-08-17T02:50:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.683+0000 7f6de4000640 1 -- 172.21.15.5:0/3480854978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc0c9df0 con 0x7f6ddc0b0b20 2024-08-17T02:50:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.684+0000 7f6de4000640 1 -- 172.21.15.5:0/3480854978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc0c9b10 con 0x7f6ddc0b0b20 2024-08-17T02:50:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.685+0000 7f6dd8c00640 1 -- 172.21.15.5:0/3480854978 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6dd401d460 con 0x7f6ddc0b0b20 2024-08-17T02:50:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.686+0000 7f6dd8c00640 1 --2- 172.21.15.5:0/3480854978 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6dbc065180 0x7f6dbc067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.686+0000 7f6dd8c00640 1 -- 172.21.15.5:0/3480854978 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6dd4081f00 con 0x7f6ddc0b0b20 2024-08-17T02:50:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.686+0000 7f6de1600640 1 --2- 172.21.15.5:0/3480854978 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6dbc065180 0x7f6dbc067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:20.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.687+0000 7f6de1600640 1 --2- 172.21.15.5:0/3480854978 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6dbc065180 0x7f6dbc067630 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0034000 tx=0x7f6dd0035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:20.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.690+0000 7f6dd8c00640 1 -- 172.21.15.5:0/3480854978 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6ddc0c9b10 con 0x7f6ddc0b0b20 2024-08-17T02:50:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.872+0000 7f6de4000640 1 -- 172.21.15.5:0/3480854978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6ddc0c9ad0 con 0x7f6ddc0b0b20 2024-08-17T02:50:20.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.876+0000 7f6dd8c00640 1 -- 172.21.15.5:0/3480854978 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6dd4050270 con 0x7f6ddc0b0b20 2024-08-17T02:50:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.878+0000 7f6de4000640 1 -- 172.21.15.5:0/3480854978 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6dbc065180 msgr2=0x7f6dbc067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.878+0000 7f6de4000640 1 --2- 172.21.15.5:0/3480854978 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6dbc065180 0x7f6dbc067630 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0034000 tx=0x7f6dd0035000 comp rx=0 tx=0).stop 2024-08-17T02:50:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.878+0000 7f6de4000640 1 -- 172.21.15.5:0/3480854978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc0b0b20 msgr2=0x7f6ddc0b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.878+0000 7f6de4000640 1 --2- 172.21.15.5:0/3480854978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc0b0b20 0x7f6ddc0b0fc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc066dc0 tx=0x7f6ddc0ce8f0 comp rx=0 tx=0).stop 2024-08-17T02:50:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.879+0000 7f6de4000640 1 -- 172.21.15.5:0/3480854978 shutdown_connections 2024-08-17T02:50:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.879+0000 7f6de4000640 1 --2- 172.21.15.5:0/3480854978 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6dbc065180 0x7f6dbc067630 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:20.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.879+0000 7f6de4000640 1 --2- 172.21.15.5:0/3480854978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ddc0b0b20 0x7f6ddc0b0fc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:20.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.879+0000 7f6de4000640 1 --2- 172.21.15.5:0/3480854978 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ddc0b3290 0x7f6ddc14b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:20.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.879+0000 7f6de4000640 1 --2- 172.21.15.5:0/3480854978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc4003a20 0x7f6ddc0c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:20.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.879+0000 7f6de4000640 1 -- 172.21.15.5:0/3480854978 >> 172.21.15.5:0/3480854978 conn(0x7f6ddc06e590 msgr2=0x7f6ddc156080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:20.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.879+0000 7f6de4000640 1 -- 172.21.15.5:0/3480854978 shutdown_connections 2024-08-17T02:50:20.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:20.879+0000 7f6de4000640 1 -- 172.21.15.5:0/3480854978 wait complete. 2024-08-17T02:50:20.895 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:50:21.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.045+0000 7fd13a800640 1 Processor -- start 2024-08-17T02:50:21.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.045+0000 7fd13a800640 1 -- start start 2024-08-17T02:50:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.046+0000 7fd13a800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1340b15d0 0x7fd1340b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.046+0000 7fd13a800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd134156ea0 0x7fd1340b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.046+0000 7fd13a800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1340ae2a0 con 0x7fd1340adde0 2024-08-17T02:50:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.046+0000 7fd13a800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1340ae580 con 0x7fd1340b15d0 2024-08-17T02:50:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.046+0000 7fd13a800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340ae860 con 0x7fd134156ea0 2024-08-17T02:50:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.046+0000 7fd133400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1340b15d0 0x7fd1340b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.046+0000 7fd133400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1340b15d0 0x7fd1340b19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36642/0 (socket says 172.21.15.5:36642) 2024-08-17T02:50:21.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.046+0000 7fd133400640 1 -- 172.21.15.5:0/192604129 learned_addr learned my addr 172.21.15.5:0/192604129 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:21.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.047+0000 7fd133e00640 1 --2- 172.21.15.5:0/192604129 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd134156ea0 0x7fd1340b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:21.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.047+0000 7fd133400640 1 -- 172.21.15.5:0/192604129 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd134156ea0 msgr2=0x7fd1340b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:21.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.047+0000 7fd133400640 1 --2- 172.21.15.5:0/192604129 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd134156ea0 0x7fd1340b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:21.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.047+0000 7fd133400640 1 -- 172.21.15.5:0/192604129 >> v1:172.21.15.107:6789/0 conn(0x7fd1340adde0 legacy=0x7fd134156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:21.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.047+0000 7fd133400640 1 -- 172.21.15.5:0/192604129 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1340aeb40 con 0x7fd1340b15d0 2024-08-17T02:50:21.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.047+0000 7fd133e00640 1 --2- 172.21.15.5:0/192604129 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd134156ea0 0x7fd1340b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:21.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.048+0000 7fd133400640 1 --2- 172.21.15.5:0/192604129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340b15d0 0x7fd1340b19a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd1340b0600 tx=0x7fd1240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e988c19c7cc2b54 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:21.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.048+0000 7fd132000640 1 -- 172.21.15.5:0/192604129 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12402adb0 con 0x7fd1340b15d0 2024-08-17T02:50:21.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.048+0000 7fd132000640 1 -- 172.21.15.5:0/192604129 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd124032440 con 0x7fd1340b15d0 2024-08-17T02:50:21.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.048+0000 7fd132000640 1 -- 172.21.15.5:0/192604129 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124032820 con 0x7fd1340b15d0 2024-08-17T02:50:21.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.049+0000 7fd13a800640 1 -- 172.21.15.5:0/192604129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340b15d0 msgr2=0x7fd1340b19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.049+0000 7fd13a800640 1 --2- 172.21.15.5:0/192604129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340b15d0 0x7fd1340b19a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd1340b0600 tx=0x7fd1240091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.049+0000 7fd13a800640 1 -- 172.21.15.5:0/192604129 shutdown_connections 2024-08-17T02:50:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.049+0000 7fd13a800640 1 --2- 172.21.15.5:0/192604129 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd134156ea0 0x7fd1340b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.049+0000 7fd13a800640 1 --2- 172.21.15.5:0/192604129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340b15d0 0x7fd1340b19a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.049+0000 7fd13a800640 1 -- 172.21.15.5:0/192604129 >> 172.21.15.5:0/192604129 conn(0x7fd1340ce5e0 msgr2=0x7fd134095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.049+0000 7fd13a800640 1 -- 172.21.15.5:0/192604129 shutdown_connections 2024-08-17T02:50:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.049+0000 7fd13a800640 1 -- 172.21.15.5:0/192604129 wait complete. 2024-08-17T02:50:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.050+0000 7fd13a800640 1 Processor -- start 2024-08-17T02:50:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.051+0000 7fd13a800640 1 -- start start 2024-08-17T02:50:21.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.051+0000 7fd13a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340adde0 0x7fd134152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:21.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.051+0000 7fd13a800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1340b15d0 0x7fd1340aab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:21.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.051+0000 7fd13a800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd134156ea0 0x7fd1340ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:21.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.051+0000 7fd13a800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13409b2b0 con 0x7fd1340adde0 2024-08-17T02:50:21.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.051+0000 7fd13a800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340a8fe0 con 0x7fd1340b15d0 2024-08-17T02:50:21.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.051+0000 7fd13a800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13409a420 con 0x7fd134156ea0 2024-08-17T02:50:21.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.052+0000 7fd133400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340adde0 0x7fd134152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:21.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.052+0000 7fd133400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340adde0 0x7fd134152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36656/0 (socket says 172.21.15.5:36656) 2024-08-17T02:50:21.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.052+0000 7fd133400640 1 -- 172.21.15.5:0/2943479039 learned_addr learned my addr 172.21.15.5:0/2943479039 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:21.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.052+0000 7fd133e00640 1 --2- 172.21.15.5:0/2943479039 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd134156ea0 0x7fd1340ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.052+0000 7fd132a00640 1 --2- 172.21.15.5:0/2943479039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1340b15d0 0x7fd1340aab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.052+0000 7fd133400640 1 -- 172.21.15.5:0/2943479039 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd134156ea0 msgr2=0x7fd1340ab0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.052+0000 7fd133400640 1 --2- 172.21.15.5:0/2943479039 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd134156ea0 0x7fd1340ab0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.052+0000 7fd133400640 1 -- 172.21.15.5:0/2943479039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1340b15d0 msgr2=0x7fd1340aab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.052+0000 7fd133400640 1 --2- 172.21.15.5:0/2943479039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1340b15d0 0x7fd1340aab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.052+0000 7fd133400640 1 -- 172.21.15.5:0/2943479039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd124009450 con 0x7fd1340adde0 2024-08-17T02:50:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.052+0000 7fd132a00640 1 --2- 172.21.15.5:0/2943479039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1340b15d0 0x7fd1340aab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.052+0000 7fd133400640 1 --2- 172.21.15.5:0/2943479039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340adde0 0x7fd134152f60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd124009940 tx=0x7fd124032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.053+0000 7fd12aa00640 1 -- 172.21.15.5:0/2943479039 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124006b30 con 0x7fd1340adde0 2024-08-17T02:50:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.053+0000 7fd12aa00640 1 -- 172.21.15.5:0/2943479039 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd124031a40 con 0x7fd1340adde0 2024-08-17T02:50:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.053+0000 7fd12aa00640 1 -- 172.21.15.5:0/2943479039 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124031e00 con 0x7fd1340adde0 2024-08-17T02:50:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.053+0000 7fd13a800640 1 -- 172.21.15.5:0/2943479039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd134099e60 con 0x7fd1340adde0 2024-08-17T02:50:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.053+0000 7fd13a800640 1 -- 172.21.15.5:0/2943479039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1340a8c70 con 0x7fd1340adde0 2024-08-17T02:50:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.054+0000 7fd13a800640 1 -- 172.21.15.5:0/2943479039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd134063fb0 con 0x7fd1340adde0 2024-08-17T02:50:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.055+0000 7fd12aa00640 1 -- 172.21.15.5:0/2943479039 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd124039040 con 0x7fd1340adde0 2024-08-17T02:50:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.055+0000 7fd12aa00640 1 --2- 172.21.15.5:0/2943479039 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd114065180 0x7fd114067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.056+0000 7fd12aa00640 1 -- 172.21.15.5:0/2943479039 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd1240a2080 con 0x7fd1340adde0 2024-08-17T02:50:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.056+0000 7fd132a00640 1 --2- 172.21.15.5:0/2943479039 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd114065180 0x7fd114067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.056+0000 7fd132a00640 1 --2- 172.21.15.5:0/2943479039 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd114065180 0x7fd114067630 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd134159470 tx=0x7fd120009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:21.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.060+0000 7fd12aa00640 1 -- 172.21.15.5:0/2943479039 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd1240d3e40 con 0x7fd1340adde0 2024-08-17T02:50:21.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.312+0000 7fd13a800640 1 -- 172.21.15.5:0/2943479039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fd1341598c0 con 0x7fd1340adde0 2024-08-17T02:50:21.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.496+0000 7fd12aa00640 1 -- 172.21.15.5:0/2943479039 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v163) v1 ==== 135+0+0 (secure 0 0 0) 0x7fd124073e80 con 0x7fd1340adde0 2024-08-17T02:50:21.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.498+0000 7fd13a800640 1 -- 172.21.15.5:0/2943479039 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd114065180 msgr2=0x7fd114067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:21.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.498+0000 7fd13a800640 1 --2- 172.21.15.5:0/2943479039 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd114065180 0x7fd114067630 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd134159470 tx=0x7fd120009040 comp rx=0 tx=0).stop 2024-08-17T02:50:21.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.498+0000 7fd13a800640 1 -- 172.21.15.5:0/2943479039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340adde0 msgr2=0x7fd134152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:21.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.498+0000 7fd13a800640 1 --2- 172.21.15.5:0/2943479039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340adde0 0x7fd134152f60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd124009940 tx=0x7fd124032000 comp rx=0 tx=0).stop 2024-08-17T02:50:21.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.499+0000 7fd13a800640 1 -- 172.21.15.5:0/2943479039 shutdown_connections 2024-08-17T02:50:21.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.499+0000 7fd13a800640 1 --2- 172.21.15.5:0/2943479039 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fd114065180 0x7fd114067630 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:21.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.499+0000 7fd13a800640 1 --2- 172.21.15.5:0/2943479039 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd134156ea0 0x7fd1340ab0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:21.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.499+0000 7fd13a800640 1 --2- 172.21.15.5:0/2943479039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1340b15d0 0x7fd1340aab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:21.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.499+0000 7fd13a800640 1 --2- 172.21.15.5:0/2943479039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340adde0 0x7fd134152f60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:21.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.499+0000 7fd13a800640 1 -- 172.21.15.5:0/2943479039 >> 172.21.15.5:0/2943479039 conn(0x7fd1340ce5e0 msgr2=0x7fd134095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:21.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.499+0000 7fd13a800640 1 -- 172.21.15.5:0/2943479039 shutdown_connections 2024-08-17T02:50:21.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:21.499+0000 7fd13a800640 1 -- 172.21.15.5:0/2943479039 wait complete. 2024-08-17T02:50:21.519 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:50:21.519 INFO:tasks.cephfs_test_runner: 2024-08-17T02:50:21.519 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:50:21.519 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:50:21.519 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:50:21.519 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:50:21.519 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:50:21.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:50:21.520 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:50:21.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:50:21.520 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:50:21.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:50:21.520 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:50:21.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:50:21.520 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:50:21.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:50:21.520 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:50:21.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:50:21.520 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:50:21.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:50:21.520 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:50:21.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:50:21.520 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:50:21.521 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:50:21.521 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:50:21.521 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi005 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000724543 --yes-i-really-mean-it' 2024-08-17T02:50:21.521 INFO:tasks.cephfs_test_runner: 2024-08-17T02:50:21.521 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:50:21.521 INFO:tasks.cephfs_test_runner:Ran 1 test in 169.337s 2024-08-17T02:50:21.521 INFO:tasks.cephfs_test_runner: 2024-08-17T02:50:21.521 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:50:21.521 INFO:tasks.cephfs_test_runner: 2024-08-17T02:50:21.521 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:50:21.521 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:50:21.521 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:50:21.521 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:50:21.522 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:50:21.522 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:50:21.522 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:50:21.522 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:50:21.522 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:50:21.522 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:50:21.522 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:50:21.522 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:50:21.522 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:50:21.522 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:50:21.522 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:50:21.522 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:50:21.523 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:50:21.523 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:50:21.523 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:50:21.523 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:50:21.523 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:50:21.523 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:50:21.523 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:50:21.523 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi005 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000724543 --yes-i-really-mean-it' 2024-08-17T02:50:21.523 INFO:tasks.cephfs_test_runner: 2024-08-17T02:50:21.524 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:50:21.746 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=67685b33dd024587b5825212ab7ff555 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:50:21.747 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:50:21.755 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-17T02:50:21.777 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-17T02:50:21.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:21.778 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-17T02:50:21.817 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:50:21.817 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:50:21.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:21.818 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:50:21.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:21.916 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:50:22.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:22.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-08-17T02:50:22.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:22.461 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-17T02:50:22.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:22.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-08-17T02:50:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2024-08-17T02:50:22.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:50:22.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:22.602 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-08-17T02:50:22.642 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:50:22.642 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:50:22.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:22.643 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:50:22.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:22.744 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:50:23.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:23.014 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-08-17T02:50:23.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:23.304 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-08-17T02:50:23.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:50:23.340 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-08-17T02:50:23.439 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-08-17T02:50:23.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:50:23.443 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:50:23.453 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:50:23.453 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:50:23.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.610+0000 7f743b200640 1 Processor -- start 2024-08-17T02:50:23.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.610+0000 7f743b200640 1 -- start start 2024-08-17T02:50:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.612+0000 7f743b200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f743c0aa4e0 0x7f743c0aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.612+0000 7f743b200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c06dba0 con 0x7f743c06e8b0 2024-08-17T02:50:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.612+0000 7f743b200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c15d580 con 0x7f743c06ed00 2024-08-17T02:50:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.612+0000 7f743b200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c06ddf0 con 0x7f743c0aa4e0 2024-08-17T02:50:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.612+0000 7f7433e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f743c06e8b0 0x7f743c0af8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51388/0 (socket says 172.21.15.5:51388) 2024-08-17T02:50:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.612+0000 7f7433e00640 1 -- 172.21.15.5:0/1880055401 learned_addr learned my addr 172.21.15.5:0/1880055401 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.612+0000 7f7439e00640 1 --2- 172.21.15.5:0/1880055401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f743c0aa4e0 0x7f743c0aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.613+0000 7f7439400640 1 -- 172.21.15.5:0/1880055401 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522960739 0 0) 0x7f743c06dba0 con 0x7f743c06e8b0 2024-08-17T02:50:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.613+0000 7f7439400640 1 -- 172.21.15.5:0/1880055401 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74200034e0 con 0x7f743c06e8b0 2024-08-17T02:50:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.613+0000 7f7439400640 1 -- 172.21.15.5:0/1880055401 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816921853 0 0) 0x7f743c15d580 con 0x7f743c06ed00 2024-08-17T02:50:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.613+0000 7f7439400640 1 -- 172.21.15.5:0/1880055401 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f743c06dba0 con 0x7f743c06ed00 2024-08-17T02:50:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.613+0000 7f7439e00640 1 -- 172.21.15.5:0/1880055401 >> v1:172.21.15.107:6789/0 conn(0x7f743c06ed00 legacy=0x7f743c15c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.613+0000 7f7439e00640 1 -- 172.21.15.5:0/1880055401 >> v1:172.21.15.5:6789/0 conn(0x7f743c06e8b0 legacy=0x7f743c0af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.613+0000 7f7439e00640 1 -- 172.21.15.5:0/1880055401 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c06e0d0 con 0x7f743c0aa4e0 2024-08-17T02:50:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.614+0000 7f7439e00640 1 --2- 172.21.15.5:0/1880055401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f743c0aa4e0 0x7f743c0aa8b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f742c009880 tx=0x7f742c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef7265a8411a224f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.614+0000 7f7439400640 1 -- 172.21.15.5:0/1880055401 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c02ad80 con 0x7f743c0aa4e0 2024-08-17T02:50:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.614+0000 7f7439400640 1 -- 172.21.15.5:0/1880055401 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c032440 con 0x7f743c0aa4e0 2024-08-17T02:50:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.614+0000 7f7439400640 1 -- 172.21.15.5:0/1880055401 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c0327c0 con 0x7f743c0aa4e0 2024-08-17T02:50:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.615+0000 7f743b200640 1 -- 172.21.15.5:0/1880055401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f743c0aa4e0 msgr2=0x7f743c0aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:23.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.615+0000 7f743b200640 1 --2- 172.21.15.5:0/1880055401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f743c0aa4e0 0x7f743c0aa8b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f742c009880 tx=0x7f742c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:23.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.615+0000 7f743b200640 1 -- 172.21.15.5:0/1880055401 shutdown_connections 2024-08-17T02:50:23.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.615+0000 7f743b200640 1 --2- 172.21.15.5:0/1880055401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f743c0aa4e0 0x7f743c0aa8b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:23.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.615+0000 7f743b200640 1 -- 172.21.15.5:0/1880055401 >> 172.21.15.5:0/1880055401 conn(0x7f743c066e60 msgr2=0x7f743c067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:23.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.615+0000 7f743b200640 1 -- 172.21.15.5:0/1880055401 shutdown_connections 2024-08-17T02:50:23.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.615+0000 7f743b200640 1 -- 172.21.15.5:0/1880055401 wait complete. 2024-08-17T02:50:23.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.616+0000 7f743b200640 1 Processor -- start 2024-08-17T02:50:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.616+0000 7f743b200640 1 -- start start 2024-08-17T02:50:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.617+0000 7f743b200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f743c06e8b0 0x7f743c159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.617+0000 7f743b200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f743c06ed00 0x7f743c16d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:23.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.617+0000 7f743b200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f743c0aa4e0 0x7f743c140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:23.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.617+0000 7f743b200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c15a230 con 0x7f743c0aa4e0 2024-08-17T02:50:23.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.617+0000 7f743b200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c15a680 con 0x7f743c06ed00 2024-08-17T02:50:23.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.617+0000 7f743b200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c15a960 con 0x7f743c06e8b0 2024-08-17T02:50:23.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.618+0000 7f743a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f743c0aa4e0 0x7f743c140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:23.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.618+0000 7f743a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f743c0aa4e0 0x7f743c140e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36660/0 (socket says 172.21.15.5:36660) 2024-08-17T02:50:23.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.618+0000 7f743a800640 1 -- 172.21.15.5:0/990127775 learned_addr learned my addr 172.21.15.5:0/990127775 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:23.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.618+0000 7f7433e00640 1 --2- 172.21.15.5:0/990127775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f743c06ed00 0x7f743c16d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:23.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.618+0000 7f7439e00640 1 --2- 172.21.15.5:0/990127775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f743c06e8b0 0x7f743c159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:23.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.618+0000 7f743a800640 1 -- 172.21.15.5:0/990127775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f743c06e8b0 msgr2=0x7f743c159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:23.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.618+0000 7f743a800640 1 --2- 172.21.15.5:0/990127775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f743c06e8b0 0x7f743c159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:23.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.618+0000 7f743a800640 1 -- 172.21.15.5:0/990127775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f743c06ed00 msgr2=0x7f743c16d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:23.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.618+0000 7f743a800640 1 --2- 172.21.15.5:0/990127775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f743c06ed00 0x7f743c16d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:23.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.618+0000 7f743a800640 1 -- 172.21.15.5:0/990127775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c009390 con 0x7f743c0aa4e0 2024-08-17T02:50:23.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.618+0000 7f743a800640 1 --2- 172.21.15.5:0/990127775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f743c0aa4e0 0x7f743c140e50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f743400c910 tx=0x7f74340026f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:23.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.619+0000 7f7431600640 1 -- 172.21.15.5:0/990127775 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743400cea0 con 0x7f743c0aa4e0 2024-08-17T02:50:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.619+0000 7f7431600640 1 -- 172.21.15.5:0/990127775 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743400a850 con 0x7f743c0aa4e0 2024-08-17T02:50:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.619+0000 7f7431600640 1 -- 172.21.15.5:0/990127775 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743400ac70 con 0x7f743c0aa4e0 2024-08-17T02:50:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.619+0000 7f743b200640 1 -- 172.21.15.5:0/990127775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c15ac40 con 0x7f743c0aa4e0 2024-08-17T02:50:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.619+0000 7f743b200640 1 -- 172.21.15.5:0/990127775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c15b440 con 0x7f743c0aa4e0 2024-08-17T02:50:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.620+0000 7f743b200640 1 -- 172.21.15.5:0/990127775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743c15a3a0 con 0x7f743c0aa4e0 2024-08-17T02:50:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.621+0000 7f7431600640 1 -- 172.21.15.5:0/990127775 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7434012630 con 0x7f743c0aa4e0 2024-08-17T02:50:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.621+0000 7f7431600640 1 --2- 172.21.15.5:0/990127775 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7418065150 0x7f7418067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:23.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.622+0000 7f7431600640 1 -- 172.21.15.5:0/990127775 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7434082400 con 0x7f743c0aa4e0 2024-08-17T02:50:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.622+0000 7f7439e00640 1 --2- 172.21.15.5:0/990127775 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7418065150 0x7f7418067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.622+0000 7f7439e00640 1 --2- 172.21.15.5:0/990127775 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7418065150 0x7f7418067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f742c034000 tx=0x7f742c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:23.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.625+0000 7f7431600640 1 -- 172.21.15.5:0/990127775 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7434050770 con 0x7f743c0aa4e0 2024-08-17T02:50:23.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.808+0000 7f743b200640 1 -- 172.21.15.5:0/990127775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f743c070720 con 0x7f743c0aa4e0 2024-08-17T02:50:23.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.809+0000 7f7431600640 1 -- 172.21.15.5:0/990127775 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12339 (secure 0 0 0) 0x7f7434053d90 con 0x7f743c0aa4e0 2024-08-17T02:50:23.809 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:23.810 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":43,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:50:20.485827+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6837/1768626934":"2024-08-18T02:50:17.313643+0000","172.21.15.5:6835/1768626934":"2024-08-18T02:50:17.313643+0000","172.21.15.5:6836/723455700":"2024-08-18T02:50:10.445560+0000","172.21.15.5:6834/723455700":"2024-08-18T02:50:10.445560+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:50:23.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.811+0000 7f743b200640 1 -- 172.21.15.5:0/990127775 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7418065150 msgr2=0x7f7418067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:23.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.811+0000 7f743b200640 1 --2- 172.21.15.5:0/990127775 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7418065150 0x7f7418067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f742c034000 tx=0x7f742c032000 comp rx=0 tx=0).stop 2024-08-17T02:50:23.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.811+0000 7f743b200640 1 -- 172.21.15.5:0/990127775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f743c0aa4e0 msgr2=0x7f743c140e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:23.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.811+0000 7f743b200640 1 --2- 172.21.15.5:0/990127775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f743c0aa4e0 0x7f743c140e50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f743400c910 tx=0x7f74340026f0 comp rx=0 tx=0).stop 2024-08-17T02:50:23.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.811+0000 7f743b200640 1 -- 172.21.15.5:0/990127775 shutdown_connections 2024-08-17T02:50:23.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.811+0000 7f743b200640 1 --2- 172.21.15.5:0/990127775 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f7418065150 0x7f7418067600 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:23.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.811+0000 7f743b200640 1 --2- 172.21.15.5:0/990127775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f743c0aa4e0 0x7f743c140e50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:23.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.811+0000 7f743b200640 1 --2- 172.21.15.5:0/990127775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f743c06ed00 0x7f743c16d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.811+0000 7f743b200640 1 --2- 172.21.15.5:0/990127775 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f743c06e8b0 0x7f743c159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.811+0000 7f743b200640 1 -- 172.21.15.5:0/990127775 >> 172.21.15.5:0/990127775 conn(0x7f743c066e60 msgr2=0x7f743c0acdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.811+0000 7f743b200640 1 -- 172.21.15.5:0/990127775 shutdown_connections 2024-08-17T02:50:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.811+0000 7f743b200640 1 -- 172.21.15.5:0/990127775 wait complete. 2024-08-17T02:50:23.827 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:50:23.827 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:50:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.978+0000 7fdc1f000640 1 Processor -- start 2024-08-17T02:50:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.979+0000 7fdc1f000640 1 -- start start 2024-08-17T02:50:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.980+0000 7fdc1f000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdc18158d50 0x7fdc180ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.980+0000 7fdc1f000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc18159120 0x7fdc180ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.980+0000 7fdc1f000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc180a96c0 con 0x7fdc180ac9e0 2024-08-17T02:50:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.980+0000 7fdc1f000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc180acf00 con 0x7fdc18159120 2024-08-17T02:50:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.980+0000 7fdc1f000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc180af7d0 con 0x7fdc18158d50 2024-08-17T02:50:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.980+0000 7fdc1d000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdc180ac9e0 0x7fdc18066e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51394/0 (socket says 172.21.15.5:51394) 2024-08-17T02:50:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.980+0000 7fdc1d000640 1 -- 172.21.15.5:0/1660925546 learned_addr learned my addr 172.21.15.5:0/1660925546 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.980+0000 7fdc0fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc18159120 0x7fdc180ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.980+0000 7fdc17e00640 1 --2- 172.21.15.5:0/1660925546 >> v2:172.21.15.107:3300/0 conn(0x7fdc18158d50 0x7fdc180ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.981+0000 7fdc0fe00640 1 -- 172.21.15.5:0/1660925546 >> v2:172.21.15.107:3300/0 conn(0x7fdc18158d50 msgr2=0x7fdc180ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.981+0000 7fdc0fe00640 1 --2- 172.21.15.5:0/1660925546 >> v2:172.21.15.107:3300/0 conn(0x7fdc18158d50 0x7fdc180ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.981+0000 7fdc0fe00640 1 -- 172.21.15.5:0/1660925546 >> v1:172.21.15.5:6789/0 conn(0x7fdc180ac9e0 legacy=0x7fdc18066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.981+0000 7fdc0fe00640 1 -- 172.21.15.5:0/1660925546 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc180a98f0 con 0x7fdc18159120 2024-08-17T02:50:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.981+0000 7fdc17400640 1 -- 172.21.15.5:0/1660925546 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645674628 0 0) 0x7fdc180a96c0 con 0x7fdc180ac9e0 2024-08-17T02:50:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.982+0000 7fdc0fe00640 1 --2- 172.21.15.5:0/1660925546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc18159120 0x7fdc180ab8f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdc1806ecf0 tx=0x7fdc000090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38cf69888f31d8a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.982+0000 7fdc17400640 1 -- 172.21.15.5:0/1660925546 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0002ad20 con 0x7fdc18159120 2024-08-17T02:50:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.982+0000 7fdc17400640 1 -- 172.21.15.5:0/1660925546 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0002ae80 con 0x7fdc18159120 2024-08-17T02:50:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.982+0000 7fdc17400640 1 -- 172.21.15.5:0/1660925546 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00032670 con 0x7fdc18159120 2024-08-17T02:50:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.982+0000 7fdc1f000640 1 -- 172.21.15.5:0/1660925546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc18159120 msgr2=0x7fdc180ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.982+0000 7fdc1f000640 1 --2- 172.21.15.5:0/1660925546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc18159120 0x7fdc180ab8f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdc1806ecf0 tx=0x7fdc000090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.983+0000 7fdc1f000640 1 -- 172.21.15.5:0/1660925546 shutdown_connections 2024-08-17T02:50:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.983+0000 7fdc1f000640 1 --2- 172.21.15.5:0/1660925546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc18159120 0x7fdc180ab8f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.983+0000 7fdc1f000640 1 --2- 172.21.15.5:0/1660925546 >> v2:172.21.15.107:3300/0 conn(0x7fdc18158d50 0x7fdc180ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.983+0000 7fdc1f000640 1 -- 172.21.15.5:0/1660925546 >> 172.21.15.5:0/1660925546 conn(0x7fdc18095a70 msgr2=0x7fdc18095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.983+0000 7fdc1f000640 1 -- 172.21.15.5:0/1660925546 shutdown_connections 2024-08-17T02:50:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.983+0000 7fdc1f000640 1 -- 172.21.15.5:0/1660925546 wait complete. 2024-08-17T02:50:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.984+0000 7fdc1f000640 1 Processor -- start 2024-08-17T02:50:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.984+0000 7fdc1f000640 1 -- start start 2024-08-17T02:50:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.985+0000 7fdc1f000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc180ac9e0 0x7fdc18169460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.985+0000 7fdc1f000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc18158d50 0x7fdc1815b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.985+0000 7fdc1f000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc18159120 0x7fdc18067090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.985+0000 7fdc1f000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1815c7c0 con 0x7fdc18159120 2024-08-17T02:50:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.985+0000 7fdc1f000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc181699a0 con 0x7fdc180ac9e0 2024-08-17T02:50:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.985+0000 7fdc1f000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1815bf20 con 0x7fdc18158d50 2024-08-17T02:50:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.985+0000 7fdc1d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc18159120 0x7fdc18067090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.986+0000 7fdc1d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc18159120 0x7fdc18067090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36678/0 (socket says 172.21.15.5:36678) 2024-08-17T02:50:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.986+0000 7fdc1d000640 1 -- 172.21.15.5:0/3803705200 learned_addr learned my addr 172.21.15.5:0/3803705200 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.986+0000 7fdc17e00640 1 --2- 172.21.15.5:0/3803705200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc180ac9e0 0x7fdc18169460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.986+0000 7fdc0fe00640 1 --2- 172.21.15.5:0/3803705200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc18158d50 0x7fdc1815b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.986+0000 7fdc1d000640 1 -- 172.21.15.5:0/3803705200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc18158d50 msgr2=0x7fdc1815b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.986+0000 7fdc1d000640 1 --2- 172.21.15.5:0/3803705200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc18158d50 0x7fdc1815b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.986+0000 7fdc1d000640 1 -- 172.21.15.5:0/3803705200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc180ac9e0 msgr2=0x7fdc18169460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.986+0000 7fdc1d000640 1 --2- 172.21.15.5:0/3803705200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc180ac9e0 0x7fdc18169460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.986+0000 7fdc1d000640 1 -- 172.21.15.5:0/3803705200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc00009390 con 0x7fdc18159120 2024-08-17T02:50:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.986+0000 7fdc0fe00640 1 --2- 172.21.15.5:0/3803705200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc18158d50 0x7fdc1815b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.986+0000 7fdc1d000640 1 --2- 172.21.15.5:0/3803705200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc18159120 0x7fdc18067090 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000cc90 tx=0x7fdc10001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.987+0000 7fdc0f400640 1 -- 172.21.15.5:0/3803705200 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1000a850 con 0x7fdc18159120 2024-08-17T02:50:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.987+0000 7fdc0f400640 1 -- 172.21.15.5:0/3803705200 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1000a9b0 con 0x7fdc18159120 2024-08-17T02:50:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.987+0000 7fdc0f400640 1 -- 172.21.15.5:0/3803705200 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1000ad70 con 0x7fdc18159120 2024-08-17T02:50:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.987+0000 7fdc1f000640 1 -- 172.21.15.5:0/3803705200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1815c200 con 0x7fdc18159120 2024-08-17T02:50:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.987+0000 7fdc1f000640 1 -- 172.21.15.5:0/3803705200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1815bac0 con 0x7fdc18159120 2024-08-17T02:50:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.988+0000 7fdc1f000640 1 -- 172.21.15.5:0/3803705200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc180afee0 con 0x7fdc18159120 2024-08-17T02:50:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.989+0000 7fdc0f400640 1 -- 172.21.15.5:0/3803705200 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdc10007300 con 0x7fdc18159120 2024-08-17T02:50:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.989+0000 7fdc0f400640 1 --2- 172.21.15.5:0/3803705200 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fdbf4065150 0x7fdbf4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.989+0000 7fdc0f400640 1 -- 172.21.15.5:0/3803705200 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fdc10082390 con 0x7fdc18159120 2024-08-17T02:50:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.990+0000 7fdc17e00640 1 --2- 172.21.15.5:0/3803705200 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fdbf4065150 0x7fdbf4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.990+0000 7fdc17e00640 1 --2- 172.21.15.5:0/3803705200 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fdbf4065150 0x7fdbf4067600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009d20 tx=0x7fdc080090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:23.993+0000 7fdc0f400640 1 -- 172.21.15.5:0/3803705200 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdc10050700 con 0x7fdc18159120 2024-08-17T02:50:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.174+0000 7fdc1f000640 1 -- 172.21.15.5:0/3803705200 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc1815bd10 con 0x7fdbf4065150 2024-08-17T02:50:24.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.176+0000 7fdc0f400640 1 -- 172.21.15.5:0/3803705200 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51067 (secure 0 0 0) 0x7fdc1815bd10 con 0x7fdbf4065150 2024-08-17T02:50:24.177 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:24.178 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:50:24.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.178+0000 7fdc1f000640 1 -- 172.21.15.5:0/3803705200 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fdbf4065150 msgr2=0x7fdbf4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:24.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.178+0000 7fdc1f000640 1 --2- 172.21.15.5:0/3803705200 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fdbf4065150 0x7fdbf4067600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009d20 tx=0x7fdc080090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.178+0000 7fdc1f000640 1 -- 172.21.15.5:0/3803705200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc18159120 msgr2=0x7fdc18067090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:24.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.178+0000 7fdc1f000640 1 --2- 172.21.15.5:0/3803705200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc18159120 0x7fdc18067090 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000cc90 tx=0x7fdc10001a20 comp rx=0 tx=0).stop 2024-08-17T02:50:24.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.178+0000 7fdc1f000640 1 -- 172.21.15.5:0/3803705200 shutdown_connections 2024-08-17T02:50:24.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.178+0000 7fdc1f000640 1 --2- 172.21.15.5:0/3803705200 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fdbf4065150 0x7fdbf4067600 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.178+0000 7fdc1f000640 1 --2- 172.21.15.5:0/3803705200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc18159120 0x7fdc18067090 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.178+0000 7fdc1f000640 1 --2- 172.21.15.5:0/3803705200 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdc18158d50 0x7fdc1815b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.178+0000 7fdc1f000640 1 --2- 172.21.15.5:0/3803705200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc180ac9e0 0x7fdc18169460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.178+0000 7fdc1f000640 1 -- 172.21.15.5:0/3803705200 >> 172.21.15.5:0/3803705200 conn(0x7fdc18095a70 msgr2=0x7fdc1806be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:24.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.178+0000 7fdc1f000640 1 -- 172.21.15.5:0/3803705200 shutdown_connections 2024-08-17T02:50:24.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.179+0000 7fdc1f000640 1 -- 172.21.15.5:0/3803705200 wait complete. 2024-08-17T02:50:24.194 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-08-17T02:50:23.106060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400568,"kb_used_data":5064,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574152,"statfs":{"total":773094113280,"available":770635931648,"internally_reserved":0,"allocated":5185536,"data_stored":2855976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001253"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:50:20.451992+0000","last_change":"2024-08-17T02:46:48.424689+0000","last_active":"2024-08-17T02:50:20.451992+0000","last_peered":"2024-08-17T02:50:20.451992+0000","last_clean":"2024-08-17T02:50:20.451992+0000","last_became_active":"2024-08-17T02:46:48.423437+0000","last_became_peered":"2024-08-17T02:46:48.423437+0000","last_unstale":"2024-08-17T02:50:20.451992+0000","last_undegraded":"2024-08-17T02:50:20.451992+0000","last_fullsized":"2024-08-17T02:50:20.451992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.106569+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:50.533980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1105920,"data_stored":804631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.66800000000000004,"15min":0.63500000000000001},"min":{"1min":0.65900000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.69899999999999995,"15min":0.67000000000000004},"min":{"1min":0.70299999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90600000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56499999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.64800000000000002,"15min":0.63600000000000001},"min":{"1min":0.63200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.63600000000000001,"15min":0.60599999999999998},"min":{"1min":0.60499999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92400000000000004,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.52700000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.69599999999999995,"15min":0.66800000000000004},"min":{"1min":0.70199999999999996,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95199999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.72899999999999998,"15min":0.72099999999999997},"min":{"1min":0.56699999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.62}]},{"osd":3,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.55400000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.875,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.70799999999999996,"15min":0.69399999999999995},"min":{"1min":0.63100000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66900000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69399999999999995,"15min":0.70899999999999996},"min":{"1min":0.53200000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70499999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63100000000000001,"15min":0.64300000000000002},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.46100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.76500000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.84799999999999998,"5min":1.024,"15min":1.024},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65700000000000003,"15min":0.66900000000000004},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297840,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":495616,"data_stored":208615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.56599999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.878,"5min":0.996,"15min":0.996},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.69599999999999995},"min":{"1min":0.57099999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88700000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.67800000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82999999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.74199999999999999,"15min":0.72799999999999998},"min":{"1min":0.65300000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.84599999999999997,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72199999999999998,"15min":0.71599999999999997},"min":{"1min":0.67300000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90600000000000003,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.66800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.88100000000000001,"5min":1.458,"15min":1.458},"last":0.80500000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.63800000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92200000000000004,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69799999999999995,"15min":0.69199999999999995},"min":{"1min":0.53700000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.81299999999999994,"5min":1.099,"15min":1.099},"last":0.65700000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84999999999999998,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":1.55,"15min":1.55},"last":0.73199999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.65600000000000003},"min":{"1min":0.49199999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88300000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.69899999999999995,"15min":0.73399999999999999},"min":{"1min":0.46400000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.86199999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73099999999999998,"15min":0.77200000000000002},"min":{"1min":0.46600000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84099999999999997,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.499,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85299999999999998,"5min":1.077,"15min":1.077},"last":0.79100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":495616,"data_stored":208615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.65700000000000003,"15min":0.63400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96399999999999997,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.877},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.63800000000000001,"15min":0.60599999999999998},"min":{"1min":0.52100000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88800000000000001,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.97299999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.65400000000000003,"15min":0.627},"min":{"1min":0.61499999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92100000000000004,"5min":1.095,"15min":1.095},"last":0.996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.68999999999999995,"15min":0.66400000000000003},"min":{"1min":0.47399999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.81999999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71499999999999997,"15min":0.69099999999999995},"min":{"1min":0.67200000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.53100000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98899999999999999,"5min":1.25,"15min":1.25},"last":1.0309999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.68799999999999994,"15min":0.66300000000000003},"min":{"1min":0.64400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.90200000000000002,"5min":1.014,"15min":1.014},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70499999999999996,"15min":0.69599999999999995},"min":{"1min":0.54700000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.91600000000000004,"5min":1.087,"15min":1.087},"last":0.92600000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.65000000000000002},"min":{"1min":0.47099999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81100000000000005,"5min":1.206,"15min":1.206},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70999999999999996,"15min":0.71599999999999997},"min":{"1min":0.435,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89100000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.749}]},{"osd":6,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64500000000000002,"15min":0.65600000000000003},"min":{"1min":0.47899999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.76900000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.871,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.69699999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.54800000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.90600000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.53300000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.77800000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297836,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074004,"statfs":{"total":96636764160,"available":96331780096,"internally_reserved":0,"allocated":491520,"data_stored":204044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.52500000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92300000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67200000000000004,"15min":0.65400000000000003},"min":{"1min":0.55700000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89200000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.624}]},{"osd":1,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67400000000000004,"15min":0.65200000000000002},"min":{"1min":0.59699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85899999999999999,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.57299999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85499999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69499999999999995,"15min":0.66900000000000004},"min":{"1min":0.63800000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.55700000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89700000000000002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67900000000000005,"15min":0.65900000000000003},"min":{"1min":0.55900000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93899999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.72399999999999998,"15min":0.71199999999999997},"min":{"1min":0.62,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91000000000000003,"5min":1.022,"15min":1.022},"last":0.77500000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79800000000000004,"5min":0.999,"15min":0.999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89200000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.84599999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.89100000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.47299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89300000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.79700000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.51300000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94599999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72399999999999998},"min":{"1min":0.54200000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91600000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.91300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.40899999999999997},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.44400000000000001,"15min":0.42799999999999999},"min":{"1min":0.32600000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.746,"5min":0.879,"15min":0.879},"last":0.377}]},{"osd":1,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.41899999999999998},"min":{"1min":0.34699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71299999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.501,"15min":0.496},"min":{"1min":0.39200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.35399999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54700000000000004,"15min":0.52900000000000003},"min":{"1min":0.438,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.748,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.504}]},{"osd":4,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75,"15min":0.76000000000000001},"min":{"1min":0.56200000000000006,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93600000000000005,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78500000000000003,"15min":0.80200000000000005},"min":{"1min":0.60099999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91600000000000004,"5min":1.196,"15min":1.196},"last":0.58699999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.82599999999999996},"min":{"1min":0.65200000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.96399999999999997,"5min":1.704,"15min":1.704},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79400000000000004,"15min":0.80800000000000005},"min":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0580000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.626,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.091,"5min":1.21,"15min":1.21},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.57699999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98599999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.68799999999999994}]},{"osd":7,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.60499999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92500000000000004,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81499999999999995,"15min":0.82999999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0089999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.621}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.309,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67600000000000005,"5min":1.417,"15min":1.417},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.498,"15min":0.5},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.60299999999999998,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.35999999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59899999999999998,"15min":0.621},"min":{"1min":0.40500000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73499999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.47699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.79500000000000004,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.437}]},{"osd":3,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.496},"min":{"1min":0.33500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.67600000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.48599999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.72999999999999998,"5min":1.343,"15min":1.343},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80200000000000005,"15min":0.79200000000000004},"min":{"1min":0.67400000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.03,"5min":1.466,"15min":1.466},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.61399999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.03,"5min":1.548,"15min":1.548},"last":0.75600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.80100000000000005,"15min":0.79000000000000004},"min":{"1min":0.57699999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0680000000000001,"5min":1.617,"15min":1.617},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.77700000000000002},"min":{"1min":0.57999999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93300000000000005,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.81899999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82299999999999995,"15min":0.81899999999999995},"min":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.079,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.66100000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0249999999999999,"5min":1.5,"15min":1.5},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.83499999999999996,"15min":0.83899999999999997},"min":{"1min":0.59699999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.99299999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.117,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301988,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":483328,"data_stored":202562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34499999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64000000000000001,"5min":1.093,"15min":1.093},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71599999999999997,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.46899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65700000000000003,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":0.316},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.48599999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72599999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.35199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.64400000000000002},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.754,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.39600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81599999999999995,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.51400000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85899999999999999,"15min":0.875},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2809999999999999,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.85499999999999998,"15min":0.872},"min":{"1min":0.67800000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1619999999999999,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.874,"15min":0.90200000000000002},"min":{"1min":0.625,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3859999999999999,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.628},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.83199999999999996},"min":{"1min":0.65600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.24,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.82799999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.874,"15min":0.89400000000000002},"min":{"1min":0.61199999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.2130000000000001,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.875,"5min":0.89000000000000001,"15min":0.91600000000000004},"min":{"1min":0.63700000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.302,"5min":3.3820000000000001,"15min":3.3820000000000001},"last":0.66800000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86199999999999999,"15min":0.871},"min":{"1min":0.61399999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1200000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.875,"15min":0.88700000000000001},"min":{"1min":0.65100000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.272,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":0.85799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302584,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069256,"statfs":{"total":96636764160,"available":96326918144,"internally_reserved":0,"allocated":1089536,"data_stored":798983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48099999999999998,"15min":0.47699999999999998},"min":{"1min":0.33900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.748,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.46100000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.496}]},{"osd":2,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47699999999999998,"15min":0.46700000000000003},"min":{"1min":0.38500000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.40999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.68700000000000006,"5min":1.702,"15min":1.702},"last":0.56899999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.47799999999999998,"15min":0.46700000000000003},"min":{"1min":0.35999999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.624,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.48499999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71899999999999997,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.54000000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.79600000000000004,"15min":0.77800000000000002},"min":{"1min":0.63300000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.141,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.746},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78200000000000003,"15min":0.77000000000000002},"min":{"1min":0.61699999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.70899999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.82299999999999995,"15min":0.81699999999999995},"min":{"1min":0.69499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.413,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79300000000000004,"15min":0.79100000000000004},"min":{"1min":0.63700000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1359999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.69699999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.82199999999999995,"15min":0.80800000000000005},"min":{"1min":0.65600000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.216,"5min":1.784,"15min":1.784},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.58499999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.288,"5min":1.538,"15min":1.538},"last":0.67000000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.67200000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83399999999999996,"15min":0.82399999999999995},"min":{"1min":0.73099999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3500000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:50:24.195 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:50:24.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.345+0000 7f2fdbe00640 1 Processor -- start 2024-08-17T02:50:24.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.346+0000 7f2fdbe00640 1 -- start start 2024-08-17T02:50:24.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.347+0000 7f2fdbe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2fdc0b0e30 0x7f2fdc0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:24.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.347+0000 7f2fdbe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fdc15a590 0x7f2fdc13fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:24.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.347+0000 7f2fdbe00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc06d7c0 con 0x7f2fdc156f90 2024-08-17T02:50:24.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.347+0000 7f2fdbe00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fdc15ab30 con 0x7f2fdc15a590 2024-08-17T02:50:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.347+0000 7f2fdbe00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fdc15ae10 con 0x7f2fdc0b0e30 2024-08-17T02:50:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.347+0000 7f2fdb400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fdc15a590 0x7f2fdc13fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.347+0000 7f2fd3e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2fdc156f90 0x7f2fdc0cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51402/0 (socket says 172.21.15.5:51402) 2024-08-17T02:50:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.347+0000 7f2fd3e00640 1 -- 172.21.15.5:0/2608101786 learned_addr learned my addr 172.21.15.5:0/2608101786 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:24.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.347+0000 7f2fdaa00640 1 --2- 172.21.15.5:0/2608101786 >> v2:172.21.15.107:3300/0 conn(0x7f2fdc0b0e30 0x7f2fdc0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:24.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.348+0000 7f2fdaa00640 1 -- 172.21.15.5:0/2608101786 >> v2:172.21.15.5:3300/0 conn(0x7f2fdc15a590 msgr2=0x7f2fdc13fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:24.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.348+0000 7f2fdaa00640 1 --2- 172.21.15.5:0/2608101786 >> v2:172.21.15.5:3300/0 conn(0x7f2fdc15a590 0x7f2fdc13fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.348+0000 7f2fdaa00640 1 -- 172.21.15.5:0/2608101786 >> v1:172.21.15.5:6789/0 conn(0x7f2fdc156f90 legacy=0x7f2fdc0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:24.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.348+0000 7f2fdaa00640 1 -- 172.21.15.5:0/2608101786 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc15b0f0 con 0x7f2fdc0b0e30 2024-08-17T02:50:24.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.348+0000 7f2fda000640 1 -- 172.21.15.5:0/2608101786 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006707051 0 0) 0x7f2fdc06d7c0 con 0x7f2fdc156f90 2024-08-17T02:50:24.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.348+0000 7f2fdb400640 1 --2- 172.21.15.5:0/2608101786 >> v2:172.21.15.5:3300/0 conn(0x7f2fdc15a590 0x7f2fdc13fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:24.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.349+0000 7f2fdaa00640 1 --2- 172.21.15.5:0/2608101786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fdc0b0e30 0x7f2fdc0b1200 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0cb7e0 tx=0x7f2fcc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69e92c65ef20bc5e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:24.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.349+0000 7f2fda000640 1 -- 172.21.15.5:0/2608101786 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc02adb0 con 0x7f2fdc0b0e30 2024-08-17T02:50:24.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.349+0000 7f2fda000640 1 -- 172.21.15.5:0/2608101786 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc032440 con 0x7f2fdc0b0e30 2024-08-17T02:50:24.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.349+0000 7f2fda000640 1 -- 172.21.15.5:0/2608101786 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0327e0 con 0x7f2fdc0b0e30 2024-08-17T02:50:24.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.350+0000 7f2fdbe00640 1 -- 172.21.15.5:0/2608101786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fdc0b0e30 msgr2=0x7f2fdc0b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:24.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.350+0000 7f2fdbe00640 1 --2- 172.21.15.5:0/2608101786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fdc0b0e30 0x7f2fdc0b1200 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0cb7e0 tx=0x7f2fcc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.350+0000 7f2fdbe00640 1 -- 172.21.15.5:0/2608101786 shutdown_connections 2024-08-17T02:50:24.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.350+0000 7f2fdbe00640 1 --2- 172.21.15.5:0/2608101786 >> v2:172.21.15.5:3300/0 conn(0x7f2fdc15a590 0x7f2fdc13fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.350+0000 7f2fdbe00640 1 --2- 172.21.15.5:0/2608101786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fdc0b0e30 0x7f2fdc0b1200 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.350+0000 7f2fdbe00640 1 -- 172.21.15.5:0/2608101786 >> 172.21.15.5:0/2608101786 conn(0x7f2fdc062af0 msgr2=0x7f2fdc062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:24.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.350+0000 7f2fdbe00640 1 -- 172.21.15.5:0/2608101786 shutdown_connections 2024-08-17T02:50:24.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.350+0000 7f2fdbe00640 1 -- 172.21.15.5:0/2608101786 wait complete. 2024-08-17T02:50:24.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.351+0000 7f2fdbe00640 1 Processor -- start 2024-08-17T02:50:24.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.351+0000 7f2fdbe00640 1 -- start start 2024-08-17T02:50:24.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.352+0000 7f2fdbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc0b0e30 0x7f2fdc0c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:24.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.352+0000 7f2fdbe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2fdc156f90 0x7f2fdc1360e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:24.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.352+0000 7f2fdbe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fdc15a590 0x7f2fdc06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:24.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.352+0000 7f2fdbe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0c6eb0 con 0x7f2fdc0b0e30 2024-08-17T02:50:24.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.352+0000 7f2fdbe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0c58d0 con 0x7f2fdc15a590 2024-08-17T02:50:24.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.352+0000 7f2fdbe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0c5bb0 con 0x7f2fdc156f90 2024-08-17T02:50:24.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.353+0000 7f2fdaa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc0b0e30 0x7f2fdc0c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:24.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.353+0000 7f2fdaa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc0b0e30 0x7f2fdc0c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36704/0 (socket says 172.21.15.5:36704) 2024-08-17T02:50:24.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.353+0000 7f2fdaa00640 1 -- 172.21.15.5:0/3901464458 learned_addr learned my addr 172.21.15.5:0/3901464458 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:24.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.353+0000 7f2fdb400640 1 --2- 172.21.15.5:0/3901464458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fdc15a590 0x7f2fdc06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:24.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.353+0000 7f2fd3e00640 1 --2- 172.21.15.5:0/3901464458 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2fdc156f90 0x7f2fdc1360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:24.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.353+0000 7f2fdaa00640 1 -- 172.21.15.5:0/3901464458 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2fdc156f90 msgr2=0x7f2fdc1360e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:24.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.353+0000 7f2fdaa00640 1 --2- 172.21.15.5:0/3901464458 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2fdc156f90 0x7f2fdc1360e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.353+0000 7f2fdaa00640 1 -- 172.21.15.5:0/3901464458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fdc15a590 msgr2=0x7f2fdc06e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:24.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.353+0000 7f2fdaa00640 1 --2- 172.21.15.5:0/3901464458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fdc15a590 0x7f2fdc06e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.353+0000 7f2fdaa00640 1 -- 172.21.15.5:0/3901464458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd4009a20 con 0x7f2fdc0b0e30 2024-08-17T02:50:24.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.353+0000 7f2fdaa00640 1 --2- 172.21.15.5:0/3901464458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc0b0e30 0x7f2fdc0c6970 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc035040 tx=0x7f2fcc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:24.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.354+0000 7f2fd2000640 1 -- 172.21.15.5:0/3901464458 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc000d10 con 0x7f2fdc0b0e30 2024-08-17T02:50:24.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.354+0000 7f2fd2000640 1 -- 172.21.15.5:0/3901464458 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc031e00 con 0x7f2fdc0b0e30 2024-08-17T02:50:24.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.354+0000 7f2fd2000640 1 -- 172.21.15.5:0/3901464458 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc03d670 con 0x7f2fdc0b0e30 2024-08-17T02:50:24.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.354+0000 7f2fdbe00640 1 -- 172.21.15.5:0/3901464458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fcc009390 con 0x7f2fdc0b0e30 2024-08-17T02:50:24.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.354+0000 7f2fdbe00640 1 -- 172.21.15.5:0/3901464458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fdc0c6170 con 0x7f2fdc0b0e30 2024-08-17T02:50:24.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.355+0000 7f2fdbe00640 1 -- 172.21.15.5:0/3901464458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fdc070720 con 0x7f2fdc0b0e30 2024-08-17T02:50:24.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.356+0000 7f2fd2000640 1 -- 172.21.15.5:0/3901464458 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2fcc039040 con 0x7f2fdc0b0e30 2024-08-17T02:50:24.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.356+0000 7f2fd2000640 1 --2- 172.21.15.5:0/3901464458 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2fb8065150 0x7f2fb8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:24.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.356+0000 7f2fd2000640 1 -- 172.21.15.5:0/3901464458 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2fcc0a2240 con 0x7f2fdc0b0e30 2024-08-17T02:50:24.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.357+0000 7f2fd3e00640 1 --2- 172.21.15.5:0/3901464458 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2fb8065150 0x7f2fb8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:24.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.357+0000 7f2fd3e00640 1 --2- 172.21.15.5:0/3901464458 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2fb8065150 0x7f2fb8067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0c7ab0 tx=0x7f2fc4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:24.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.361+0000 7f2fd2000640 1 -- 172.21.15.5:0/3901464458 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2fcc070500 con 0x7f2fdc0b0e30 2024-08-17T02:50:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.542+0000 7f2fdbe00640 1 -- 172.21.15.5:0/3901464458 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2fdc06a470 con 0x7f2fb8065150 2024-08-17T02:50:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.544+0000 7f2fd2000640 1 -- 172.21.15.5:0/3901464458 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51067 (secure 0 0 0) 0x7f2fdc06a470 con 0x7f2fb8065150 2024-08-17T02:50:24.545 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:50:24.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.546+0000 7f2fdbe00640 1 -- 172.21.15.5:0/3901464458 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2fb8065150 msgr2=0x7f2fb8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:24.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.546+0000 7f2fdbe00640 1 --2- 172.21.15.5:0/3901464458 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2fb8065150 0x7f2fb8067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0c7ab0 tx=0x7f2fc4009040 comp rx=0 tx=0).stop 2024-08-17T02:50:24.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.546+0000 7f2fdbe00640 1 -- 172.21.15.5:0/3901464458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc0b0e30 msgr2=0x7f2fdc0c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:24.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.546+0000 7f2fdbe00640 1 --2- 172.21.15.5:0/3901464458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc0b0e30 0x7f2fdc0c6970 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc035040 tx=0x7f2fcc032000 comp rx=0 tx=0).stop 2024-08-17T02:50:24.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.547+0000 7f2fdbe00640 1 -- 172.21.15.5:0/3901464458 shutdown_connections 2024-08-17T02:50:24.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.547+0000 7f2fdbe00640 1 --2- 172.21.15.5:0/3901464458 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2fb8065150 0x7f2fb8067600 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.547+0000 7f2fdbe00640 1 --2- 172.21.15.5:0/3901464458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2fdc15a590 0x7f2fdc06e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.547+0000 7f2fdbe00640 1 --2- 172.21.15.5:0/3901464458 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2fdc156f90 0x7f2fdc1360e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.547+0000 7f2fdbe00640 1 --2- 172.21.15.5:0/3901464458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc0b0e30 0x7f2fdc0c6970 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.547+0000 7f2fdbe00640 1 -- 172.21.15.5:0/3901464458 >> 172.21.15.5:0/3901464458 conn(0x7f2fdc062af0 msgr2=0x7f2fdc158e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:24.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.547+0000 7f2fdbe00640 1 -- 172.21.15.5:0/3901464458 shutdown_connections 2024-08-17T02:50:24.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.547+0000 7f2fdbe00640 1 -- 172.21.15.5:0/3901464458 wait complete. 2024-08-17T02:50:24.562 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-08-17T02:50:23.106060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400568,"kb_used_data":5064,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574152,"statfs":{"total":773094113280,"available":770635931648,"internally_reserved":0,"allocated":5185536,"data_stored":2855976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001253"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:50:20.451992+0000","last_change":"2024-08-17T02:46:48.424689+0000","last_active":"2024-08-17T02:50:20.451992+0000","last_peered":"2024-08-17T02:50:20.451992+0000","last_clean":"2024-08-17T02:50:20.451992+0000","last_became_active":"2024-08-17T02:46:48.423437+0000","last_became_peered":"2024-08-17T02:46:48.423437+0000","last_unstale":"2024-08-17T02:50:20.451992+0000","last_undegraded":"2024-08-17T02:50:20.451992+0000","last_fullsized":"2024-08-17T02:50:20.451992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.106569+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:50.533980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1105920,"data_stored":804631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.66800000000000004,"15min":0.63500000000000001},"min":{"1min":0.65900000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.69899999999999995,"15min":0.67000000000000004},"min":{"1min":0.70299999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90600000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56499999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.64800000000000002,"15min":0.63600000000000001},"min":{"1min":0.63200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.63600000000000001,"15min":0.60599999999999998},"min":{"1min":0.60499999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92400000000000004,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.52700000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.69599999999999995,"15min":0.66800000000000004},"min":{"1min":0.70199999999999996,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95199999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.72899999999999998,"15min":0.72099999999999997},"min":{"1min":0.56699999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.62}]},{"osd":3,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.55400000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.875,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.70799999999999996,"15min":0.69399999999999995},"min":{"1min":0.63100000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66900000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69399999999999995,"15min":0.70899999999999996},"min":{"1min":0.53200000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70499999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63100000000000001,"15min":0.64300000000000002},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.46100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.76500000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.84799999999999998,"5min":1.024,"15min":1.024},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65700000000000003,"15min":0.66900000000000004},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297840,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":495616,"data_stored":208615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.56599999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.878,"5min":0.996,"15min":0.996},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.69599999999999995},"min":{"1min":0.57099999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88700000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.67800000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82999999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.74199999999999999,"15min":0.72799999999999998},"min":{"1min":0.65300000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.84599999999999997,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72199999999999998,"15min":0.71599999999999997},"min":{"1min":0.67300000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90600000000000003,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.66800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.88100000000000001,"5min":1.458,"15min":1.458},"last":0.80500000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.63800000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92200000000000004,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69799999999999995,"15min":0.69199999999999995},"min":{"1min":0.53700000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.81299999999999994,"5min":1.099,"15min":1.099},"last":0.65700000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84999999999999998,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":1.55,"15min":1.55},"last":0.73199999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.65600000000000003},"min":{"1min":0.49199999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88300000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.69899999999999995,"15min":0.73399999999999999},"min":{"1min":0.46400000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.86199999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73099999999999998,"15min":0.77200000000000002},"min":{"1min":0.46600000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84099999999999997,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.499,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85299999999999998,"5min":1.077,"15min":1.077},"last":0.79100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":495616,"data_stored":208615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.65700000000000003,"15min":0.63400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96399999999999997,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.877},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.63800000000000001,"15min":0.60599999999999998},"min":{"1min":0.52100000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88800000000000001,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.97299999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.65400000000000003,"15min":0.627},"min":{"1min":0.61499999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92100000000000004,"5min":1.095,"15min":1.095},"last":0.996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.68999999999999995,"15min":0.66400000000000003},"min":{"1min":0.47399999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.81999999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71499999999999997,"15min":0.69099999999999995},"min":{"1min":0.67200000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.53100000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98899999999999999,"5min":1.25,"15min":1.25},"last":1.0309999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.68799999999999994,"15min":0.66300000000000003},"min":{"1min":0.64400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.90200000000000002,"5min":1.014,"15min":1.014},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70499999999999996,"15min":0.69599999999999995},"min":{"1min":0.54700000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.91600000000000004,"5min":1.087,"15min":1.087},"last":0.92600000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.65000000000000002},"min":{"1min":0.47099999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81100000000000005,"5min":1.206,"15min":1.206},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70999999999999996,"15min":0.71599999999999997},"min":{"1min":0.435,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89100000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.749}]},{"osd":6,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64500000000000002,"15min":0.65600000000000003},"min":{"1min":0.47899999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.76900000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.871,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.69699999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.54800000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.90600000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.53300000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.77800000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297836,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074004,"statfs":{"total":96636764160,"available":96331780096,"internally_reserved":0,"allocated":491520,"data_stored":204044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.52500000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92300000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67200000000000004,"15min":0.65400000000000003},"min":{"1min":0.55700000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89200000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.624}]},{"osd":1,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67400000000000004,"15min":0.65200000000000002},"min":{"1min":0.59699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85899999999999999,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.57299999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85499999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69499999999999995,"15min":0.66900000000000004},"min":{"1min":0.63800000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.55700000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89700000000000002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67900000000000005,"15min":0.65900000000000003},"min":{"1min":0.55900000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93899999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.72399999999999998,"15min":0.71199999999999997},"min":{"1min":0.62,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91000000000000003,"5min":1.022,"15min":1.022},"last":0.77500000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79800000000000004,"5min":0.999,"15min":0.999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89200000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.84599999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.89100000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.47299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89300000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.79700000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.51300000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94599999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72399999999999998},"min":{"1min":0.54200000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91600000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.91300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.40899999999999997},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.44400000000000001,"15min":0.42799999999999999},"min":{"1min":0.32600000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.746,"5min":0.879,"15min":0.879},"last":0.377}]},{"osd":1,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.41899999999999998},"min":{"1min":0.34699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71299999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.501,"15min":0.496},"min":{"1min":0.39200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.35399999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54700000000000004,"15min":0.52900000000000003},"min":{"1min":0.438,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.748,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.504}]},{"osd":4,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75,"15min":0.76000000000000001},"min":{"1min":0.56200000000000006,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93600000000000005,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78500000000000003,"15min":0.80200000000000005},"min":{"1min":0.60099999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91600000000000004,"5min":1.196,"15min":1.196},"last":0.58699999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.82599999999999996},"min":{"1min":0.65200000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.96399999999999997,"5min":1.704,"15min":1.704},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79400000000000004,"15min":0.80800000000000005},"min":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0580000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.626,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.091,"5min":1.21,"15min":1.21},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.57699999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98599999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.68799999999999994}]},{"osd":7,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.60499999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92500000000000004,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81499999999999995,"15min":0.82999999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0089999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.621}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.309,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67600000000000005,"5min":1.417,"15min":1.417},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.498,"15min":0.5},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.60299999999999998,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.35999999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59899999999999998,"15min":0.621},"min":{"1min":0.40500000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73499999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.47699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.79500000000000004,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.437}]},{"osd":3,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.496},"min":{"1min":0.33500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.67600000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.48599999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.72999999999999998,"5min":1.343,"15min":1.343},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80200000000000005,"15min":0.79200000000000004},"min":{"1min":0.67400000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.03,"5min":1.466,"15min":1.466},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.61399999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.03,"5min":1.548,"15min":1.548},"last":0.75600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.80100000000000005,"15min":0.79000000000000004},"min":{"1min":0.57699999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0680000000000001,"5min":1.617,"15min":1.617},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.77700000000000002},"min":{"1min":0.57999999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93300000000000005,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.81899999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82299999999999995,"15min":0.81899999999999995},"min":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.079,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.66100000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0249999999999999,"5min":1.5,"15min":1.5},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.83499999999999996,"15min":0.83899999999999997},"min":{"1min":0.59699999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.99299999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.117,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301988,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":483328,"data_stored":202562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34499999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64000000000000001,"5min":1.093,"15min":1.093},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71599999999999997,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.46899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65700000000000003,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":0.316},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.48599999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72599999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.35199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.64400000000000002},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.754,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.39600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81599999999999995,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.51400000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85899999999999999,"15min":0.875},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2809999999999999,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.85499999999999998,"15min":0.872},"min":{"1min":0.67800000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1619999999999999,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.874,"15min":0.90200000000000002},"min":{"1min":0.625,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3859999999999999,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.628},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.83199999999999996},"min":{"1min":0.65600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.24,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.82799999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.874,"15min":0.89400000000000002},"min":{"1min":0.61199999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.2130000000000001,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.875,"5min":0.89000000000000001,"15min":0.91600000000000004},"min":{"1min":0.63700000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.302,"5min":3.3820000000000001,"15min":3.3820000000000001},"last":0.66800000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86199999999999999,"15min":0.871},"min":{"1min":0.61399999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1200000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.875,"15min":0.88700000000000001},"min":{"1min":0.65100000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.272,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":0.85799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302584,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069256,"statfs":{"total":96636764160,"available":96326918144,"internally_reserved":0,"allocated":1089536,"data_stored":798983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48099999999999998,"15min":0.47699999999999998},"min":{"1min":0.33900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.748,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.46100000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.496}]},{"osd":2,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47699999999999998,"15min":0.46700000000000003},"min":{"1min":0.38500000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.40999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.68700000000000006,"5min":1.702,"15min":1.702},"last":0.56899999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.47799999999999998,"15min":0.46700000000000003},"min":{"1min":0.35999999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.624,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.48499999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71899999999999997,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.54000000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.79600000000000004,"15min":0.77800000000000002},"min":{"1min":0.63300000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.141,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.746},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78200000000000003,"15min":0.77000000000000002},"min":{"1min":0.61699999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.70899999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.82299999999999995,"15min":0.81699999999999995},"min":{"1min":0.69499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.413,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79300000000000004,"15min":0.79100000000000004},"min":{"1min":0.63700000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1359999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.69699999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.82199999999999995,"15min":0.80800000000000005},"min":{"1min":0.65600000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.216,"5min":1.784,"15min":1.784},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.58499999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.288,"5min":1.538,"15min":1.538},"last":0.67000000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.67200000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83399999999999996,"15min":0.82399999999999995},"min":{"1min":0.73099999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3500000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:50:24.564 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:50:24.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:50:24.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.715+0000 7f2ce6600640 1 Processor -- start 2024-08-17T02:50:24.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.715+0000 7f2ce6600640 1 -- start start 2024-08-17T02:50:24.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.716+0000 7f2ce6600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ce006dee0 0x7f2ce00b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:24.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.716+0000 7f2ce6600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce00aff30 con 0x7f2ce015cdc0 2024-08-17T02:50:24.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.716+0000 7f2ce6600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce00af320 con 0x7f2ce00b03c0 2024-08-17T02:50:24.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.716+0000 7f2ce6600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce00af600 con 0x7f2ce006dee0 2024-08-17T02:50:24.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.716+0000 7f2cdf400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2ce015cdc0 0x7f2ce00ae860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51416/0 (socket says 172.21.15.5:51416) 2024-08-17T02:50:24.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.716+0000 7f2cdf400640 1 -- 172.21.15.5:0/1293745401 learned_addr learned my addr 172.21.15.5:0/1293745401 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:24.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.717+0000 7f2cdfe00640 1 --2- 172.21.15.5:0/1293745401 >> v2:172.21.15.5:3300/0 conn(0x7f2ce006dee0 0x7f2ce00b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:24.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.717+0000 7f2cde000640 1 -- 172.21.15.5:0/1293745401 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002076585 0 0) 0x7f2ce00aff30 con 0x7f2ce015cdc0 2024-08-17T02:50:24.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.717+0000 7f2cde000640 1 -- 172.21.15.5:0/1293745401 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cc40034e0 con 0x7f2ce015cdc0 2024-08-17T02:50:24.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.717+0000 7f2cdfe00640 1 -- 172.21.15.5:0/1293745401 >> v1:172.21.15.107:6789/0 conn(0x7f2ce00b03c0 legacy=0x7f2ce006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:24.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.717+0000 7f2cdfe00640 1 -- 172.21.15.5:0/1293745401 >> v1:172.21.15.5:6789/0 conn(0x7f2ce015cdc0 legacy=0x7f2ce00ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:24.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.717+0000 7f2cdfe00640 1 -- 172.21.15.5:0/1293745401 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce00af8e0 con 0x7f2ce006dee0 2024-08-17T02:50:24.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.718+0000 7f2cdfe00640 1 --2- 172.21.15.5:0/1293745401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce006dee0 0x7f2ce00b0840 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009e60 tx=0x7f2cd8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8636dfc2e05f8aef server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:24.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.718+0000 7f2cde000640 1 -- 172.21.15.5:0/1293745401 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8007550 con 0x7f2ce006dee0 2024-08-17T02:50:24.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.718+0000 7f2cde000640 1 -- 172.21.15.5:0/1293745401 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd802d050 con 0x7f2ce006dee0 2024-08-17T02:50:24.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.718+0000 7f2cde000640 1 -- 172.21.15.5:0/1293745401 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd80078c0 con 0x7f2ce006dee0 2024-08-17T02:50:24.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.719+0000 7f2ce6600640 1 -- 172.21.15.5:0/1293745401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce006dee0 msgr2=0x7f2ce00b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:24.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.719+0000 7f2ce6600640 1 --2- 172.21.15.5:0/1293745401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce006dee0 0x7f2ce00b0840 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009e60 tx=0x7f2cd8009780 comp rx=0 tx=0).stop 2024-08-17T02:50:24.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.719+0000 7f2ce6600640 1 -- 172.21.15.5:0/1293745401 shutdown_connections 2024-08-17T02:50:24.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.719+0000 7f2ce6600640 1 --2- 172.21.15.5:0/1293745401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce006dee0 0x7f2ce00b0840 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.719+0000 7f2ce6600640 1 -- 172.21.15.5:0/1293745401 >> 172.21.15.5:0/1293745401 conn(0x7f2ce0066e60 msgr2=0x7f2ce0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:24.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.719+0000 7f2ce6600640 1 -- 172.21.15.5:0/1293745401 shutdown_connections 2024-08-17T02:50:24.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.719+0000 7f2ce6600640 1 -- 172.21.15.5:0/1293745401 wait complete. 2024-08-17T02:50:24.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.720+0000 7f2ce6600640 1 Processor -- start 2024-08-17T02:50:24.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.721+0000 7f2ce6600640 1 -- start start 2024-08-17T02:50:24.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.721+0000 7f2ce6600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce006dee0 0x7f2ce0171660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:24.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.721+0000 7f2ce6600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ce00b03c0 0x7f2ce0153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:24.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.721+0000 7f2ce6600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ce015cdc0 0x7f2ce0156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:24.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.721+0000 7f2ce6600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce01583d0 con 0x7f2ce006dee0 2024-08-17T02:50:24.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.721+0000 7f2ce6600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce0156f50 con 0x7f2ce00b03c0 2024-08-17T02:50:24.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.721+0000 7f2ce6600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce01571d0 con 0x7f2ce015cdc0 2024-08-17T02:50:24.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.722+0000 7f2cdf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce006dee0 0x7f2ce0171660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:24.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.722+0000 7f2cdf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce006dee0 0x7f2ce0171660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36736/0 (socket says 172.21.15.5:36736) 2024-08-17T02:50:24.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.722+0000 7f2cdf400640 1 -- 172.21.15.5:0/631642580 learned_addr learned my addr 172.21.15.5:0/631642580 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.722+0000 7f2cdf400640 1 -- 172.21.15.5:0/631642580 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ce015cdc0 msgr2=0x7f2ce0156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.722+0000 7f2cdea00640 1 --2- 172.21.15.5:0/631642580 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ce00b03c0 0x7f2ce0153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.722+0000 7f2cdfe00640 1 --2- 172.21.15.5:0/631642580 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ce015cdc0 0x7f2ce0156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.722+0000 7f2cdf400640 1 --2- 172.21.15.5:0/631642580 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ce015cdc0 0x7f2ce0156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.722+0000 7f2cdf400640 1 -- 172.21.15.5:0/631642580 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ce00b03c0 msgr2=0x7f2ce0153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.722+0000 7f2cdf400640 1 --2- 172.21.15.5:0/631642580 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ce00b03c0 0x7f2ce0153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.722+0000 7f2cdf400640 1 -- 172.21.15.5:0/631642580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd8009a20 con 0x7f2ce006dee0 2024-08-17T02:50:24.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.722+0000 7f2cdea00640 1 --2- 172.21.15.5:0/631642580 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ce00b03c0 0x7f2ce0153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:24.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.722+0000 7f2cdfe00640 1 --2- 172.21.15.5:0/631642580 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ce015cdc0 0x7f2ce0156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:24.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.722+0000 7f2cdf400640 1 --2- 172.21.15.5:0/631642580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce006dee0 0x7f2ce0171660 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000c5c0 tx=0x7f2cd0007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:24.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.723+0000 7f2cd6a00640 1 -- 172.21.15.5:0/631642580 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0005b70 con 0x7f2ce006dee0 2024-08-17T02:50:24.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.723+0000 7f2cd6a00640 1 -- 172.21.15.5:0/631642580 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd0005cf0 con 0x7f2ce006dee0 2024-08-17T02:50:24.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.723+0000 7f2cd6a00640 1 -- 172.21.15.5:0/631642580 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0005ea0 con 0x7f2ce006dee0 2024-08-17T02:50:24.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.723+0000 7f2ce6600640 1 -- 172.21.15.5:0/631642580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce01574b0 con 0x7f2ce006dee0 2024-08-17T02:50:24.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.723+0000 7f2ce6600640 1 -- 172.21.15.5:0/631642580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce01585b0 con 0x7f2ce006dee0 2024-08-17T02:50:24.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.724+0000 7f2ce6600640 1 -- 172.21.15.5:0/631642580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce01587d0 con 0x7f2ce006dee0 2024-08-17T02:50:24.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.725+0000 7f2cd6a00640 1 -- 172.21.15.5:0/631642580 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2cd00075f0 con 0x7f2ce006dee0 2024-08-17T02:50:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.726+0000 7f2cd6a00640 1 --2- 172.21.15.5:0/631642580 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2cc0065150 0x7f2cc0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.726+0000 7f2cd6a00640 1 -- 172.21.15.5:0/631642580 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2cd0081730 con 0x7f2ce006dee0 2024-08-17T02:50:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.726+0000 7f2cdea00640 1 --2- 172.21.15.5:0/631642580 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2cc0065150 0x7f2cc0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:24.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.726+0000 7f2cdea00640 1 --2- 172.21.15.5:0/631642580 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2cc0065150 0x7f2cc0067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0160b80 tx=0x7f2ccc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:24.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.730+0000 7f2cd6a00640 1 -- 172.21.15.5:0/631642580 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2cd004f9f0 con 0x7f2ce006dee0 2024-08-17T02:50:24.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.910+0000 7f2ce6600640 1 -- 172.21.15.5:0/631642580 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ce0063fb0 con 0x7f2cc0065150 2024-08-17T02:50:24.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.912+0000 7f2cd6a00640 1 -- 172.21.15.5:0/631642580 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51067 (secure 0 0 0) 0x7f2ce0063fb0 con 0x7f2cc0065150 2024-08-17T02:50:24.913 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:24.914 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:50:24.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.914+0000 7f2ce6600640 1 -- 172.21.15.5:0/631642580 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2cc0065150 msgr2=0x7f2cc0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:24.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.914+0000 7f2ce6600640 1 --2- 172.21.15.5:0/631642580 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2cc0065150 0x7f2cc0067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0160b80 tx=0x7f2ccc009040 comp rx=0 tx=0).stop 2024-08-17T02:50:24.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.914+0000 7f2ce6600640 1 -- 172.21.15.5:0/631642580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce006dee0 msgr2=0x7f2ce0171660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:24.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.914+0000 7f2ce6600640 1 --2- 172.21.15.5:0/631642580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce006dee0 0x7f2ce0171660 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000c5c0 tx=0x7f2cd0007d70 comp rx=0 tx=0).stop 2024-08-17T02:50:24.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.915+0000 7f2ce6600640 1 -- 172.21.15.5:0/631642580 shutdown_connections 2024-08-17T02:50:24.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.915+0000 7f2ce6600640 1 --2- 172.21.15.5:0/631642580 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2cc0065150 0x7f2cc0067600 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.915+0000 7f2ce6600640 1 --2- 172.21.15.5:0/631642580 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2ce015cdc0 0x7f2ce0156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.915+0000 7f2ce6600640 1 --2- 172.21.15.5:0/631642580 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ce00b03c0 0x7f2ce0153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.915+0000 7f2ce6600640 1 --2- 172.21.15.5:0/631642580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce006dee0 0x7f2ce0171660 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:24.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.915+0000 7f2ce6600640 1 -- 172.21.15.5:0/631642580 >> 172.21.15.5:0/631642580 conn(0x7f2ce0066e60 msgr2=0x7f2ce015bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:24.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.915+0000 7f2ce6600640 1 -- 172.21.15.5:0/631642580 shutdown_connections 2024-08-17T02:50:24.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:24.915+0000 7f2ce6600640 1 -- 172.21.15.5:0/631642580 wait complete. 2024-08-17T02:50:24.930 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-08-17T02:50:23.106060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400568,"kb_used_data":5064,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574152,"statfs":{"total":773094113280,"available":770635931648,"internally_reserved":0,"allocated":5185536,"data_stored":2855976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001253"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:50:20.451992+0000","last_change":"2024-08-17T02:46:48.424689+0000","last_active":"2024-08-17T02:50:20.451992+0000","last_peered":"2024-08-17T02:50:20.451992+0000","last_clean":"2024-08-17T02:50:20.451992+0000","last_became_active":"2024-08-17T02:46:48.423437+0000","last_became_peered":"2024-08-17T02:46:48.423437+0000","last_unstale":"2024-08-17T02:50:20.451992+0000","last_undegraded":"2024-08-17T02:50:20.451992+0000","last_fullsized":"2024-08-17T02:50:20.451992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.106569+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:50.533980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1105920,"data_stored":804631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.66800000000000004,"15min":0.63500000000000001},"min":{"1min":0.65900000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.69899999999999995,"15min":0.67000000000000004},"min":{"1min":0.70299999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90600000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56499999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.64800000000000002,"15min":0.63600000000000001},"min":{"1min":0.63200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.63600000000000001,"15min":0.60599999999999998},"min":{"1min":0.60499999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92400000000000004,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.52700000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.69599999999999995,"15min":0.66800000000000004},"min":{"1min":0.70199999999999996,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95199999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.72899999999999998,"15min":0.72099999999999997},"min":{"1min":0.56699999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.62}]},{"osd":3,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.55400000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.875,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.70799999999999996,"15min":0.69399999999999995},"min":{"1min":0.63100000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66900000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69399999999999995,"15min":0.70899999999999996},"min":{"1min":0.53200000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70499999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63100000000000001,"15min":0.64300000000000002},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.46100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.76500000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.84799999999999998,"5min":1.024,"15min":1.024},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65700000000000003,"15min":0.66900000000000004},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297840,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":495616,"data_stored":208615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.56599999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.878,"5min":0.996,"15min":0.996},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.69599999999999995},"min":{"1min":0.57099999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88700000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.67800000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82999999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.74199999999999999,"15min":0.72799999999999998},"min":{"1min":0.65300000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.84599999999999997,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72199999999999998,"15min":0.71599999999999997},"min":{"1min":0.67300000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90600000000000003,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.66800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.88100000000000001,"5min":1.458,"15min":1.458},"last":0.80500000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.63800000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92200000000000004,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69799999999999995,"15min":0.69199999999999995},"min":{"1min":0.53700000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.81299999999999994,"5min":1.099,"15min":1.099},"last":0.65700000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84999999999999998,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":1.55,"15min":1.55},"last":0.73199999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.65600000000000003},"min":{"1min":0.49199999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88300000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.69899999999999995,"15min":0.73399999999999999},"min":{"1min":0.46400000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.86199999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73099999999999998,"15min":0.77200000000000002},"min":{"1min":0.46600000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84099999999999997,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.499,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85299999999999998,"5min":1.077,"15min":1.077},"last":0.79100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":495616,"data_stored":208615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.65700000000000003,"15min":0.63400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96399999999999997,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.877},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.63800000000000001,"15min":0.60599999999999998},"min":{"1min":0.52100000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88800000000000001,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.97299999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.65400000000000003,"15min":0.627},"min":{"1min":0.61499999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92100000000000004,"5min":1.095,"15min":1.095},"last":0.996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.68999999999999995,"15min":0.66400000000000003},"min":{"1min":0.47399999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.81999999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71499999999999997,"15min":0.69099999999999995},"min":{"1min":0.67200000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.53100000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98899999999999999,"5min":1.25,"15min":1.25},"last":1.0309999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.68799999999999994,"15min":0.66300000000000003},"min":{"1min":0.64400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.90200000000000002,"5min":1.014,"15min":1.014},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70499999999999996,"15min":0.69599999999999995},"min":{"1min":0.54700000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.91600000000000004,"5min":1.087,"15min":1.087},"last":0.92600000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.65000000000000002},"min":{"1min":0.47099999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81100000000000005,"5min":1.206,"15min":1.206},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70999999999999996,"15min":0.71599999999999997},"min":{"1min":0.435,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89100000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.749}]},{"osd":6,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64500000000000002,"15min":0.65600000000000003},"min":{"1min":0.47899999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.76900000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.871,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.69699999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.54800000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.90600000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.53300000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.77800000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297836,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074004,"statfs":{"total":96636764160,"available":96331780096,"internally_reserved":0,"allocated":491520,"data_stored":204044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.52500000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92300000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67200000000000004,"15min":0.65400000000000003},"min":{"1min":0.55700000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89200000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.624}]},{"osd":1,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67400000000000004,"15min":0.65200000000000002},"min":{"1min":0.59699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85899999999999999,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.57299999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85499999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69499999999999995,"15min":0.66900000000000004},"min":{"1min":0.63800000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.55700000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89700000000000002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67900000000000005,"15min":0.65900000000000003},"min":{"1min":0.55900000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93899999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.72399999999999998,"15min":0.71199999999999997},"min":{"1min":0.62,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91000000000000003,"5min":1.022,"15min":1.022},"last":0.77500000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79800000000000004,"5min":0.999,"15min":0.999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89200000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.84599999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.89100000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.47299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89300000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.79700000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.51300000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94599999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72399999999999998},"min":{"1min":0.54200000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91600000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.91300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.40899999999999997},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.44400000000000001,"15min":0.42799999999999999},"min":{"1min":0.32600000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.746,"5min":0.879,"15min":0.879},"last":0.377}]},{"osd":1,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.41899999999999998},"min":{"1min":0.34699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71299999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.501,"15min":0.496},"min":{"1min":0.39200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.35399999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54700000000000004,"15min":0.52900000000000003},"min":{"1min":0.438,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.748,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.504}]},{"osd":4,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75,"15min":0.76000000000000001},"min":{"1min":0.56200000000000006,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93600000000000005,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78500000000000003,"15min":0.80200000000000005},"min":{"1min":0.60099999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91600000000000004,"5min":1.196,"15min":1.196},"last":0.58699999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.82599999999999996},"min":{"1min":0.65200000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.96399999999999997,"5min":1.704,"15min":1.704},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79400000000000004,"15min":0.80800000000000005},"min":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0580000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.626,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.091,"5min":1.21,"15min":1.21},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.57699999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98599999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.68799999999999994}]},{"osd":7,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.60499999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92500000000000004,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81499999999999995,"15min":0.82999999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0089999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.621}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.309,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67600000000000005,"5min":1.417,"15min":1.417},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.498,"15min":0.5},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.60299999999999998,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.35999999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59899999999999998,"15min":0.621},"min":{"1min":0.40500000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73499999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.47699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.79500000000000004,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.437}]},{"osd":3,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.496},"min":{"1min":0.33500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.67600000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.48599999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.72999999999999998,"5min":1.343,"15min":1.343},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80200000000000005,"15min":0.79200000000000004},"min":{"1min":0.67400000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.03,"5min":1.466,"15min":1.466},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.61399999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.03,"5min":1.548,"15min":1.548},"last":0.75600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.80100000000000005,"15min":0.79000000000000004},"min":{"1min":0.57699999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0680000000000001,"5min":1.617,"15min":1.617},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.77700000000000002},"min":{"1min":0.57999999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93300000000000005,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.81899999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82299999999999995,"15min":0.81899999999999995},"min":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.079,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.66100000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0249999999999999,"5min":1.5,"15min":1.5},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.83499999999999996,"15min":0.83899999999999997},"min":{"1min":0.59699999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.99299999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.117,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301988,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":483328,"data_stored":202562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34499999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64000000000000001,"5min":1.093,"15min":1.093},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71599999999999997,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.46899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65700000000000003,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":0.316},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.48599999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72599999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.35199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.64400000000000002},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.754,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.39600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81599999999999995,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.51400000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85899999999999999,"15min":0.875},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2809999999999999,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.85499999999999998,"15min":0.872},"min":{"1min":0.67800000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1619999999999999,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.874,"15min":0.90200000000000002},"min":{"1min":0.625,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3859999999999999,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.628},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.83199999999999996},"min":{"1min":0.65600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.24,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.82799999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.874,"15min":0.89400000000000002},"min":{"1min":0.61199999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.2130000000000001,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.875,"5min":0.89000000000000001,"15min":0.91600000000000004},"min":{"1min":0.63700000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.302,"5min":3.3820000000000001,"15min":3.3820000000000001},"last":0.66800000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86199999999999999,"15min":0.871},"min":{"1min":0.61399999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1200000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.875,"15min":0.88700000000000001},"min":{"1min":0.65100000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.272,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":0.85799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302584,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069256,"statfs":{"total":96636764160,"available":96326918144,"internally_reserved":0,"allocated":1089536,"data_stored":798983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48099999999999998,"15min":0.47699999999999998},"min":{"1min":0.33900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.748,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.46100000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.496}]},{"osd":2,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47699999999999998,"15min":0.46700000000000003},"min":{"1min":0.38500000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.40999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.68700000000000006,"5min":1.702,"15min":1.702},"last":0.56899999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.47799999999999998,"15min":0.46700000000000003},"min":{"1min":0.35999999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.624,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.48499999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71899999999999997,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.54000000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.79600000000000004,"15min":0.77800000000000002},"min":{"1min":0.63300000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.141,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.746},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78200000000000003,"15min":0.77000000000000002},"min":{"1min":0.61699999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.70899999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.82299999999999995,"15min":0.81699999999999995},"min":{"1min":0.69499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.413,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79300000000000004,"15min":0.79100000000000004},"min":{"1min":0.63700000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1359999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.69699999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.82199999999999995,"15min":0.80800000000000005},"min":{"1min":0.65600000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.216,"5min":1.784,"15min":1.784},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.58499999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.288,"5min":1.538,"15min":1.538},"last":0.67000000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.67200000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83399999999999996,"15min":0.82399999999999995},"min":{"1min":0.73099999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3500000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:50:24.932 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:50:25.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.084+0000 7f638c600640 1 Processor -- start 2024-08-17T02:50:25.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.084+0000 7f638c600640 1 -- start start 2024-08-17T02:50:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.085+0000 7f638c600640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f63840ca050 0x7f6384156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.085+0000 7f638c600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63840add30 0x7f638415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.085+0000 7f638c600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638415b5e0 con 0x7f63840ad960 2024-08-17T02:50:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.085+0000 7f638c600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63840cb160 con 0x7f63840add30 2024-08-17T02:50:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.085+0000 7f638c600640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63840b0d10 con 0x7f63840ca050 2024-08-17T02:50:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.085+0000 7f6389c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f63840ad960 0x7f6384156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51422/0 (socket says 172.21.15.5:51422) 2024-08-17T02:50:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.085+0000 7f6389c00640 1 -- 172.21.15.5:0/2354669631 learned_addr learned my addr 172.21.15.5:0/2354669631 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.085+0000 7f638a600640 1 --2- 172.21.15.5:0/2354669631 >> v2:172.21.15.5:3300/0 conn(0x7f63840add30 0x7f638415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:25.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.086+0000 7f6389200640 1 --2- 172.21.15.5:0/2354669631 >> v2:172.21.15.107:3300/0 conn(0x7f63840ca050 0x7f6384156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:25.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.086+0000 7f6383e00640 1 -- 172.21.15.5:0/2354669631 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235090152 0 0) 0x7f6378001110 con 0x7f63840ad960 2024-08-17T02:50:25.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.086+0000 7f6383e00640 1 -- 172.21.15.5:0/2354669631 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f636c0034e0 con 0x7f63840ad960 2024-08-17T02:50:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.086+0000 7f638a600640 1 -- 172.21.15.5:0/2354669631 >> v2:172.21.15.107:3300/0 conn(0x7f63840ca050 msgr2=0x7f6384156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.086+0000 7f638a600640 1 --2- 172.21.15.5:0/2354669631 >> v2:172.21.15.107:3300/0 conn(0x7f63840ca050 0x7f6384156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.086+0000 7f638a600640 1 -- 172.21.15.5:0/2354669631 >> v1:172.21.15.5:6789/0 conn(0x7f63840ad960 legacy=0x7f6384156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.086+0000 7f638a600640 1 -- 172.21.15.5:0/2354669631 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63840ca550 con 0x7f63840add30 2024-08-17T02:50:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.087+0000 7f638a600640 1 --2- 172.21.15.5:0/2354669631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63840add30 0x7f638415b0a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6384063600 tx=0x7f637c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234213fa81539d60 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.087+0000 7f6383e00640 1 -- 172.21.15.5:0/2354669631 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c007550 con 0x7f63840add30 2024-08-17T02:50:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.087+0000 7f6383e00640 1 -- 172.21.15.5:0/2354669631 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c02d050 con 0x7f63840add30 2024-08-17T02:50:25.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.087+0000 7f6383e00640 1 -- 172.21.15.5:0/2354669631 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c007920 con 0x7f63840add30 2024-08-17T02:50:25.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.088+0000 7f638c600640 1 -- 172.21.15.5:0/2354669631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63840add30 msgr2=0x7f638415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:25.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.088+0000 7f638c600640 1 --2- 172.21.15.5:0/2354669631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63840add30 0x7f638415b0a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6384063600 tx=0x7f637c009780 comp rx=0 tx=0).stop 2024-08-17T02:50:25.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.088+0000 7f638c600640 1 -- 172.21.15.5:0/2354669631 shutdown_connections 2024-08-17T02:50:25.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.088+0000 7f638c600640 1 --2- 172.21.15.5:0/2354669631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63840add30 0x7f638415b0a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:25.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.088+0000 7f638c600640 1 --2- 172.21.15.5:0/2354669631 >> v2:172.21.15.107:3300/0 conn(0x7f63840ca050 0x7f6384156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:25.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.088+0000 7f638c600640 1 -- 172.21.15.5:0/2354669631 >> 172.21.15.5:0/2354669631 conn(0x7f6384066e60 msgr2=0x7f6384067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:25.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.088+0000 7f638c600640 1 -- 172.21.15.5:0/2354669631 shutdown_connections 2024-08-17T02:50:25.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.088+0000 7f638c600640 1 -- 172.21.15.5:0/2354669631 wait complete. 2024-08-17T02:50:25.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.089+0000 7f638c600640 1 Processor -- start 2024-08-17T02:50:25.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.090+0000 7f638c600640 1 -- start start 2024-08-17T02:50:25.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.090+0000 7f638c600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63840ad960 0x7f6384154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:25.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.090+0000 7f638c600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63840add30 0x7f6384150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:25.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.090+0000 7f638c600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63840ca050 0x7f63841510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:25.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.090+0000 7f638c600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638416d140 con 0x7f63840ca050 2024-08-17T02:50:25.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.090+0000 7f638c600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6384151620 con 0x7f63840add30 2024-08-17T02:50:25.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.090+0000 7f638c600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6384157ab0 con 0x7f63840ad960 2024-08-17T02:50:25.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.091+0000 7f638a600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63840ca050 0x7f63841510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:25.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.091+0000 7f638a600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63840ca050 0x7f63841510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36754/0 (socket says 172.21.15.5:36754) 2024-08-17T02:50:25.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.091+0000 7f638a600640 1 -- 172.21.15.5:0/1847985204 learned_addr learned my addr 172.21.15.5:0/1847985204 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:25.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.091+0000 7f6389200640 1 --2- 172.21.15.5:0/1847985204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63840add30 0x7f6384150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:25.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.091+0000 7f638a600640 1 -- 172.21.15.5:0/1847985204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63840ad960 msgr2=0x7f6384154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:25.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.091+0000 7f6389c00640 1 --2- 172.21.15.5:0/1847985204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63840ad960 0x7f6384154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:25.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.091+0000 7f638a600640 1 --2- 172.21.15.5:0/1847985204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63840ad960 0x7f6384154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:25.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.091+0000 7f638a600640 1 -- 172.21.15.5:0/1847985204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63840add30 msgr2=0x7f6384150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:25.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.091+0000 7f638a600640 1 --2- 172.21.15.5:0/1847985204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63840add30 0x7f6384150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:25.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.091+0000 7f638a600640 1 -- 172.21.15.5:0/1847985204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c009a20 con 0x7f63840ca050 2024-08-17T02:50:25.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.091+0000 7f6389200640 1 --2- 172.21.15.5:0/1847985204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63840add30 0x7f6384150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:25.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.091+0000 7f6389c00640 1 --2- 172.21.15.5:0/1847985204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63840ad960 0x7f6384154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:25.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.091+0000 7f638a600640 1 --2- 172.21.15.5:0/1847985204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63840ca050 0x7f63841510e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f637c009e90 tx=0x7f637c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:25.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.092+0000 7f6380c00640 1 -- 172.21.15.5:0/1847985204 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c031960 con 0x7f63840ca050 2024-08-17T02:50:25.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.092+0000 7f6380c00640 1 -- 172.21.15.5:0/1847985204 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c040070 con 0x7f63840ca050 2024-08-17T02:50:25.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.092+0000 7f6380c00640 1 -- 172.21.15.5:0/1847985204 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c031cf0 con 0x7f63840ca050 2024-08-17T02:50:25.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.092+0000 7f638c600640 1 -- 172.21.15.5:0/1847985204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6384157d90 con 0x7f63840ca050 2024-08-17T02:50:25.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.092+0000 7f638c600640 1 -- 172.21.15.5:0/1847985204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6384158350 con 0x7f63840ca050 2024-08-17T02:50:25.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.093+0000 7f638c600640 1 -- 172.21.15.5:0/1847985204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63841585a0 con 0x7f63840ca050 2024-08-17T02:50:25.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.094+0000 7f6380c00640 1 -- 172.21.15.5:0/1847985204 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f637c042030 con 0x7f63840ca050 2024-08-17T02:50:25.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.094+0000 7f6380c00640 1 --2- 172.21.15.5:0/1847985204 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6364065150 0x7f6364067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:25.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.095+0000 7f6380c00640 1 -- 172.21.15.5:0/1847985204 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f637c0a3370 con 0x7f63840ca050 2024-08-17T02:50:25.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.095+0000 7f6389c00640 1 --2- 172.21.15.5:0/1847985204 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6364065150 0x7f6364067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:25.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.095+0000 7f6389c00640 1 --2- 172.21.15.5:0/1847985204 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6364065150 0x7f6364067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6378005840 tx=0x7f6378009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:25.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.099+0000 7f6380c00640 1 -- 172.21.15.5:0/1847985204 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f637c071630 con 0x7f63840ca050 2024-08-17T02:50:25.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.284+0000 7f638c600640 1 -- 172.21.15.5:0/1847985204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6384063fb0 con 0x7f63840ca050 2024-08-17T02:50:25.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.285+0000 7f6380c00640 1 -- 172.21.15.5:0/1847985204 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12339 (secure 0 0 0) 0x7f637c074c50 con 0x7f63840ca050 2024-08-17T02:50:25.285 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:25.285 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":43,"fsid":"c0b1ebd9-d8c7-4fea-9f3f-a7f46fabd5c3","created":"2024-08-17T02:46:34.357572+0000","modified":"2024-08-17T02:50:20.485827+0000","last_up_change":"2024-08-17T02:46:45.866169+0000","last_in_change":"2024-08-17T02:46:37.161503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:47.106425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"7208b1d9-8c22-4f5f-8bff-f15936a8cd4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":37190},{"type":"v1","addr":"172.21.15.5:6801","nonce":37190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":37190},{"type":"v1","addr":"172.21.15.5:6803","nonce":37190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":37190},{"type":"v1","addr":"172.21.15.5:6807","nonce":37190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":37190},{"type":"v1","addr":"172.21.15.5:6805","nonce":37190}]},"public_addr":"172.21.15.5:6801/37190","cluster_addr":"172.21.15.5:6803/37190","heartbeat_back_addr":"172.21.15.5:6807/37190","heartbeat_front_addr":"172.21.15.5:6805/37190","state":["exists","up"]},{"osd":1,"uuid":"1766b5a8-d8a2-418f-b792-ec1a51b7c0a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":37204},{"type":"v1","addr":"172.21.15.5:6811","nonce":37204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":37204},{"type":"v1","addr":"172.21.15.5:6814","nonce":37204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":37204},{"type":"v1","addr":"172.21.15.5:6821","nonce":37204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":37204},{"type":"v1","addr":"172.21.15.5:6818","nonce":37204}]},"public_addr":"172.21.15.5:6811/37204","cluster_addr":"172.21.15.5:6814/37204","heartbeat_back_addr":"172.21.15.5:6821/37204","heartbeat_front_addr":"172.21.15.5:6818/37204","state":["exists","up"]},{"osd":2,"uuid":"73126905-9aa6-45ae-977f-1fdef3ac5e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":37203},{"type":"v1","addr":"172.21.15.5:6810","nonce":37203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":37203},{"type":"v1","addr":"172.21.15.5:6815","nonce":37203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":37203},{"type":"v1","addr":"172.21.15.5:6823","nonce":37203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":37203},{"type":"v1","addr":"172.21.15.5:6819","nonce":37203}]},"public_addr":"172.21.15.5:6810/37203","cluster_addr":"172.21.15.5:6815/37203","heartbeat_back_addr":"172.21.15.5:6823/37203","heartbeat_front_addr":"172.21.15.5:6819/37203","state":["exists","up"]},{"osd":3,"uuid":"60ed3139-2a99-499e-b113-cc38ce4489c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":37194},{"type":"v1","addr":"172.21.15.5:6825","nonce":37194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":37194},{"type":"v1","addr":"172.21.15.5:6827","nonce":37194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":37194},{"type":"v1","addr":"172.21.15.5:6831","nonce":37194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":37194},{"type":"v1","addr":"172.21.15.5:6829","nonce":37194}]},"public_addr":"172.21.15.5:6825/37194","cluster_addr":"172.21.15.5:6827/37194","heartbeat_back_addr":"172.21.15.5:6831/37194","heartbeat_front_addr":"172.21.15.5:6829/37194","state":["exists","up"]},{"osd":4,"uuid":"6640fd16-835f-4242-b9f5-d0b2e5deeb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":37108},{"type":"v1","addr":"172.21.15.107:6801","nonce":37108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":37108},{"type":"v1","addr":"172.21.15.107:6803","nonce":37108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":37108},{"type":"v1","addr":"172.21.15.107:6807","nonce":37108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":37108},{"type":"v1","addr":"172.21.15.107:6805","nonce":37108}]},"public_addr":"172.21.15.107:6801/37108","cluster_addr":"172.21.15.107:6803/37108","heartbeat_back_addr":"172.21.15.107:6807/37108","heartbeat_front_addr":"172.21.15.107:6805/37108","state":["exists","up"]},{"osd":5,"uuid":"6a70b251-0ed3-47d8-979a-f2a58a3421ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":37109},{"type":"v1","addr":"172.21.15.107:6809","nonce":37109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":37109},{"type":"v1","addr":"172.21.15.107:6811","nonce":37109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":37109},{"type":"v1","addr":"172.21.15.107:6815","nonce":37109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":37109},{"type":"v1","addr":"172.21.15.107:6813","nonce":37109}]},"public_addr":"172.21.15.107:6809/37109","cluster_addr":"172.21.15.107:6811/37109","heartbeat_back_addr":"172.21.15.107:6815/37109","heartbeat_front_addr":"172.21.15.107:6813/37109","state":["exists","up"]},{"osd":6,"uuid":"8e2d91e1-0939-4678-a578-800e02af359d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":37110},{"type":"v1","addr":"172.21.15.107:6817","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":37110},{"type":"v1","addr":"172.21.15.107:6819","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":37110},{"type":"v1","addr":"172.21.15.107:6823","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":37110},{"type":"v1","addr":"172.21.15.107:6821","nonce":37110}]},"public_addr":"172.21.15.107:6817/37110","cluster_addr":"172.21.15.107:6819/37110","heartbeat_back_addr":"172.21.15.107:6823/37110","heartbeat_front_addr":"172.21.15.107:6821/37110","state":["exists","up"]},{"osd":7,"uuid":"8c407789-07b3-45dd-9dd5-add2448887ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":37152},{"type":"v1","addr":"172.21.15.107:6825","nonce":37152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":37152},{"type":"v1","addr":"172.21.15.107:6827","nonce":37152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":37152},{"type":"v1","addr":"172.21.15.107:6831","nonce":37152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":37152},{"type":"v1","addr":"172.21.15.107:6829","nonce":37152}]},"public_addr":"172.21.15.107:6825/37152","cluster_addr":"172.21.15.107:6827/37152","heartbeat_back_addr":"172.21.15.107:6831/37152","heartbeat_front_addr":"172.21.15.107:6829/37152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.377851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.418162+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.484957+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.516640+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.481722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.489712+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.487368+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:42.491867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6837/1768626934":"2024-08-18T02:50:17.313643+0000","172.21.15.5:6835/1768626934":"2024-08-18T02:50:17.313643+0000","172.21.15.5:6836/723455700":"2024-08-18T02:50:10.445560+0000","172.21.15.5:6834/723455700":"2024-08-18T02:50:10.445560+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:50:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.287+0000 7f638c600640 1 -- 172.21.15.5:0/1847985204 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6364065150 msgr2=0x7f6364067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.287+0000 7f638c600640 1 --2- 172.21.15.5:0/1847985204 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6364065150 0x7f6364067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6378005840 tx=0x7f6378009040 comp rx=0 tx=0).stop 2024-08-17T02:50:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.287+0000 7f638c600640 1 -- 172.21.15.5:0/1847985204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63840ca050 msgr2=0x7f63841510e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.287+0000 7f638c600640 1 --2- 172.21.15.5:0/1847985204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63840ca050 0x7f63841510e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f637c009e90 tx=0x7f637c037000 comp rx=0 tx=0).stop 2024-08-17T02:50:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.287+0000 7f638c600640 1 -- 172.21.15.5:0/1847985204 shutdown_connections 2024-08-17T02:50:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.287+0000 7f638c600640 1 --2- 172.21.15.5:0/1847985204 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f6364065150 0x7f6364067600 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.287+0000 7f638c600640 1 --2- 172.21.15.5:0/1847985204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63840ca050 0x7f63841510e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.287+0000 7f638c600640 1 --2- 172.21.15.5:0/1847985204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63840add30 0x7f6384150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.287+0000 7f638c600640 1 --2- 172.21.15.5:0/1847985204 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63840ad960 0x7f6384154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.287+0000 7f638c600640 1 -- 172.21.15.5:0/1847985204 >> 172.21.15.5:0/1847985204 conn(0x7f6384066e60 msgr2=0x7f6384152e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.287+0000 7f638c600640 1 -- 172.21.15.5:0/1847985204 shutdown_connections 2024-08-17T02:50:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:25.287+0000 7f638c600640 1 -- 172.21.15.5:0/1847985204 wait complete. 2024-08-17T02:50:26.303 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:50:26.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:50:26.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.469+0000 7f8d67200640 1 Processor -- start 2024-08-17T02:50:26.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.470+0000 7f8d67200640 1 -- start start 2024-08-17T02:50:26.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.471+0000 7f8d67200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d680ad780 0x7f8d680adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:26.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.471+0000 7f8d67200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8d680cae20 0x7f8d680ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:26.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.471+0000 7f8d67200640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d680ca060 con 0x7f8d680af6c0 2024-08-17T02:50:26.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.471+0000 7f8d67200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d680ca340 con 0x7f8d680cae20 2024-08-17T02:50:26.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.471+0000 7f8d67200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680ca620 con 0x7f8d680ad780 2024-08-17T02:50:26.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.471+0000 7f8d5fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8d680cae20 0x7f8d680ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:26.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.471+0000 7f8d65e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d680ad780 0x7f8d680adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:26.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.472+0000 7f8d5fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8d680cae20 0x7f8d680ae6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:39872/0 (socket says 172.21.15.5:39872) 2024-08-17T02:50:26.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.472+0000 7f8d66800640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8d680af6c0 0x7f8d68157100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:58884/0 (socket says 172.21.15.5:58884) 2024-08-17T02:50:26.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.472+0000 7f8d5fe00640 1 -- 172.21.15.5:0/2215827252 learned_addr learned my addr 172.21.15.5:0/2215827252 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:26.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.472+0000 7f8d65e00640 1 -- 172.21.15.5:0/2215827252 >> v2:172.21.15.107:3300/0 conn(0x7f8d680cae20 msgr2=0x7f8d680ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:26.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.472+0000 7f8d65e00640 1 --2- 172.21.15.5:0/2215827252 >> v2:172.21.15.107:3300/0 conn(0x7f8d680cae20 0x7f8d680ae6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.472+0000 7f8d65e00640 1 -- 172.21.15.5:0/2215827252 >> v1:172.21.15.107:6789/0 conn(0x7f8d680af6c0 legacy=0x7f8d68157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:26.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.472+0000 7f8d65e00640 1 -- 172.21.15.5:0/2215827252 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d680ca900 con 0x7f8d680ad780 2024-08-17T02:50:26.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.472+0000 7f8d5fe00640 1 --2- 172.21.15.5:0/2215827252 >> v2:172.21.15.107:3300/0 conn(0x7f8d680cae20 0x7f8d680ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:26.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.473+0000 7f8d65e00640 1 --2- 172.21.15.5:0/2215827252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d680ad780 0x7f8d680adb50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009850 tx=0x7f8d580090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=955eadb6a044ff03 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:26.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.473+0000 7f8d65400640 1 -- 172.21.15.5:0/2215827252 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5802ad90 con 0x7f8d680ad780 2024-08-17T02:50:26.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.474+0000 7f8d65400640 1 -- 172.21.15.5:0/2215827252 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d58032440 con 0x7f8d680ad780 2024-08-17T02:50:26.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.474+0000 7f8d65400640 1 -- 172.21.15.5:0/2215827252 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58032820 con 0x7f8d680ad780 2024-08-17T02:50:26.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.474+0000 7f8d67200640 1 -- 172.21.15.5:0/2215827252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d680ad780 msgr2=0x7f8d680adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:26.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.474+0000 7f8d67200640 1 --2- 172.21.15.5:0/2215827252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d680ad780 0x7f8d680adb50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009850 tx=0x7f8d580090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.474+0000 7f8d67200640 1 -- 172.21.15.5:0/2215827252 shutdown_connections 2024-08-17T02:50:26.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.474+0000 7f8d67200640 1 --2- 172.21.15.5:0/2215827252 >> v2:172.21.15.107:3300/0 conn(0x7f8d680cae20 0x7f8d680ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.474+0000 7f8d67200640 1 --2- 172.21.15.5:0/2215827252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d680ad780 0x7f8d680adb50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.474+0000 7f8d67200640 1 -- 172.21.15.5:0/2215827252 >> 172.21.15.5:0/2215827252 conn(0x7f8d68066e60 msgr2=0x7f8d68067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:26.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.474+0000 7f8d67200640 1 -- 172.21.15.5:0/2215827252 shutdown_connections 2024-08-17T02:50:26.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.474+0000 7f8d67200640 1 -- 172.21.15.5:0/2215827252 wait complete. 2024-08-17T02:50:26.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.476+0000 7f8d67200640 1 Processor -- start 2024-08-17T02:50:26.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.476+0000 7f8d67200640 1 -- start start 2024-08-17T02:50:26.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.477+0000 7f8d67200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d680ad780 0x7f8d680a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:26.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.477+0000 7f8d67200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d680af6c0 0x7f8d681589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:26.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.477+0000 7f8d67200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d680cae20 0x7f8d68158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:26.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.477+0000 7f8d67200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68159420 con 0x7f8d680ad780 2024-08-17T02:50:26.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.477+0000 7f8d67200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d681596d0 con 0x7f8d680af6c0 2024-08-17T02:50:26.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.477+0000 7f8d67200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d681599b0 con 0x7f8d680cae20 2024-08-17T02:50:26.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.477+0000 7f8d65e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d680ad780 0x7f8d680a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:26.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.477+0000 7f8d65e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d680ad780 0x7f8d680a9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43422/0 (socket says 172.21.15.5:43422) 2024-08-17T02:50:26.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.477+0000 7f8d65e00640 1 -- 172.21.15.5:0/2881741061 learned_addr learned my addr 172.21.15.5:0/2881741061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:26.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.477+0000 7f8d5fe00640 1 --2- 172.21.15.5:0/2881741061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d680af6c0 0x7f8d681589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:26.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.477+0000 7f8d66800640 1 --2- 172.21.15.5:0/2881741061 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d680cae20 0x7f8d68158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:26.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.478+0000 7f8d65e00640 1 -- 172.21.15.5:0/2881741061 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d680cae20 msgr2=0x7f8d68158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:26.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.478+0000 7f8d65e00640 1 --2- 172.21.15.5:0/2881741061 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8d680cae20 0x7f8d68158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.478+0000 7f8d65e00640 1 -- 172.21.15.5:0/2881741061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d680af6c0 msgr2=0x7f8d681589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:26.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.478+0000 7f8d65e00640 1 --2- 172.21.15.5:0/2881741061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d680af6c0 0x7f8d681589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.478+0000 7f8d65e00640 1 -- 172.21.15.5:0/2881741061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d50009450 con 0x7f8d680ad780 2024-08-17T02:50:26.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.478+0000 7f8d65e00640 1 --2- 172.21.15.5:0/2881741061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d680ad780 0x7f8d680a9e50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009360 tx=0x7f8d58032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:26.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.478+0000 7f8d5d600640 1 -- 172.21.15.5:0/2881741061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58000d10 con 0x7f8d680ad780 2024-08-17T02:50:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.478+0000 7f8d5d600640 1 -- 172.21.15.5:0/2881741061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d58031de0 con 0x7f8d680ad780 2024-08-17T02:50:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.478+0000 7f8d67200640 1 -- 172.21.15.5:0/2881741061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d58009390 con 0x7f8d680ad780 2024-08-17T02:50:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.478+0000 7f8d5d600640 1 -- 172.21.15.5:0/2881741061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5803d670 con 0x7f8d680ad780 2024-08-17T02:50:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.479+0000 7f8d67200640 1 -- 172.21.15.5:0/2881741061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d68159f70 con 0x7f8d680ad780 2024-08-17T02:50:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.479+0000 7f8d67200640 1 -- 172.21.15.5:0/2881741061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d68155c10 con 0x7f8d680ad780 2024-08-17T02:50:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.480+0000 7f8d5d600640 1 -- 172.21.15.5:0/2881741061 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8d58039040 con 0x7f8d680ad780 2024-08-17T02:50:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.481+0000 7f8d5d600640 1 --2- 172.21.15.5:0/2881741061 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8d44065150 0x7f8d44067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.481+0000 7f8d5d600640 1 -- 172.21.15.5:0/2881741061 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f8d580a2330 con 0x7f8d680ad780 2024-08-17T02:50:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.481+0000 7f8d5d600640 1 --2- 172.21.15.5:0/2881741061 >> [v2:172.21.15.5:6800/37190,v1:172.21.15.5:6801/37190] conn(0x7f8d4406aed0 0x7f8d4406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.481+0000 7f8d5d600640 1 -- 172.21.15.5:0/2881741061 --> [v2:172.21.15.5:6800/37190,v1:172.21.15.5:6801/37190] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d4406d990 con 0x7f8d4406aed0 2024-08-17T02:50:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.481+0000 7f8d5d600640 1 -- 172.21.15.5:0/2881741061 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d580a4970 con 0x7f8d680ad780 2024-08-17T02:50:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.481+0000 7f8d5fe00640 1 --2- 172.21.15.5:0/2881741061 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8d44065150 0x7f8d44067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.482+0000 7f8d66800640 1 --2- 172.21.15.5:0/2881741061 >> [v2:172.21.15.5:6800/37190,v1:172.21.15.5:6801/37190] conn(0x7f8d4406aed0 0x7f8d4406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.482+0000 7f8d5fe00640 1 --2- 172.21.15.5:0/2881741061 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8d44065150 0x7f8d44067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8d68164aa0 tx=0x7f8d500091d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.482+0000 7f8d66800640 1 --2- 172.21.15.5:0/2881741061 >> [v2:172.21.15.5:6800/37190,v1:172.21.15.5:6801/37190] conn(0x7f8d4406aed0 0x7f8d4406d2e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.483+0000 7f8d5d600640 1 -- 172.21.15.5:0/2881741061 <== osd.0 v2:172.21.15.5:6800/37190 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8d4406d990 con 0x7f8d4406aed0 2024-08-17T02:50:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.496+0000 7f8d67200640 1 -- 172.21.15.5:0/2881741061 --> [v2:172.21.15.5:6800/37190,v1:172.21.15.5:6801/37190] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8d68063f10 con 0x7f8d4406aed0 2024-08-17T02:50:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.496+0000 7f8d5d600640 1 -- 172.21.15.5:0/2881741061 <== osd.0 v2:172.21.15.5:6800/37190 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8d68063f10 con 0x7f8d4406aed0 2024-08-17T02:50:26.496 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:50:26.497 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:50:26.497 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:50:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.496+0000 7f8d67200640 1 -- 172.21.15.5:0/2881741061 >> [v2:172.21.15.5:6800/37190,v1:172.21.15.5:6801/37190] conn(0x7f8d4406aed0 msgr2=0x7f8d4406d2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.496+0000 7f8d67200640 1 --2- 172.21.15.5:0/2881741061 >> [v2:172.21.15.5:6800/37190,v1:172.21.15.5:6801/37190] conn(0x7f8d4406aed0 0x7f8d4406d2e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.497+0000 7f8d67200640 1 -- 172.21.15.5:0/2881741061 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8d44065150 msgr2=0x7f8d44067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.497+0000 7f8d67200640 1 --2- 172.21.15.5:0/2881741061 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f8d44065150 0x7f8d44067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8d68164aa0 tx=0x7f8d500091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.497+0000 7f8d67200640 1 -- 172.21.15.5:0/2881741061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d680ad780 msgr2=0x7f8d680a9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.497+0000 7f8d67200640 1 --2- 172.21.15.5:0/2881741061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d680ad780 0x7f8d680a9e50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009360 tx=0x7f8d58032000 comp rx=0 tx=0).stop 2024-08-17T02:50:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.497+0000 7f8d66800640 1 -- 172.21.15.5:0/2881741061 reap_dead start 2024-08-17T02:50:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.497+0000 7f8d67200640 1 -- 172.21.15.5:0/2881741061 shutdown_connections 2024-08-17T02:50:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.497+0000 7f8d67200640 1 -- 172.21.15.5:0/2881741061 >> 172.21.15.5:0/2881741061 conn(0x7f8d68066e60 msgr2=0x7f8d6806e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.497+0000 7f8d67200640 1 -- 172.21.15.5:0/2881741061 shutdown_connections 2024-08-17T02:50:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.497+0000 7f8d67200640 1 -- 172.21.15.5:0/2881741061 wait complete. 2024-08-17T02:50:26.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:50:26.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.663+0000 7f589ae00640 1 Processor -- start 2024-08-17T02:50:26.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.664+0000 7f589ae00640 1 -- start start 2024-08-17T02:50:26.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.665+0000 7f589ae00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58941588d0 0x7f58940ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:26.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.665+0000 7f589ae00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58940cf900 0x7f58940cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:26.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.665+0000 7f589ae00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58940af600 con 0x7f5894158ca0 2024-08-17T02:50:26.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.665+0000 7f589ae00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58940cb280 con 0x7f58941588d0 2024-08-17T02:50:26.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.665+0000 7f589ae00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58940afb60 con 0x7f58940cf900 2024-08-17T02:50:26.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.665+0000 7f5899a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58941588d0 0x7f58940ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:26.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.665+0000 7f5899000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5894158ca0 0x7f58940cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34268/0 (socket says 172.21.15.5:34268) 2024-08-17T02:50:26.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.665+0000 7f5899000640 1 -- 172.21.15.5:0/3027815462 learned_addr learned my addr 172.21.15.5:0/3027815462 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:26.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.665+0000 7f589a400640 1 --2- 172.21.15.5:0/3027815462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58940cf900 0x7f58940cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:26.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.666+0000 7f5899a00640 1 -- 172.21.15.5:0/3027815462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58940cf900 msgr2=0x7f58940cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:26.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.666+0000 7f5899a00640 1 --2- 172.21.15.5:0/3027815462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58940cf900 0x7f58940cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.666+0000 7f5899a00640 1 -- 172.21.15.5:0/3027815462 >> v1:172.21.15.5:6789/0 conn(0x7f5894158ca0 legacy=0x7f58940cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:26.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.666+0000 7f5899a00640 1 -- 172.21.15.5:0/3027815462 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58940d04e0 con 0x7f58941588d0 2024-08-17T02:50:26.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.667+0000 7f5899a00640 1 --2- 172.21.15.5:0/3027815462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58941588d0 0x7f58940ca800 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5888009850 tx=0x7f58880090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e445e7abc1eae71 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:26.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.667+0000 7f5893e00640 1 -- 172.21.15.5:0/3027815462 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588802ad90 con 0x7f58941588d0 2024-08-17T02:50:26.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.667+0000 7f5893e00640 1 -- 172.21.15.5:0/3027815462 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5888032440 con 0x7f58941588d0 2024-08-17T02:50:26.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.667+0000 7f5893e00640 1 -- 172.21.15.5:0/3027815462 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888032820 con 0x7f58941588d0 2024-08-17T02:50:26.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.667+0000 7f589ae00640 1 -- 172.21.15.5:0/3027815462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58941588d0 msgr2=0x7f58940ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:26.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.667+0000 7f589ae00640 1 --2- 172.21.15.5:0/3027815462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58941588d0 0x7f58940ca800 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5888009850 tx=0x7f58880090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.668+0000 7f589ae00640 1 -- 172.21.15.5:0/3027815462 shutdown_connections 2024-08-17T02:50:26.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.668+0000 7f589ae00640 1 --2- 172.21.15.5:0/3027815462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58940cf900 0x7f58940cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.668+0000 7f589ae00640 1 --2- 172.21.15.5:0/3027815462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58941588d0 0x7f58940ca800 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.668+0000 7f589ae00640 1 -- 172.21.15.5:0/3027815462 >> 172.21.15.5:0/3027815462 conn(0x7f5894087a80 msgr2=0x7f589406e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:26.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.668+0000 7f589ae00640 1 -- 172.21.15.5:0/3027815462 shutdown_connections 2024-08-17T02:50:26.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.668+0000 7f589ae00640 1 -- 172.21.15.5:0/3027815462 wait complete. 2024-08-17T02:50:26.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.669+0000 7f589ae00640 1 Processor -- start 2024-08-17T02:50:26.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.669+0000 7f589ae00640 1 -- start start 2024-08-17T02:50:26.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.670+0000 7f589ae00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58940cf900 0x7f58940b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.670+0000 7f589ae00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58941588d0 0x7f5894168dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.670+0000 7f589ae00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5894158ca0 0x7f5894169300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.670+0000 7f589ae00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58940b3ac0 con 0x7f58940cf900 2024-08-17T02:50:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.670+0000 7f589ae00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58940b4f20 con 0x7f58941588d0 2024-08-17T02:50:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.670+0000 7f589ae00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58940b37e0 con 0x7f5894158ca0 2024-08-17T02:50:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.670+0000 7f5899a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58940cf900 0x7f58940b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.670+0000 7f5899a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58940cf900 0x7f58940b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43434/0 (socket says 172.21.15.5:43434) 2024-08-17T02:50:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.670+0000 7f5899a00640 1 -- 172.21.15.5:0/430361610 learned_addr learned my addr 172.21.15.5:0/430361610 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.671+0000 7f5899000640 1 --2- 172.21.15.5:0/430361610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58941588d0 0x7f5894168dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.671+0000 7f589a400640 1 --2- 172.21.15.5:0/430361610 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5894158ca0 0x7f5894169300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.671+0000 7f5899a00640 1 -- 172.21.15.5:0/430361610 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5894158ca0 msgr2=0x7f5894169300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.671+0000 7f5899a00640 1 --2- 172.21.15.5:0/430361610 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5894158ca0 0x7f5894169300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.671+0000 7f5899a00640 1 -- 172.21.15.5:0/430361610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58941588d0 msgr2=0x7f5894168dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.671+0000 7f5899a00640 1 --2- 172.21.15.5:0/430361610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58941588d0 0x7f5894168dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.671+0000 7f5899a00640 1 -- 172.21.15.5:0/430361610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5888009390 con 0x7f58940cf900 2024-08-17T02:50:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.671+0000 7f589a400640 1 --2- 172.21.15.5:0/430361610 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5894158ca0 0x7f5894169300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:26.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.671+0000 7f5899a00640 1 --2- 172.21.15.5:0/430361610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58940cf900 0x7f58940b53d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5888009360 tx=0x7f5888032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:26.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.671+0000 7f5890c00640 1 -- 172.21.15.5:0/430361610 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888031de0 con 0x7f58940cf900 2024-08-17T02:50:26.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.671+0000 7f5890c00640 1 -- 172.21.15.5:0/430361610 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588803d440 con 0x7f58940cf900 2024-08-17T02:50:26.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.671+0000 7f589ae00640 1 -- 172.21.15.5:0/430361610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58940b48d0 con 0x7f58940cf900 2024-08-17T02:50:26.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.671+0000 7f5890c00640 1 -- 172.21.15.5:0/430361610 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588803d7e0 con 0x7f58940cf900 2024-08-17T02:50:26.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.672+0000 7f589ae00640 1 -- 172.21.15.5:0/430361610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58940a7130 con 0x7f58940cf900 2024-08-17T02:50:26.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.673+0000 7f589ae00640 1 -- 172.21.15.5:0/430361610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58940b3c00 con 0x7f58940cf900 2024-08-17T02:50:26.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.674+0000 7f5890c00640 1 -- 172.21.15.5:0/430361610 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5888039040 con 0x7f58940cf900 2024-08-17T02:50:26.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.674+0000 7f5890c00640 1 --2- 172.21.15.5:0/430361610 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5874065150 0x7f5874067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:26.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.674+0000 7f5890c00640 1 -- 172.21.15.5:0/430361610 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f58880a22e0 con 0x7f58940cf900 2024-08-17T02:50:26.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.675+0000 7f5899000640 1 --2- 172.21.15.5:0/430361610 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5874065150 0x7f5874067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:26.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.675+0000 7f5899000640 1 --2- 172.21.15.5:0/430361610 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5874065150 0x7f5874067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f58940cb180 tx=0x7f5880009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:26.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.678+0000 7f5890c00640 1 -- 172.21.15.5:0/430361610 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f58880706f0 con 0x7f58940cf900 2024-08-17T02:50:26.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.862+0000 7f589ae00640 1 -- 172.21.15.5:0/430361610 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f58940b5910 con 0x7f5874065150 2024-08-17T02:50:26.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.863+0000 7f5890c00640 1 -- 172.21.15.5:0/430361610 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f58940b5910 con 0x7f5874065150 2024-08-17T02:50:26.863 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:50:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.865+0000 7f589ae00640 1 -- 172.21.15.5:0/430361610 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5874065150 msgr2=0x7f5874067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.865+0000 7f589ae00640 1 --2- 172.21.15.5:0/430361610 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5874065150 0x7f5874067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f58940cb180 tx=0x7f5880009040 comp rx=0 tx=0).stop 2024-08-17T02:50:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.865+0000 7f589ae00640 1 -- 172.21.15.5:0/430361610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58940cf900 msgr2=0x7f58940b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.865+0000 7f589ae00640 1 --2- 172.21.15.5:0/430361610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58940cf900 0x7f58940b53d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5888009360 tx=0x7f5888032000 comp rx=0 tx=0).stop 2024-08-17T02:50:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.865+0000 7f589ae00640 1 -- 172.21.15.5:0/430361610 shutdown_connections 2024-08-17T02:50:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.865+0000 7f589ae00640 1 --2- 172.21.15.5:0/430361610 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5874065150 0x7f5874067600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.865+0000 7f589ae00640 1 --2- 172.21.15.5:0/430361610 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5894158ca0 0x7f5894169300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.865+0000 7f589ae00640 1 --2- 172.21.15.5:0/430361610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58941588d0 0x7f5894168dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.865+0000 7f589ae00640 1 --2- 172.21.15.5:0/430361610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58940cf900 0x7f58940b53d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.865+0000 7f589ae00640 1 -- 172.21.15.5:0/430361610 >> 172.21.15.5:0/430361610 conn(0x7f5894087a80 msgr2=0x7f5894157890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.865+0000 7f589ae00640 1 -- 172.21.15.5:0/430361610 shutdown_connections 2024-08-17T02:50:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:26.865+0000 7f589ae00640 1 -- 172.21.15.5:0/430361610 wait complete. 2024-08-17T02:50:26.880 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:50:26.881 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:50:27.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.035+0000 7f9a2ac00640 1 Processor -- start 2024-08-17T02:50:27.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.035+0000 7f9a2ac00640 1 -- start start 2024-08-17T02:50:27.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.037+0000 7f9a2ac00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9a24158c90 0x7f9a2415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.037+0000 7f9a2ac00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a24062fb0 0x7f9a240a8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.037+0000 7f9a2ac00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2415d820 con 0x7f9a240a94b0 2024-08-17T02:50:27.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.037+0000 7f9a2ac00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a240a98b0 con 0x7f9a24062fb0 2024-08-17T02:50:27.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.037+0000 7f9a2ac00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2406e280 con 0x7f9a24158c90 2024-08-17T02:50:27.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.037+0000 7f9a28e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a24062fb0 0x7f9a240a8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.037+0000 7f9a2a200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9a240a94b0 0x7f9a24067070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34284/0 (socket says 172.21.15.5:34284) 2024-08-17T02:50:27.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.037+0000 7f9a2a200640 1 -- 172.21.15.5:0/1628463801 learned_addr learned my addr 172.21.15.5:0/1628463801 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:27.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.037+0000 7f9a29800640 1 --2- 172.21.15.5:0/1628463801 >> v2:172.21.15.107:3300/0 conn(0x7f9a24158c90 0x7f9a2415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.037+0000 7f9a28e00640 1 -- 172.21.15.5:0/1628463801 >> v2:172.21.15.107:3300/0 conn(0x7f9a24158c90 msgr2=0x7f9a2415d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.037+0000 7f9a28e00640 1 --2- 172.21.15.5:0/1628463801 >> v2:172.21.15.107:3300/0 conn(0x7f9a24158c90 0x7f9a2415d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.037+0000 7f9a28e00640 1 -- 172.21.15.5:0/1628463801 >> v1:172.21.15.5:6789/0 conn(0x7f9a240a94b0 legacy=0x7f9a24067070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.038+0000 7f9a28e00640 1 -- 172.21.15.5:0/1628463801 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2406e540 con 0x7f9a24062fb0 2024-08-17T02:50:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.038+0000 7f9a23e00640 1 -- 172.21.15.5:0/1628463801 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941128395 0 0) 0x7f9a1c001490 con 0x7f9a240a94b0 2024-08-17T02:50:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.039+0000 7f9a28e00640 1 --2- 172.21.15.5:0/1628463801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a24062fb0 0x7f9a240a8f70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9a2404bdd0 tx=0x7f9a100090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f0389f846bbdd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.039+0000 7f9a23e00640 1 -- 172.21.15.5:0/1628463801 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1002ae40 con 0x7f9a24062fb0 2024-08-17T02:50:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.039+0000 7f9a23e00640 1 -- 172.21.15.5:0/1628463801 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a10032440 con 0x7f9a24062fb0 2024-08-17T02:50:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.039+0000 7f9a23e00640 1 -- 172.21.15.5:0/1628463801 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a100327e0 con 0x7f9a24062fb0 2024-08-17T02:50:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.039+0000 7f9a2ac00640 1 -- 172.21.15.5:0/1628463801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a24062fb0 msgr2=0x7f9a240a8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.039+0000 7f9a2ac00640 1 --2- 172.21.15.5:0/1628463801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a24062fb0 0x7f9a240a8f70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9a2404bdd0 tx=0x7f9a100090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.039+0000 7f9a2ac00640 1 -- 172.21.15.5:0/1628463801 shutdown_connections 2024-08-17T02:50:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.039+0000 7f9a2ac00640 1 --2- 172.21.15.5:0/1628463801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a24062fb0 0x7f9a240a8f70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.039+0000 7f9a2ac00640 1 --2- 172.21.15.5:0/1628463801 >> v2:172.21.15.107:3300/0 conn(0x7f9a24158c90 0x7f9a2415d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.039+0000 7f9a2ac00640 1 -- 172.21.15.5:0/1628463801 >> 172.21.15.5:0/1628463801 conn(0x7f9a240cc040 msgr2=0x7f9a240cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:27.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.040+0000 7f9a2ac00640 1 -- 172.21.15.5:0/1628463801 shutdown_connections 2024-08-17T02:50:27.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.040+0000 7f9a2ac00640 1 -- 172.21.15.5:0/1628463801 wait complete. 2024-08-17T02:50:27.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.041+0000 7f9a2ac00640 1 Processor -- start 2024-08-17T02:50:27.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.041+0000 7f9a2ac00640 1 -- start start 2024-08-17T02:50:27.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.042+0000 7f9a2ac00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a24062fb0 0x7f9a240b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.042+0000 7f9a2ac00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a240a94b0 0x7f9a2415c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.042+0000 7f9a2ac00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a24158c90 0x7f9a2415b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.042+0000 7f9a2ac00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2416a200 con 0x7f9a24158c90 2024-08-17T02:50:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.042+0000 7f9a2ac00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a241695f0 con 0x7f9a24062fb0 2024-08-17T02:50:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.042+0000 7f9a2ac00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a241698d0 con 0x7f9a240a94b0 2024-08-17T02:50:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.042+0000 7f9a2a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a24158c90 0x7f9a2415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.042+0000 7f9a2a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a24158c90 0x7f9a2415b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43452/0 (socket says 172.21.15.5:43452) 2024-08-17T02:50:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.042+0000 7f9a2a200640 1 -- 172.21.15.5:0/3754480502 learned_addr learned my addr 172.21.15.5:0/3754480502 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.042+0000 7f9a28e00640 1 --2- 172.21.15.5:0/3754480502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a240a94b0 0x7f9a2415c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.042+0000 7f9a29800640 1 --2- 172.21.15.5:0/3754480502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a24062fb0 0x7f9a240b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.043+0000 7f9a2a200640 1 -- 172.21.15.5:0/3754480502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a240a94b0 msgr2=0x7f9a2415c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.043+0000 7f9a2a200640 1 --2- 172.21.15.5:0/3754480502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a240a94b0 0x7f9a2415c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.043+0000 7f9a2a200640 1 -- 172.21.15.5:0/3754480502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a24062fb0 msgr2=0x7f9a240b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.043+0000 7f9a2a200640 1 --2- 172.21.15.5:0/3754480502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a24062fb0 0x7f9a240b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.043+0000 7f9a2a200640 1 -- 172.21.15.5:0/3754480502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a10009390 con 0x7f9a24158c90 2024-08-17T02:50:27.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.043+0000 7f9a2a200640 1 --2- 172.21.15.5:0/3754480502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a24158c90 0x7f9a2415b210 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00ccc0 tx=0x7f9a1c001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:27.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.043+0000 7f9a20c00640 1 -- 172.21.15.5:0/3754480502 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c00ce80 con 0x7f9a24158c90 2024-08-17T02:50:27.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.043+0000 7f9a20c00640 1 -- 172.21.15.5:0/3754480502 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c00a850 con 0x7f9a24158c90 2024-08-17T02:50:27.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.043+0000 7f9a20c00640 1 -- 172.21.15.5:0/3754480502 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c00ac50 con 0x7f9a24158c90 2024-08-17T02:50:27.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.043+0000 7f9a2ac00640 1 -- 172.21.15.5:0/3754480502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a24169bb0 con 0x7f9a24158c90 2024-08-17T02:50:27.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.043+0000 7f9a2ac00640 1 -- 172.21.15.5:0/3754480502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a241692c0 con 0x7f9a24158c90 2024-08-17T02:50:27.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.044+0000 7f9a2ac00640 1 -- 172.21.15.5:0/3754480502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a240638d0 con 0x7f9a24158c90 2024-08-17T02:50:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.045+0000 7f9a20c00640 1 -- 172.21.15.5:0/3754480502 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9a1c007300 con 0x7f9a24158c90 2024-08-17T02:50:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.046+0000 7f9a20c00640 1 --2- 172.21.15.5:0/3754480502 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9a04065180 0x7f9a04067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.046+0000 7f9a20c00640 1 -- 172.21.15.5:0/3754480502 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9a1c082320 con 0x7f9a24158c90 2024-08-17T02:50:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.046+0000 7f9a29800640 1 --2- 172.21.15.5:0/3754480502 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9a04065180 0x7f9a04067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.046+0000 7f9a20c00640 1 --2- 172.21.15.5:0/3754480502 >> [v2:172.21.15.5:6809/37204,v1:172.21.15.5:6811/37204] conn(0x7f9a0406afa0 0x7f9a0406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.046+0000 7f9a20c00640 1 -- 172.21.15.5:0/3754480502 --> [v2:172.21.15.5:6809/37204,v1:172.21.15.5:6811/37204] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a0406da60 con 0x7f9a0406afa0 2024-08-17T02:50:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.046+0000 7f9a20c00640 1 -- 172.21.15.5:0/3754480502 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a1c084880 con 0x7f9a24158c90 2024-08-17T02:50:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.046+0000 7f9a28e00640 1 --2- 172.21.15.5:0/3754480502 >> [v2:172.21.15.5:6809/37204,v1:172.21.15.5:6811/37204] conn(0x7f9a0406afa0 0x7f9a0406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.047+0000 7f9a29800640 1 --2- 172.21.15.5:0/3754480502 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9a04065180 0x7f9a04067630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800bb70 tx=0x7f9a18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:27.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.047+0000 7f9a28e00640 1 --2- 172.21.15.5:0/3754480502 >> [v2:172.21.15.5:6809/37204,v1:172.21.15.5:6811/37204] conn(0x7f9a0406afa0 0x7f9a0406d3b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:27.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.048+0000 7f9a20c00640 1 -- 172.21.15.5:0/3754480502 <== osd.1 v2:172.21.15.5:6809/37204 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f9a0406da60 con 0x7f9a0406afa0 2024-08-17T02:50:27.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.060+0000 7f9a2ac00640 1 -- 172.21.15.5:0/3754480502 --> [v2:172.21.15.5:6809/37204,v1:172.21.15.5:6811/37204] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9a2415d820 con 0x7f9a0406afa0 2024-08-17T02:50:27.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.061+0000 7f9a20c00640 1 -- 172.21.15.5:0/3754480502 <== osd.1 v2:172.21.15.5:6809/37204 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9a2415d820 con 0x7f9a0406afa0 2024-08-17T02:50:27.061 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:50:27.061 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:50:27.062 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:50:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.061+0000 7f9a2ac00640 1 -- 172.21.15.5:0/3754480502 >> [v2:172.21.15.5:6809/37204,v1:172.21.15.5:6811/37204] conn(0x7f9a0406afa0 msgr2=0x7f9a0406d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.061+0000 7f9a2ac00640 1 --2- 172.21.15.5:0/3754480502 >> [v2:172.21.15.5:6809/37204,v1:172.21.15.5:6811/37204] conn(0x7f9a0406afa0 0x7f9a0406d3b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.061+0000 7f9a2ac00640 1 -- 172.21.15.5:0/3754480502 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9a04065180 msgr2=0x7f9a04067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.061+0000 7f9a2ac00640 1 --2- 172.21.15.5:0/3754480502 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f9a04065180 0x7f9a04067630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800bb70 tx=0x7f9a18008040 comp rx=0 tx=0).stop 2024-08-17T02:50:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.061+0000 7f9a2ac00640 1 -- 172.21.15.5:0/3754480502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a24158c90 msgr2=0x7f9a2415b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.061+0000 7f9a2ac00640 1 --2- 172.21.15.5:0/3754480502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a24158c90 0x7f9a2415b210 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00ccc0 tx=0x7f9a1c001a10 comp rx=0 tx=0).stop 2024-08-17T02:50:27.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.061+0000 7f9a2a200640 1 -- 172.21.15.5:0/3754480502 reap_dead start 2024-08-17T02:50:27.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.062+0000 7f9a2ac00640 1 -- 172.21.15.5:0/3754480502 shutdown_connections 2024-08-17T02:50:27.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.062+0000 7f9a2ac00640 1 -- 172.21.15.5:0/3754480502 >> 172.21.15.5:0/3754480502 conn(0x7f9a240cc040 msgr2=0x7f9a240675b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:27.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.062+0000 7f9a2ac00640 1 -- 172.21.15.5:0/3754480502 shutdown_connections 2024-08-17T02:50:27.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.062+0000 7f9a2ac00640 1 -- 172.21.15.5:0/3754480502 wait complete. 2024-08-17T02:50:27.075 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:50:27.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.228+0000 7fc105000640 1 Processor -- start 2024-08-17T02:50:27.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.228+0000 7fc105000640 1 -- start start 2024-08-17T02:50:27.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.229+0000 7fc105000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1000ad960 0x7fc10015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.229+0000 7fc105000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1000ca050 0x7fc100156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.229+0000 7fc105000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10015b5e0 con 0x7fc1000add30 2024-08-17T02:50:27.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.229+0000 7fc105000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1000cb160 con 0x7fc1000ad960 2024-08-17T02:50:27.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.229+0000 7fc105000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000b0d10 con 0x7fc1000ca050 2024-08-17T02:50:27.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.229+0000 7fc0fde00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1000ad960 0x7fc10015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.229+0000 7fc0fe800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc1000add30 0x7fc100156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34288/0 (socket says 172.21.15.5:34288) 2024-08-17T02:50:27.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.229+0000 7fc0fe800640 1 -- 172.21.15.5:0/2158257518 learned_addr learned my addr 172.21.15.5:0/2158257518 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:27.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.230+0000 7fc0fd400640 1 --2- 172.21.15.5:0/2158257518 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1000ca050 0x7fc100156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.230+0000 7fc0fde00640 1 -- 172.21.15.5:0/2158257518 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1000ca050 msgr2=0x7fc100156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:27.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.230+0000 7fc0fde00640 1 --2- 172.21.15.5:0/2158257518 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1000ca050 0x7fc100156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.230+0000 7fc0fde00640 1 -- 172.21.15.5:0/2158257518 >> v1:172.21.15.5:6789/0 conn(0x7fc1000add30 legacy=0x7fc100156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.230+0000 7fc0fde00640 1 -- 172.21.15.5:0/2158257518 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1000ca550 con 0x7fc1000ad960 2024-08-17T02:50:27.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.230+0000 7fc0fca00640 1 -- 172.21.15.5:0/2158257518 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077629547 0 0) 0x7fc0f8001490 con 0x7fc1000add30 2024-08-17T02:50:27.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.231+0000 7fc0fde00640 1 --2- 172.21.15.5:0/2158257518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1000ad960 0x7fc10015b0a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009850 tx=0x7fc0f00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2d7e70b6ddd307 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:27.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.231+0000 7fc0fca00640 1 -- 172.21.15.5:0/2158257518 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f002ae10 con 0x7fc1000ad960 2024-08-17T02:50:27.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.231+0000 7fc0fca00640 1 -- 172.21.15.5:0/2158257518 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f0032440 con 0x7fc1000ad960 2024-08-17T02:50:27.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.231+0000 7fc0fca00640 1 -- 172.21.15.5:0/2158257518 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f00327e0 con 0x7fc1000ad960 2024-08-17T02:50:27.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.232+0000 7fc105000640 1 -- 172.21.15.5:0/2158257518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1000ad960 msgr2=0x7fc10015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.232+0000 7fc105000640 1 --2- 172.21.15.5:0/2158257518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1000ad960 0x7fc10015b0a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009850 tx=0x7fc0f00090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.232+0000 7fc105000640 1 -- 172.21.15.5:0/2158257518 shutdown_connections 2024-08-17T02:50:27.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.232+0000 7fc105000640 1 --2- 172.21.15.5:0/2158257518 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1000ca050 0x7fc100156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.232+0000 7fc105000640 1 --2- 172.21.15.5:0/2158257518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1000ad960 0x7fc10015b0a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.232+0000 7fc105000640 1 -- 172.21.15.5:0/2158257518 >> 172.21.15.5:0/2158257518 conn(0x7fc100066e60 msgr2=0x7fc100067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:27.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.232+0000 7fc105000640 1 -- 172.21.15.5:0/2158257518 shutdown_connections 2024-08-17T02:50:27.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.232+0000 7fc105000640 1 -- 172.21.15.5:0/2158257518 wait complete. 2024-08-17T02:50:27.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.233+0000 7fc105000640 1 Processor -- start 2024-08-17T02:50:27.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.234+0000 7fc105000640 1 -- start start 2024-08-17T02:50:27.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.234+0000 7fc105000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1000ad960 0x7fc1000ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.234+0000 7fc105000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1000add30 0x7fc1001511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.235+0000 7fc105000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1000ca050 0x7fc10006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.235+0000 7fc105000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc100157100 con 0x7fc1000ca050 2024-08-17T02:50:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.235+0000 7fc105000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1001573a0 con 0x7fc1000add30 2024-08-17T02:50:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.235+0000 7fc105000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10015bd20 con 0x7fc1000ad960 2024-08-17T02:50:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.235+0000 7fc0fe800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1000ca050 0x7fc10006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.235+0000 7fc0fe800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1000ca050 0x7fc10006d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43476/0 (socket says 172.21.15.5:43476) 2024-08-17T02:50:27.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.235+0000 7fc0fe800640 1 -- 172.21.15.5:0/2493728261 learned_addr learned my addr 172.21.15.5:0/2493728261 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:27.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.235+0000 7fc0fde00640 1 --2- 172.21.15.5:0/2493728261 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1000ad960 0x7fc1000ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.235+0000 7fc0fd400640 1 --2- 172.21.15.5:0/2493728261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1000add30 0x7fc1001511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.235+0000 7fc0fe800640 1 -- 172.21.15.5:0/2493728261 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1000ad960 msgr2=0x7fc1000ac210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.235+0000 7fc0fe800640 1 --2- 172.21.15.5:0/2493728261 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1000ad960 0x7fc1000ac210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.235+0000 7fc0fe800640 1 -- 172.21.15.5:0/2493728261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1000add30 msgr2=0x7fc1001511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.235+0000 7fc0fe800640 1 --2- 172.21.15.5:0/2493728261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1000add30 0x7fc1001511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.235+0000 7fc0fe800640 1 -- 172.21.15.5:0/2493728261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f0009390 con 0x7fc1000ca050 2024-08-17T02:50:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.235+0000 7fc0fd400640 1 --2- 172.21.15.5:0/2493728261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1000add30 0x7fc1001511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.235+0000 7fc0fde00640 1 --2- 172.21.15.5:0/2493728261 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1000ad960 0x7fc1000ac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.236+0000 7fc0fe800640 1 --2- 172.21.15.5:0/2493728261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1000ca050 0x7fc10006d7d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800cc90 tx=0x7fc0f8001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.236+0000 7fc0f5600640 1 -- 172.21.15.5:0/2493728261 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8004b20 con 0x7fc1000ca050 2024-08-17T02:50:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.236+0000 7fc0f5600640 1 -- 172.21.15.5:0/2493728261 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f8004c80 con 0x7fc1000ca050 2024-08-17T02:50:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.236+0000 7fc0f5600640 1 -- 172.21.15.5:0/2493728261 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800aaa0 con 0x7fc1000ca050 2024-08-17T02:50:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.236+0000 7fc105000640 1 -- 172.21.15.5:0/2493728261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10015c000 con 0x7fc1000ca050 2024-08-17T02:50:27.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.236+0000 7fc105000640 1 -- 172.21.15.5:0/2493728261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10015c5c0 con 0x7fc1000ca050 2024-08-17T02:50:27.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.237+0000 7fc105000640 1 -- 172.21.15.5:0/2493728261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc100157510 con 0x7fc1000ca050 2024-08-17T02:50:27.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.238+0000 7fc0f5600640 1 -- 172.21.15.5:0/2493728261 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc0f80070f0 con 0x7fc1000ca050 2024-08-17T02:50:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.239+0000 7fc0f5600640 1 --2- 172.21.15.5:0/2493728261 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc0e0065150 0x7fc0e0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.239+0000 7fc0f5600640 1 -- 172.21.15.5:0/2493728261 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc0f8081c20 con 0x7fc1000ca050 2024-08-17T02:50:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.239+0000 7fc0fde00640 1 --2- 172.21.15.5:0/2493728261 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc0e0065150 0x7fc0e0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.240+0000 7fc0fde00640 1 --2- 172.21.15.5:0/2493728261 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc0e0065150 0x7fc0e0067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0034000 tx=0x7fc0f0032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.242+0000 7fc0f5600640 1 -- 172.21.15.5:0/2493728261 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc0f8050000 con 0x7fc1000ca050 2024-08-17T02:50:27.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.425+0000 7fc105000640 1 -- 172.21.15.5:0/2493728261 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc100063fb0 con 0x7fc0e0065150 2024-08-17T02:50:27.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.425+0000 7fc0f5600640 1 -- 172.21.15.5:0/2493728261 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc100063fb0 con 0x7fc0e0065150 2024-08-17T02:50:27.426 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:50:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.427+0000 7fc105000640 1 -- 172.21.15.5:0/2493728261 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc0e0065150 msgr2=0x7fc0e0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.427+0000 7fc105000640 1 --2- 172.21.15.5:0/2493728261 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc0e0065150 0x7fc0e0067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0034000 tx=0x7fc0f0032000 comp rx=0 tx=0).stop 2024-08-17T02:50:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.427+0000 7fc105000640 1 -- 172.21.15.5:0/2493728261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1000ca050 msgr2=0x7fc10006d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.427+0000 7fc105000640 1 --2- 172.21.15.5:0/2493728261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1000ca050 0x7fc10006d7d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800cc90 tx=0x7fc0f8001a50 comp rx=0 tx=0).stop 2024-08-17T02:50:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.427+0000 7fc105000640 1 -- 172.21.15.5:0/2493728261 shutdown_connections 2024-08-17T02:50:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.427+0000 7fc105000640 1 --2- 172.21.15.5:0/2493728261 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fc0e0065150 0x7fc0e0067600 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.427+0000 7fc105000640 1 --2- 172.21.15.5:0/2493728261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1000ca050 0x7fc10006d7d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.427+0000 7fc105000640 1 --2- 172.21.15.5:0/2493728261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1000add30 0x7fc1001511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.427+0000 7fc105000640 1 --2- 172.21.15.5:0/2493728261 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1000ad960 0x7fc1000ac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.427+0000 7fc105000640 1 -- 172.21.15.5:0/2493728261 >> 172.21.15.5:0/2493728261 conn(0x7fc100066e60 msgr2=0x7fc100154dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:27.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.427+0000 7fc105000640 1 -- 172.21.15.5:0/2493728261 shutdown_connections 2024-08-17T02:50:27.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.427+0000 7fc105000640 1 -- 172.21.15.5:0/2493728261 wait complete. 2024-08-17T02:50:27.444 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:50:27.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:50:27.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.599+0000 7efdef600640 1 Processor -- start 2024-08-17T02:50:27.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.599+0000 7efdef600640 1 -- start start 2024-08-17T02:50:27.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.600+0000 7efdef600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde8142600 0x7efde8069d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.600+0000 7efdef600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efde80a9900 0x7efde80af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.600+0000 7efdef600640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde806b360 con 0x7efde806a260 2024-08-17T02:50:27.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.600+0000 7efdef600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde806a750 con 0x7efde80a9900 2024-08-17T02:50:27.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.600+0000 7efdef600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde806aa30 con 0x7efde8142600 2024-08-17T02:50:27.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.600+0000 7efded600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efde80a9900 0x7efde80af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.600+0000 7efded600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efde80a9900 0x7efde80af0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43480/0 (socket says 172.21.15.5:43480) 2024-08-17T02:50:27.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.600+0000 7efded600640 1 -- 172.21.15.5:0/566285749 learned_addr learned my addr 172.21.15.5:0/566285749 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:27.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.601+0000 7efdecc00640 1 --2- 172.21.15.5:0/566285749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde8142600 0x7efde8069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.601+0000 7efded600640 1 -- 172.21.15.5:0/566285749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde8142600 msgr2=0x7efde8069d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:27.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.601+0000 7efded600640 1 --2- 172.21.15.5:0/566285749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde8142600 0x7efde8069d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.601+0000 7efded600640 1 -- 172.21.15.5:0/566285749 >> v1:172.21.15.107:6789/0 conn(0x7efde806a260 legacy=0x7efde80a91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.601+0000 7efded600640 1 -- 172.21.15.5:0/566285749 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde806ad10 con 0x7efde80a9900 2024-08-17T02:50:27.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.602+0000 7efded600640 1 --2- 172.21.15.5:0/566285749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde80a9900 0x7efde80af0b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efde0009f20 tx=0x7efde0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729a3a330c5ea98a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:27.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.602+0000 7efde7400640 1 -- 172.21.15.5:0/566285749 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0031400 con 0x7efde80a9900 2024-08-17T02:50:27.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.602+0000 7efde7400640 1 -- 172.21.15.5:0/566285749 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde002d050 con 0x7efde80a9900 2024-08-17T02:50:27.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.602+0000 7efde7400640 1 -- 172.21.15.5:0/566285749 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde00317d0 con 0x7efde80a9900 2024-08-17T02:50:27.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.603+0000 7efdef600640 1 -- 172.21.15.5:0/566285749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde80a9900 msgr2=0x7efde80af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.603+0000 7efdef600640 1 --2- 172.21.15.5:0/566285749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde80a9900 0x7efde80af0b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efde0009f20 tx=0x7efde0009840 comp rx=0 tx=0).stop 2024-08-17T02:50:27.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.603+0000 7efdef600640 1 -- 172.21.15.5:0/566285749 shutdown_connections 2024-08-17T02:50:27.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.603+0000 7efdef600640 1 --2- 172.21.15.5:0/566285749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde80a9900 0x7efde80af0b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.603+0000 7efdef600640 1 --2- 172.21.15.5:0/566285749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde8142600 0x7efde8069d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.603+0000 7efdef600640 1 -- 172.21.15.5:0/566285749 >> 172.21.15.5:0/566285749 conn(0x7efde8066e60 msgr2=0x7efde8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:27.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.603+0000 7efdef600640 1 -- 172.21.15.5:0/566285749 shutdown_connections 2024-08-17T02:50:27.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.603+0000 7efdef600640 1 -- 172.21.15.5:0/566285749 wait complete. 2024-08-17T02:50:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.604+0000 7efdef600640 1 Processor -- start 2024-08-17T02:50:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.604+0000 7efdef600640 1 -- start start 2024-08-17T02:50:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.605+0000 7efdef600640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde806a260 0x7efde815a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.605+0000 7efdef600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efde80a9900 0x7efde81583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.605+0000 7efdef600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde8142600 0x7efde815e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.605+0000 7efdef600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde815a420 con 0x7efde8142600 2024-08-17T02:50:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.605+0000 7efdef600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde8159810 con 0x7efde80a9900 2024-08-17T02:50:27.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.605+0000 7efdef600640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde8159af0 con 0x7efde806a260 2024-08-17T02:50:27.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.606+0000 7efded600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde8142600 0x7efde815e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.606+0000 7efded600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde8142600 0x7efde815e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43482/0 (socket says 172.21.15.5:43482) 2024-08-17T02:50:27.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.606+0000 7efded600640 1 -- 172.21.15.5:0/2205793880 learned_addr learned my addr 172.21.15.5:0/2205793880 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:27.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.606+0000 7efded600640 1 -- 172.21.15.5:0/2205793880 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde806a260 msgr2=0x7efde815a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.606+0000 7efded600640 1 --2- 172.21.15.5:0/2205793880 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efde806a260 0x7efde815a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.606+0000 7efded600640 1 -- 172.21.15.5:0/2205793880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efde80a9900 msgr2=0x7efde81583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.606+0000 7efde7e00640 1 --2- 172.21.15.5:0/2205793880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efde80a9900 0x7efde81583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.606+0000 7efded600640 1 --2- 172.21.15.5:0/2205793880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efde80a9900 0x7efde81583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.606+0000 7efded600640 1 -- 172.21.15.5:0/2205793880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde0009ae0 con 0x7efde8142600 2024-08-17T02:50:27.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.606+0000 7efde7e00640 1 --2- 172.21.15.5:0/2205793880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efde80a9900 0x7efde81583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:50:27.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.606+0000 7efded600640 1 --2- 172.21.15.5:0/2205793880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde8142600 0x7efde815e1b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7efde0009f80 tx=0x7efde0036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:27.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.607+0000 7efddbe00640 1 -- 172.21.15.5:0/2205793880 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0008e50 con 0x7efde8142600 2024-08-17T02:50:27.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.607+0000 7efddbe00640 1 -- 172.21.15.5:0/2205793880 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde003b410 con 0x7efde8142600 2024-08-17T02:50:27.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.607+0000 7efddbe00640 1 -- 172.21.15.5:0/2205793880 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde003b7d0 con 0x7efde8142600 2024-08-17T02:50:27.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.607+0000 7efdef600640 1 -- 172.21.15.5:0/2205793880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde8159dd0 con 0x7efde8142600 2024-08-17T02:50:27.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.607+0000 7efdef600640 1 -- 172.21.15.5:0/2205793880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde8158920 con 0x7efde8142600 2024-08-17T02:50:27.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.608+0000 7efdef600640 1 -- 172.21.15.5:0/2205793880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efde8063fb0 con 0x7efde8142600 2024-08-17T02:50:27.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.609+0000 7efddbe00640 1 -- 172.21.15.5:0/2205793880 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efde0038050 con 0x7efde8142600 2024-08-17T02:50:27.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.609+0000 7efddbe00640 1 --2- 172.21.15.5:0/2205793880 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efdc8065150 0x7efdc8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.609+0000 7efddbe00640 1 -- 172.21.15.5:0/2205793880 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7efde00a2e20 con 0x7efde8142600 2024-08-17T02:50:27.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.610+0000 7efdecc00640 1 --2- 172.21.15.5:0/2205793880 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efdc8065150 0x7efdc8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.610+0000 7efddbe00640 1 --2- 172.21.15.5:0/2205793880 >> [v2:172.21.15.5:6808/37203,v1:172.21.15.5:6810/37203] conn(0x7efdc806b040 0x7efdc806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.610+0000 7efddbe00640 1 -- 172.21.15.5:0/2205793880 --> [v2:172.21.15.5:6808/37203,v1:172.21.15.5:6810/37203] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efdc806db00 con 0x7efdc806b040 2024-08-17T02:50:27.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.610+0000 7efddbe00640 1 -- 172.21.15.5:0/2205793880 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7efde00a5380 con 0x7efde8142600 2024-08-17T02:50:27.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.610+0000 7efde7e00640 1 --2- 172.21.15.5:0/2205793880 >> [v2:172.21.15.5:6808/37203,v1:172.21.15.5:6810/37203] conn(0x7efdc806b040 0x7efdc806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.610+0000 7efdecc00640 1 --2- 172.21.15.5:0/2205793880 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efdc8065150 0x7efdc8067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efddc009a80 tx=0x7efddc0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:27.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.611+0000 7efde7e00640 1 --2- 172.21.15.5:0/2205793880 >> [v2:172.21.15.5:6808/37203,v1:172.21.15.5:6810/37203] conn(0x7efdc806b040 0x7efdc806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:27.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.611+0000 7efddbe00640 1 -- 172.21.15.5:0/2205793880 <== osd.2 v2:172.21.15.5:6808/37203 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7efdc806db00 con 0x7efdc806b040 2024-08-17T02:50:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.624+0000 7efdef600640 1 -- 172.21.15.5:0/2205793880 --> [v2:172.21.15.5:6808/37203,v1:172.21.15.5:6810/37203] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efde80ae7b0 con 0x7efdc806b040 2024-08-17T02:50:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.624+0000 7efddbe00640 1 -- 172.21.15.5:0/2205793880 <== osd.2 v2:172.21.15.5:6808/37203 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efde80ae7b0 con 0x7efdc806b040 2024-08-17T02:50:27.625 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:50:27.625 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:50:27.625 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:50:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.625+0000 7efdef600640 1 -- 172.21.15.5:0/2205793880 >> [v2:172.21.15.5:6808/37203,v1:172.21.15.5:6810/37203] conn(0x7efdc806b040 msgr2=0x7efdc806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.625+0000 7efdef600640 1 --2- 172.21.15.5:0/2205793880 >> [v2:172.21.15.5:6808/37203,v1:172.21.15.5:6810/37203] conn(0x7efdc806b040 0x7efdc806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.625+0000 7efdef600640 1 -- 172.21.15.5:0/2205793880 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efdc8065150 msgr2=0x7efdc8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.625+0000 7efdef600640 1 --2- 172.21.15.5:0/2205793880 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7efdc8065150 0x7efdc8067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efddc009a80 tx=0x7efddc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.625+0000 7efdef600640 1 -- 172.21.15.5:0/2205793880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde8142600 msgr2=0x7efde815e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.625+0000 7efdef600640 1 --2- 172.21.15.5:0/2205793880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde8142600 0x7efde815e1b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7efde0009f80 tx=0x7efde0036000 comp rx=0 tx=0).stop 2024-08-17T02:50:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.625+0000 7efded600640 1 -- 172.21.15.5:0/2205793880 reap_dead start 2024-08-17T02:50:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.625+0000 7efdef600640 1 -- 172.21.15.5:0/2205793880 shutdown_connections 2024-08-17T02:50:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.625+0000 7efdef600640 1 -- 172.21.15.5:0/2205793880 >> 172.21.15.5:0/2205793880 conn(0x7efde8066e60 msgr2=0x7efde80b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.625+0000 7efdef600640 1 -- 172.21.15.5:0/2205793880 shutdown_connections 2024-08-17T02:50:27.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.625+0000 7efdef600640 1 -- 172.21.15.5:0/2205793880 wait complete. 2024-08-17T02:50:27.639 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:50:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.790+0000 7eff5fe00640 1 Processor -- start 2024-08-17T02:50:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.790+0000 7eff5fe00640 1 -- start start 2024-08-17T02:50:27.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.791+0000 7eff5fe00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7eff580acf10 0x7eff580b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.791+0000 7eff5fe00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff580c92b0 con 0x7eff580afca0 2024-08-17T02:50:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.791+0000 7eff5fe00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff580ad480 con 0x7eff581590b0 2024-08-17T02:50:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.791+0000 7eff5fe00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff580b0980 con 0x7eff580acf10 2024-08-17T02:50:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.791+0000 7eff5d400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7eff580afca0 0x7eff581589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34302/0 (socket says 172.21.15.5:34302) 2024-08-17T02:50:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.791+0000 7eff5d400640 1 -- 172.21.15.5:0/3436729273 learned_addr learned my addr 172.21.15.5:0/3436729273 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff5de00640 1 --2- 172.21.15.5:0/3436729273 >> v2:172.21.15.107:3300/0 conn(0x7eff580acf10 0x7eff580b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff57e00640 1 -- 172.21.15.5:0/3436729273 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486774708 0 0) 0x7eff580c92b0 con 0x7eff580afca0 2024-08-17T02:50:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff57e00640 1 -- 172.21.15.5:0/3436729273 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff400034e0 con 0x7eff580afca0 2024-08-17T02:50:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff57e00640 1 -- 172.21.15.5:0/3436729273 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1386954258 0 0) 0x7eff400034e0 con 0x7eff580afca0 2024-08-17T02:50:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff57e00640 1 -- 172.21.15.5:0/3436729273 >> v2:172.21.15.107:3300/0 conn(0x7eff580acf10 msgr2=0x7eff580b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff57e00640 1 --2- 172.21.15.5:0/3436729273 >> v2:172.21.15.107:3300/0 conn(0x7eff580acf10 0x7eff580b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff57e00640 1 -- 172.21.15.5:0/3436729273 >> v1:172.21.15.107:6789/0 conn(0x7eff581590b0 legacy=0x7eff580c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff57e00640 1 -- 172.21.15.5:0/3436729273 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff580ad760 con 0x7eff580afca0 2024-08-17T02:50:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff57e00640 1 -- 172.21.15.5:0/3436729273 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7eff4c001470 con 0x7eff580afca0 2024-08-17T02:50:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff57e00640 1 -- 172.21.15.5:0/3436729273 >> v1:172.21.15.5:6789/0 conn(0x7eff580afca0 legacy=0x7eff581589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff57e00640 1 --2- 172.21.15.5:0/3436729273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff400039d0 0x7eff40003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff57e00640 1 --2- 172.21.15.5:0/3436729273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff40004780 0x7eff40004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff57e00640 1 --2- 172.21.15.5:0/3436729273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff40005130 0x7eff4000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff57e00640 1 -- 172.21.15.5:0/3436729273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4000c010 con 0x7eff40004780 2024-08-17T02:50:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff57e00640 1 -- 172.21.15.5:0/3436729273 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4000c180 con 0x7eff400039d0 2024-08-17T02:50:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff57e00640 1 -- 172.21.15.5:0/3436729273 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4000c340 con 0x7eff40005130 2024-08-17T02:50:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.792+0000 7eff5de00640 1 --2- 172.21.15.5:0/3436729273 >> v2:172.21.15.107:3300/0 conn(0x7eff580acf10 0x7eff580b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.793+0000 7eff5ca00640 1 --2- 172.21.15.5:0/3436729273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff40004780 0x7eff40004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.793+0000 7eff5d400640 1 --2- 172.21.15.5:0/3436729273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff400039d0 0x7eff40003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.793+0000 7eff5de00640 1 --2- 172.21.15.5:0/3436729273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff40005130 0x7eff4000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.793+0000 7eff5ca00640 1 -- 172.21.15.5:0/3436729273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff40005130 msgr2=0x7eff4000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.793+0000 7eff5ca00640 1 --2- 172.21.15.5:0/3436729273 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff40005130 0x7eff4000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.793+0000 7eff5ca00640 1 -- 172.21.15.5:0/3436729273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff400039d0 msgr2=0x7eff40003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.793+0000 7eff5ca00640 1 --2- 172.21.15.5:0/3436729273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff400039d0 0x7eff40003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.793+0000 7eff5ca00640 1 -- 172.21.15.5:0/3436729273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff400034e0 con 0x7eff40004780 2024-08-17T02:50:27.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.793+0000 7eff5de00640 1 -- 172.21.15.5:0/3436729273 reap_dead start 2024-08-17T02:50:27.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.794+0000 7eff5ca00640 1 --2- 172.21.15.5:0/3436729273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff40004780 0x7eff40004bf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7eff581594f0 tx=0x7eff44007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652f3d6fec19c269 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:27.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.794+0000 7eff57e00640 1 -- 172.21.15.5:0/3436729273 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4402a8b0 con 0x7eff40004780 2024-08-17T02:50:27.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.794+0000 7eff57e00640 1 -- 172.21.15.5:0/3436729273 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4402aa30 con 0x7eff40004780 2024-08-17T02:50:27.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.794+0000 7eff57e00640 1 -- 172.21.15.5:0/3436729273 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4402adf0 con 0x7eff40004780 2024-08-17T02:50:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.795+0000 7eff5fe00640 1 -- 172.21.15.5:0/3436729273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff40004780 msgr2=0x7eff40004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.795+0000 7eff5fe00640 1 --2- 172.21.15.5:0/3436729273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff40004780 0x7eff40004bf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7eff581594f0 tx=0x7eff44007ca0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.795+0000 7eff5fe00640 1 -- 172.21.15.5:0/3436729273 shutdown_connections 2024-08-17T02:50:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.795+0000 7eff5fe00640 1 --2- 172.21.15.5:0/3436729273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff40004780 0x7eff40004bf0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.795+0000 7eff5fe00640 1 -- 172.21.15.5:0/3436729273 >> 172.21.15.5:0/3436729273 conn(0x7eff58066e60 msgr2=0x7eff58067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.795+0000 7eff5fe00640 1 -- 172.21.15.5:0/3436729273 shutdown_connections 2024-08-17T02:50:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.795+0000 7eff5fe00640 1 -- 172.21.15.5:0/3436729273 wait complete. 2024-08-17T02:50:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.796+0000 7eff5fe00640 1 Processor -- start 2024-08-17T02:50:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.797+0000 7eff5fe00640 1 -- start start 2024-08-17T02:50:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.797+0000 7eff5fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff40004780 0x7eff58153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.797+0000 7eff5fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff58156e40 0x7eff581572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.797+0000 7eff5fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff580c56e0 0x7eff580c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.797+0000 7eff5fe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff581577f0 con 0x7eff580c56e0 2024-08-17T02:50:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.797+0000 7eff5fe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff581699f0 con 0x7eff58156e40 2024-08-17T02:50:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.797+0000 7eff5fe00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff58168de0 con 0x7eff40004780 2024-08-17T02:50:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.798+0000 7eff5de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff580c56e0 0x7eff580c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.798+0000 7eff5de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff580c56e0 0x7eff580c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43506/0 (socket says 172.21.15.5:43506) 2024-08-17T02:50:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.798+0000 7eff5de00640 1 -- 172.21.15.5:0/4242795635 learned_addr learned my addr 172.21.15.5:0/4242795635 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.798+0000 7eff5d400640 1 --2- 172.21.15.5:0/4242795635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff40004780 0x7eff58153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.798+0000 7eff5ca00640 1 --2- 172.21.15.5:0/4242795635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff58156e40 0x7eff581572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.798+0000 7eff5de00640 1 -- 172.21.15.5:0/4242795635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff40004780 msgr2=0x7eff58153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.798+0000 7eff5de00640 1 --2- 172.21.15.5:0/4242795635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff40004780 0x7eff58153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.798+0000 7eff5de00640 1 -- 172.21.15.5:0/4242795635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff58156e40 msgr2=0x7eff581572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.798+0000 7eff5de00640 1 --2- 172.21.15.5:0/4242795635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff58156e40 0x7eff581572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.798+0000 7eff5de00640 1 -- 172.21.15.5:0/4242795635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff581690c0 con 0x7eff580c56e0 2024-08-17T02:50:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.798+0000 7eff5d400640 1 --2- 172.21.15.5:0/4242795635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff40004780 0x7eff58153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.798+0000 7eff5de00640 1 --2- 172.21.15.5:0/4242795635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff580c56e0 0x7eff580c5b30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7eff580cb4a0 tx=0x7eff5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.798+0000 7eff54c00640 1 -- 172.21.15.5:0/4242795635 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5000e070 con 0x7eff580c56e0 2024-08-17T02:50:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.799+0000 7eff54c00640 1 -- 172.21.15.5:0/4242795635 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff50011750 con 0x7eff580c56e0 2024-08-17T02:50:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.799+0000 7eff54c00640 1 -- 172.21.15.5:0/4242795635 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50011b30 con 0x7eff580c56e0 2024-08-17T02:50:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.799+0000 7eff5fe00640 1 -- 172.21.15.5:0/4242795635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff581693a0 con 0x7eff580c56e0 2024-08-17T02:50:27.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.799+0000 7eff5fe00640 1 -- 172.21.15.5:0/4242795635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff580c6070 con 0x7eff580c56e0 2024-08-17T02:50:27.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.800+0000 7eff5fe00640 1 -- 172.21.15.5:0/4242795635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff58169b80 con 0x7eff580c56e0 2024-08-17T02:50:27.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.800+0000 7eff54c00640 1 -- 172.21.15.5:0/4242795635 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7eff50016470 con 0x7eff580c56e0 2024-08-17T02:50:27.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.801+0000 7eff54c00640 1 --2- 172.21.15.5:0/4242795635 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7eff38065150 0x7eff38067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:27.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.801+0000 7eff54c00640 1 -- 172.21.15.5:0/4242795635 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7eff50082840 con 0x7eff580c56e0 2024-08-17T02:50:27.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.802+0000 7eff5d400640 1 --2- 172.21.15.5:0/4242795635 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7eff38065150 0x7eff38067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:27.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.802+0000 7eff5d400640 1 --2- 172.21.15.5:0/4242795635 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7eff38065150 0x7eff38067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7eff4c000e10 tx=0x7eff4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:27.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.805+0000 7eff54c00640 1 -- 172.21.15.5:0/4242795635 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7eff50050ba0 con 0x7eff580c56e0 2024-08-17T02:50:27.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.987+0000 7eff5fe00640 1 -- 172.21.15.5:0/4242795635 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7eff58063fb0 con 0x7eff38065150 2024-08-17T02:50:27.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.988+0000 7eff54c00640 1 -- 172.21.15.5:0/4242795635 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7eff58063fb0 con 0x7eff38065150 2024-08-17T02:50:27.988 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:50:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.990+0000 7eff5fe00640 1 -- 172.21.15.5:0/4242795635 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7eff38065150 msgr2=0x7eff38067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.990+0000 7eff5fe00640 1 --2- 172.21.15.5:0/4242795635 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7eff38065150 0x7eff38067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7eff4c000e10 tx=0x7eff4c009040 comp rx=0 tx=0).stop 2024-08-17T02:50:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.990+0000 7eff5fe00640 1 -- 172.21.15.5:0/4242795635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff580c56e0 msgr2=0x7eff580c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.990+0000 7eff5fe00640 1 --2- 172.21.15.5:0/4242795635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff580c56e0 0x7eff580c5b30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7eff580cb4a0 tx=0x7eff5000b040 comp rx=0 tx=0).stop 2024-08-17T02:50:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.990+0000 7eff5fe00640 1 -- 172.21.15.5:0/4242795635 shutdown_connections 2024-08-17T02:50:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.990+0000 7eff5fe00640 1 --2- 172.21.15.5:0/4242795635 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7eff38065150 0x7eff38067600 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.990+0000 7eff5fe00640 1 --2- 172.21.15.5:0/4242795635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff580c56e0 0x7eff580c5b30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.990+0000 7eff5fe00640 1 --2- 172.21.15.5:0/4242795635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff58156e40 0x7eff581572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.990+0000 7eff5fe00640 1 --2- 172.21.15.5:0/4242795635 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff40004780 0x7eff58153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.990+0000 7eff5fe00640 1 -- 172.21.15.5:0/4242795635 >> 172.21.15.5:0/4242795635 conn(0x7eff58066e60 msgr2=0x7eff5806ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:27.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.990+0000 7eff5fe00640 1 -- 172.21.15.5:0/4242795635 shutdown_connections 2024-08-17T02:50:27.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:27.990+0000 7eff5fe00640 1 -- 172.21.15.5:0/4242795635 wait complete. 2024-08-17T02:50:28.005 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:50:28.005 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:50:28.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.160+0000 7f2414400640 1 Processor -- start 2024-08-17T02:50:28.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.160+0000 7f2414400640 1 -- start start 2024-08-17T02:50:28.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.161+0000 7f2414400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f240c0ac000 0x7f240c156a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.161+0000 7f2414400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f240c0ad020 0x7f240c159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.161+0000 7f2414400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240c159ad0 con 0x7f240c0afa00 2024-08-17T02:50:28.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.161+0000 7f2414400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240c156f40 con 0x7f240c0ac000 2024-08-17T02:50:28.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.161+0000 7f2414400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0ad590 con 0x7f240c0ad020 2024-08-17T02:50:28.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.162+0000 7f2411a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f240c0ac000 0x7f240c156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.162+0000 7f2412400640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f240c0afa00 0x7f240c157190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:58896/0 (socket says 172.21.15.5:58896) 2024-08-17T02:50:28.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.162+0000 7f2411a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f240c0ac000 0x7f240c156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:39978/0 (socket says 172.21.15.5:39978) 2024-08-17T02:50:28.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.162+0000 7f2412400640 1 -- 172.21.15.5:0/3666610274 learned_addr learned my addr 172.21.15.5:0/3666610274 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:28.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.162+0000 7f2411000640 1 --2- 172.21.15.5:0/3666610274 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f240c0ad020 0x7f240c159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.162+0000 7f2411a00640 1 -- 172.21.15.5:0/3666610274 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f240c0ad020 msgr2=0x7f240c159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.162+0000 7f2411a00640 1 --2- 172.21.15.5:0/3666610274 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f240c0ad020 0x7f240c159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.162+0000 7f2411a00640 1 -- 172.21.15.5:0/3666610274 >> v1:172.21.15.107:6789/0 conn(0x7f240c0afa00 legacy=0x7f240c157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.162+0000 7f2411a00640 1 -- 172.21.15.5:0/3666610274 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c0ad870 con 0x7f240c0ac000 2024-08-17T02:50:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.163+0000 7f2411a00640 1 --2- 172.21.15.5:0/3666610274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f240c0ac000 0x7f240c156a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2400009850 tx=0x7f24000090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41054acf00d0d621 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.164+0000 7f240be00640 1 -- 172.21.15.5:0/3666610274 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240002ad00 con 0x7f240c0ac000 2024-08-17T02:50:28.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.164+0000 7f240be00640 1 -- 172.21.15.5:0/3666610274 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240002ae60 con 0x7f240c0ac000 2024-08-17T02:50:28.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.164+0000 7f240be00640 1 -- 172.21.15.5:0/3666610274 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2400032670 con 0x7f240c0ac000 2024-08-17T02:50:28.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.164+0000 7f2414400640 1 -- 172.21.15.5:0/3666610274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f240c0ac000 msgr2=0x7f240c156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.164+0000 7f2414400640 1 --2- 172.21.15.5:0/3666610274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f240c0ac000 0x7f240c156a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2400009850 tx=0x7f24000090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.164+0000 7f2414400640 1 -- 172.21.15.5:0/3666610274 shutdown_connections 2024-08-17T02:50:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.164+0000 7f2414400640 1 --2- 172.21.15.5:0/3666610274 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f240c0ad020 0x7f240c159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.164+0000 7f2414400640 1 --2- 172.21.15.5:0/3666610274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f240c0ac000 0x7f240c156a00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.164+0000 7f2414400640 1 -- 172.21.15.5:0/3666610274 >> 172.21.15.5:0/3666610274 conn(0x7f240c066e60 msgr2=0x7f240c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.164+0000 7f2414400640 1 -- 172.21.15.5:0/3666610274 shutdown_connections 2024-08-17T02:50:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.164+0000 7f2414400640 1 -- 172.21.15.5:0/3666610274 wait complete. 2024-08-17T02:50:28.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.166+0000 7f2414400640 1 Processor -- start 2024-08-17T02:50:28.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.166+0000 7f2414400640 1 -- start start 2024-08-17T02:50:28.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.167+0000 7f2414400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f240c0ac000 0x7f240c0c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.167+0000 7f2414400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f240c0ad020 0x7f240c0aa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.167+0000 7f2414400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240c0afa00 0x7f240c14a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.167+0000 7f2414400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0c6880 con 0x7f240c0afa00 2024-08-17T02:50:28.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.167+0000 7f2414400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0c5c70 con 0x7f240c0ac000 2024-08-17T02:50:28.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.167+0000 7f2414400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0c5f50 con 0x7f240c0ad020 2024-08-17T02:50:28.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.167+0000 7f2412400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240c0afa00 0x7f240c14a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.167+0000 7f2412400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240c0afa00 0x7f240c14a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43508/0 (socket says 172.21.15.5:43508) 2024-08-17T02:50:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.167+0000 7f2412400640 1 -- 172.21.15.5:0/820607616 learned_addr learned my addr 172.21.15.5:0/820607616 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.167+0000 7f2411a00640 1 --2- 172.21.15.5:0/820607616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f240c0ac000 0x7f240c0c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.167+0000 7f2411000640 1 --2- 172.21.15.5:0/820607616 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f240c0ad020 0x7f240c0aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.168+0000 7f2412400640 1 -- 172.21.15.5:0/820607616 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f240c0ad020 msgr2=0x7f240c0aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.168+0000 7f2412400640 1 --2- 172.21.15.5:0/820607616 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f240c0ad020 0x7f240c0aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.168+0000 7f2412400640 1 -- 172.21.15.5:0/820607616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f240c0ac000 msgr2=0x7f240c0c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.168+0000 7f2412400640 1 --2- 172.21.15.5:0/820607616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f240c0ac000 0x7f240c0c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.168+0000 7f2412400640 1 -- 172.21.15.5:0/820607616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2400009390 con 0x7f240c0afa00 2024-08-17T02:50:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.168+0000 7f2412400640 1 --2- 172.21.15.5:0/820607616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240c0afa00 0x7f240c14a390 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f240400cc40 tx=0x7f2404001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.168+0000 7f2408c00640 1 -- 172.21.15.5:0/820607616 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240400ce60 con 0x7f240c0afa00 2024-08-17T02:50:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.168+0000 7f2408c00640 1 -- 172.21.15.5:0/820607616 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240400a850 con 0x7f240c0afa00 2024-08-17T02:50:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.168+0000 7f2408c00640 1 -- 172.21.15.5:0/820607616 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240400ac10 con 0x7f240c0afa00 2024-08-17T02:50:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.168+0000 7f2414400640 1 -- 172.21.15.5:0/820607616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240c0c6230 con 0x7f240c0afa00 2024-08-17T02:50:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.168+0000 7f2414400640 1 -- 172.21.15.5:0/820607616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240c0aa870 con 0x7f240c0afa00 2024-08-17T02:50:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.169+0000 7f2414400640 1 -- 172.21.15.5:0/820607616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f240c063fb0 con 0x7f240c0afa00 2024-08-17T02:50:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.170+0000 7f2408c00640 1 -- 172.21.15.5:0/820607616 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2404007300 con 0x7f240c0afa00 2024-08-17T02:50:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.171+0000 7f2408c00640 1 --2- 172.21.15.5:0/820607616 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f23ec065150 0x7f23ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.171+0000 7f2408c00640 1 -- 172.21.15.5:0/820607616 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2404082250 con 0x7f240c0afa00 2024-08-17T02:50:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.171+0000 7f2408c00640 1 --2- 172.21.15.5:0/820607616 >> [v2:172.21.15.5:6824/37194,v1:172.21.15.5:6825/37194] conn(0x7f23ec06b040 0x7f23ec06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.171+0000 7f2408c00640 1 -- 172.21.15.5:0/820607616 --> [v2:172.21.15.5:6824/37194,v1:172.21.15.5:6825/37194] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f23ec06db00 con 0x7f23ec06b040 2024-08-17T02:50:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.171+0000 7f2408c00640 1 -- 172.21.15.5:0/820607616 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2404084750 con 0x7f240c0afa00 2024-08-17T02:50:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.171+0000 7f2411a00640 1 --2- 172.21.15.5:0/820607616 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f23ec065150 0x7f23ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.171+0000 7f2411000640 1 --2- 172.21.15.5:0/820607616 >> [v2:172.21.15.5:6824/37194,v1:172.21.15.5:6825/37194] conn(0x7f23ec06b040 0x7f23ec06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.172+0000 7f2411a00640 1 --2- 172.21.15.5:0/820607616 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f23ec065150 0x7f23ec067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2400034000 tx=0x7f2400032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.172+0000 7f2411000640 1 --2- 172.21.15.5:0/820607616 >> [v2:172.21.15.5:6824/37194,v1:172.21.15.5:6825/37194] conn(0x7f23ec06b040 0x7f23ec06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.173+0000 7f2408c00640 1 -- 172.21.15.5:0/820607616 <== osd.3 v2:172.21.15.5:6824/37194 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f23ec06db00 con 0x7f23ec06b040 2024-08-17T02:50:28.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.185+0000 7f2414400640 1 -- 172.21.15.5:0/820607616 --> [v2:172.21.15.5:6824/37194,v1:172.21.15.5:6825/37194] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f240c067c10 con 0x7f23ec06b040 2024-08-17T02:50:28.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.186+0000 7f2408c00640 1 -- 172.21.15.5:0/820607616 <== osd.3 v2:172.21.15.5:6824/37194 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f240c067c10 con 0x7f23ec06b040 2024-08-17T02:50:28.186 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:50:28.187 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:50:28.187 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:50:28.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.186+0000 7f2414400640 1 -- 172.21.15.5:0/820607616 >> [v2:172.21.15.5:6824/37194,v1:172.21.15.5:6825/37194] conn(0x7f23ec06b040 msgr2=0x7f23ec06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.186+0000 7f2414400640 1 --2- 172.21.15.5:0/820607616 >> [v2:172.21.15.5:6824/37194,v1:172.21.15.5:6825/37194] conn(0x7f23ec06b040 0x7f23ec06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.186+0000 7f2414400640 1 -- 172.21.15.5:0/820607616 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f23ec065150 msgr2=0x7f23ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.186+0000 7f2414400640 1 --2- 172.21.15.5:0/820607616 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f23ec065150 0x7f23ec067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2400034000 tx=0x7f2400032000 comp rx=0 tx=0).stop 2024-08-17T02:50:28.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.186+0000 7f2414400640 1 -- 172.21.15.5:0/820607616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240c0afa00 msgr2=0x7f240c14a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.186+0000 7f2414400640 1 --2- 172.21.15.5:0/820607616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240c0afa00 0x7f240c14a390 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f240400cc40 tx=0x7f2404001a50 comp rx=0 tx=0).stop 2024-08-17T02:50:28.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.186+0000 7f2412400640 1 -- 172.21.15.5:0/820607616 reap_dead start 2024-08-17T02:50:28.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.186+0000 7f2414400640 1 -- 172.21.15.5:0/820607616 shutdown_connections 2024-08-17T02:50:28.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.186+0000 7f2414400640 1 -- 172.21.15.5:0/820607616 >> 172.21.15.5:0/820607616 conn(0x7f240c066e60 msgr2=0x7f240c06ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:28.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.187+0000 7f2414400640 1 -- 172.21.15.5:0/820607616 shutdown_connections 2024-08-17T02:50:28.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.187+0000 7f2414400640 1 -- 172.21.15.5:0/820607616 wait complete. 2024-08-17T02:50:28.201 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:50:28.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.352+0000 7f1132400640 1 Processor -- start 2024-08-17T02:50:28.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.352+0000 7f1132400640 1 -- start start 2024-08-17T02:50:28.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.354+0000 7f1132400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f112c159eb0 0x7f112c156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.354+0000 7f1132400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f112c0adcd0 0x7f112c0af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.354+0000 7f1132400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f112c157430 con 0x7f112c0c81a0 2024-08-17T02:50:28.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.354+0000 7f1132400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f112c0b0c50 con 0x7f112c159eb0 2024-08-17T02:50:28.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.354+0000 7f1132400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f112c0cb1e0 con 0x7f112c0adcd0 2024-08-17T02:50:28.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.354+0000 7f1131000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f112c159eb0 0x7f112c156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.354+0000 7f1131000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f112c159eb0 0x7f112c156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43520/0 (socket says 172.21.15.5:43520) 2024-08-17T02:50:28.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.354+0000 7f1131000640 1 -- 172.21.15.5:0/2827762524 learned_addr learned my addr 172.21.15.5:0/2827762524 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:28.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.354+0000 7f1131a00640 1 --2- 172.21.15.5:0/2827762524 >> v2:172.21.15.107:3300/0 conn(0x7f112c0adcd0 0x7f112c0af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.354+0000 7f1131000640 1 -- 172.21.15.5:0/2827762524 >> v2:172.21.15.107:3300/0 conn(0x7f112c0adcd0 msgr2=0x7f112c0af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:28.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.354+0000 7f1131000640 1 --2- 172.21.15.5:0/2827762524 >> v2:172.21.15.107:3300/0 conn(0x7f112c0adcd0 0x7f112c0af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.354+0000 7f1131000640 1 -- 172.21.15.5:0/2827762524 >> v1:172.21.15.107:6789/0 conn(0x7f112c0c81a0 legacy=0x7f112c0ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:28.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.355+0000 7f1131000640 1 -- 172.21.15.5:0/2827762524 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c0cac20 con 0x7f112c159eb0 2024-08-17T02:50:28.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.356+0000 7f1131000640 1 --2- 172.21.15.5:0/2827762524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c159eb0 0x7f112c156ef0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f112c0c9620 tx=0x7f11200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25aba401b88da91 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:28.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.356+0000 7f112b400640 1 -- 172.21.15.5:0/2827762524 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112002ad40 con 0x7f112c159eb0 2024-08-17T02:50:28.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.356+0000 7f112b400640 1 -- 172.21.15.5:0/2827762524 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1120032440 con 0x7f112c159eb0 2024-08-17T02:50:28.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.356+0000 7f112b400640 1 -- 172.21.15.5:0/2827762524 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112002aea0 con 0x7f112c159eb0 2024-08-17T02:50:28.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.356+0000 7f1132400640 1 -- 172.21.15.5:0/2827762524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c159eb0 msgr2=0x7f112c156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.356+0000 7f1132400640 1 --2- 172.21.15.5:0/2827762524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c159eb0 0x7f112c156ef0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f112c0c9620 tx=0x7f11200091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.357+0000 7f1132400640 1 -- 172.21.15.5:0/2827762524 shutdown_connections 2024-08-17T02:50:28.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.357+0000 7f1132400640 1 --2- 172.21.15.5:0/2827762524 >> v2:172.21.15.107:3300/0 conn(0x7f112c0adcd0 0x7f112c0af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.357+0000 7f1132400640 1 --2- 172.21.15.5:0/2827762524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c159eb0 0x7f112c156ef0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.357+0000 7f1132400640 1 -- 172.21.15.5:0/2827762524 >> 172.21.15.5:0/2827762524 conn(0x7f112c066e60 msgr2=0x7f112c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:28.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.357+0000 7f1132400640 1 -- 172.21.15.5:0/2827762524 shutdown_connections 2024-08-17T02:50:28.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.357+0000 7f1132400640 1 -- 172.21.15.5:0/2827762524 wait complete. 2024-08-17T02:50:28.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.358+0000 7f1132400640 1 Processor -- start 2024-08-17T02:50:28.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.359+0000 7f1132400640 1 -- start start 2024-08-17T02:50:28.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.359+0000 7f1132400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c0adcd0 0x7f112c154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.359+0000 7f1132400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f112c0c81a0 0x7f112c0a6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.359+0000 7f1132400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f112c159eb0 0x7f112c15b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.359+0000 7f1132400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c0a9030 con 0x7f112c0adcd0 2024-08-17T02:50:28.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.359+0000 7f1132400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c1546b0 con 0x7f112c0c81a0 2024-08-17T02:50:28.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.359+0000 7f1132400640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c0a8420 con 0x7f112c159eb0 2024-08-17T02:50:28.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.360+0000 7f1131000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c0adcd0 0x7f112c154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.360+0000 7f1131000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c0adcd0 0x7f112c154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43534/0 (socket says 172.21.15.5:43534) 2024-08-17T02:50:28.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.360+0000 7f1131000640 1 -- 172.21.15.5:0/1656234778 learned_addr learned my addr 172.21.15.5:0/1656234778 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:28.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.360+0000 7f1131a00640 1 --2- 172.21.15.5:0/1656234778 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f112c159eb0 0x7f112c15b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.360+0000 7f112be00640 1 --2- 172.21.15.5:0/1656234778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f112c0c81a0 0x7f112c0a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.360+0000 7f1131000640 1 -- 172.21.15.5:0/1656234778 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f112c159eb0 msgr2=0x7f112c15b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.360+0000 7f1131000640 1 --2- 172.21.15.5:0/1656234778 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f112c159eb0 0x7f112c15b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.360+0000 7f1131000640 1 -- 172.21.15.5:0/1656234778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f112c0c81a0 msgr2=0x7f112c0a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.360+0000 7f1131000640 1 --2- 172.21.15.5:0/1656234778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f112c0c81a0 0x7f112c0a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.360+0000 7f1131000640 1 -- 172.21.15.5:0/1656234778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1120009450 con 0x7f112c0adcd0 2024-08-17T02:50:28.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.361+0000 7f1131000640 1 --2- 172.21.15.5:0/1656234778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c0adcd0 0x7f112c154170 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1120009210 tx=0x7f1120032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:28.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.361+0000 7f111fe00640 1 -- 172.21.15.5:0/1656234778 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120031a60 con 0x7f112c0adcd0 2024-08-17T02:50:28.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.361+0000 7f111fe00640 1 -- 172.21.15.5:0/1656234778 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1120031be0 con 0x7f112c0adcd0 2024-08-17T02:50:28.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.361+0000 7f1132400640 1 -- 172.21.15.5:0/1656234778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112c0a8700 con 0x7f112c0adcd0 2024-08-17T02:50:28.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.361+0000 7f111fe00640 1 -- 172.21.15.5:0/1656234778 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112003d420 con 0x7f112c0adcd0 2024-08-17T02:50:28.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.361+0000 7f1132400640 1 -- 172.21.15.5:0/1656234778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112c0a8cc0 con 0x7f112c0adcd0 2024-08-17T02:50:28.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.362+0000 7f1132400640 1 -- 172.21.15.5:0/1656234778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f112c070720 con 0x7f112c0adcd0 2024-08-17T02:50:28.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.363+0000 7f111fe00640 1 -- 172.21.15.5:0/1656234778 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1120039040 con 0x7f112c0adcd0 2024-08-17T02:50:28.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.364+0000 7f111fe00640 1 --2- 172.21.15.5:0/1656234778 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f110c065150 0x7f110c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.364+0000 7f111fe00640 1 -- 172.21.15.5:0/1656234778 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f11200a1fe0 con 0x7f112c0adcd0 2024-08-17T02:50:28.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.364+0000 7f112be00640 1 --2- 172.21.15.5:0/1656234778 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f110c065150 0x7f110c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.365+0000 7f112be00640 1 --2- 172.21.15.5:0/1656234778 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f110c065150 0x7f110c067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f112c0c7cf0 tx=0x7f1118007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:28.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.368+0000 7f111fe00640 1 -- 172.21.15.5:0/1656234778 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f11200703b0 con 0x7f112c0adcd0 2024-08-17T02:50:28.441 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:28.445 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.551+0000 7f1132400640 1 -- 172.21.15.5:0/1656234778 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f112c0a9170 con 0x7f110c065150 2024-08-17T02:50:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.552+0000 7f111fe00640 1 -- 172.21.15.5:0/1656234778 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f11180028a0 con 0x7f110c065150 2024-08-17T02:50:28.552 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:50:28.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.554+0000 7f1132400640 1 -- 172.21.15.5:0/1656234778 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f110c065150 msgr2=0x7f110c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.554+0000 7f1132400640 1 --2- 172.21.15.5:0/1656234778 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f110c065150 0x7f110c067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f112c0c7cf0 tx=0x7f1118007e30 comp rx=0 tx=0).stop 2024-08-17T02:50:28.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.554+0000 7f1132400640 1 -- 172.21.15.5:0/1656234778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c0adcd0 msgr2=0x7f112c154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.554+0000 7f1132400640 1 --2- 172.21.15.5:0/1656234778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c0adcd0 0x7f112c154170 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1120009210 tx=0x7f1120032000 comp rx=0 tx=0).stop 2024-08-17T02:50:28.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.554+0000 7f1132400640 1 -- 172.21.15.5:0/1656234778 shutdown_connections 2024-08-17T02:50:28.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.554+0000 7f1132400640 1 --2- 172.21.15.5:0/1656234778 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f110c065150 0x7f110c067600 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.554+0000 7f1132400640 1 --2- 172.21.15.5:0/1656234778 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f112c159eb0 0x7f112c15b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.554+0000 7f1132400640 1 --2- 172.21.15.5:0/1656234778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f112c0c81a0 0x7f112c0a6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.554+0000 7f1132400640 1 --2- 172.21.15.5:0/1656234778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c0adcd0 0x7f112c154170 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.554+0000 7f1132400640 1 -- 172.21.15.5:0/1656234778 >> 172.21.15.5:0/1656234778 conn(0x7f112c066e60 msgr2=0x7f112c067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:28.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.554+0000 7f1132400640 1 -- 172.21.15.5:0/1656234778 shutdown_connections 2024-08-17T02:50:28.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.554+0000 7f1132400640 1 -- 172.21.15.5:0/1656234778 wait complete. 2024-08-17T02:50:28.569 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:50:28.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:50:28.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.764+0000 7f547da00640 1 Processor -- start 2024-08-17T02:50:28.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.765+0000 7f547da00640 1 -- start start 2024-08-17T02:50:28.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.766+0000 7f547da00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5478158c90 0x7f547815d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.766+0000 7f547da00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54780a9680 0x7f54780ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.766+0000 7f547da00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547815d820 con 0x7f5478062fb0 2024-08-17T02:50:28.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.766+0000 7f547da00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547806e280 con 0x7f5478158c90 2024-08-17T02:50:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.766+0000 7f547da00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547806e540 con 0x7f54780a9680 2024-08-17T02:50:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.767+0000 7f547d000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54780a9680 0x7f54780ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.767+0000 7f546fe00640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f5478062fb0 0x7f54780a8f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.5:58912/0 (socket says 172.21.15.5:58912) 2024-08-17T02:50:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.767+0000 7f546fe00640 1 -- 172.21.15.5:0/2438607456 learned_addr learned my addr 172.21.15.5:0/2438607456 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.767+0000 7f5477e00640 1 --2- 172.21.15.5:0/2438607456 >> v2:172.21.15.107:3300/0 conn(0x7f5478158c90 0x7f547815d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.767+0000 7f547d000640 1 -- 172.21.15.5:0/2438607456 >> v2:172.21.15.107:3300/0 conn(0x7f5478158c90 msgr2=0x7f547815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:28.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.767+0000 7f547d000640 1 --2- 172.21.15.5:0/2438607456 >> v2:172.21.15.107:3300/0 conn(0x7f5478158c90 0x7f547815d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.767+0000 7f5477400640 1 -- 172.21.15.5:0/2438607456 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3881276511 0 0) 0x7f5460001110 con 0x7f5478062fb0 2024-08-17T02:50:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.767+0000 7f547d000640 1 -- 172.21.15.5:0/2438607456 >> v1:172.21.15.107:6789/0 conn(0x7f5478062fb0 legacy=0x7f54780a8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.767+0000 7f547d000640 1 -- 172.21.15.5:0/2438607456 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547806e820 con 0x7f54780a9680 2024-08-17T02:50:28.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.768+0000 7f547d000640 1 --2- 172.21.15.5:0/2438607456 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54780a9680 0x7f54780ca920 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5470009e60 tx=0x7f5470009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84a989ae9a786b90 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:28.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.769+0000 7f5477400640 1 -- 172.21.15.5:0/2438607456 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470007550 con 0x7f54780a9680 2024-08-17T02:50:28.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.769+0000 7f5477400640 1 -- 172.21.15.5:0/2438607456 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547002d050 con 0x7f54780a9680 2024-08-17T02:50:28.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.769+0000 7f5477400640 1 -- 172.21.15.5:0/2438607456 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470007900 con 0x7f54780a9680 2024-08-17T02:50:28.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.769+0000 7f547da00640 1 -- 172.21.15.5:0/2438607456 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54780a9680 msgr2=0x7f54780ca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.769+0000 7f547da00640 1 --2- 172.21.15.5:0/2438607456 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54780a9680 0x7f54780ca920 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5470009e60 tx=0x7f5470009780 comp rx=0 tx=0).stop 2024-08-17T02:50:28.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.769+0000 7f547da00640 1 -- 172.21.15.5:0/2438607456 shutdown_connections 2024-08-17T02:50:28.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.769+0000 7f547da00640 1 --2- 172.21.15.5:0/2438607456 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54780a9680 0x7f54780ca920 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.769+0000 7f547da00640 1 --2- 172.21.15.5:0/2438607456 >> v2:172.21.15.107:3300/0 conn(0x7f5478158c90 0x7f547815d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.769+0000 7f547da00640 1 -- 172.21.15.5:0/2438607456 >> 172.21.15.5:0/2438607456 conn(0x7f54780cc040 msgr2=0x7f54780cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:28.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.769+0000 7f547da00640 1 -- 172.21.15.5:0/2438607456 shutdown_connections 2024-08-17T02:50:28.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.769+0000 7f547da00640 1 -- 172.21.15.5:0/2438607456 wait complete. 2024-08-17T02:50:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.771+0000 7f547da00640 1 Processor -- start 2024-08-17T02:50:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.771+0000 7f547da00640 1 -- start start 2024-08-17T02:50:28.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.772+0000 7f547da00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5478062fb0 0x7f54780aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.772+0000 7f547da00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54780a9680 0x7f5478154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.772+0000 7f547da00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5478158c90 0x7f5478169590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.772+0000 7f547da00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5478169100 con 0x7f5478062fb0 2024-08-17T02:50:28.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.772+0000 7f547da00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54780ad290 con 0x7f54780a9680 2024-08-17T02:50:28.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.772+0000 7f547da00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54780ad570 con 0x7f5478158c90 2024-08-17T02:50:28.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.772+0000 7f5477e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5478062fb0 0x7f54780aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.772+0000 7f5477e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5478062fb0 0x7f54780aca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43546/0 (socket says 172.21.15.5:43546) 2024-08-17T02:50:28.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.772+0000 7f5477e00640 1 -- 172.21.15.5:0/400359183 learned_addr learned my addr 172.21.15.5:0/400359183 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:28.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.772+0000 7f546fe00640 1 --2- 172.21.15.5:0/400359183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54780a9680 0x7f5478154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.772+0000 7f547d000640 1 --2- 172.21.15.5:0/400359183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5478158c90 0x7f5478169590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.772+0000 7f5477e00640 1 -- 172.21.15.5:0/400359183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5478158c90 msgr2=0x7f5478169590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.772+0000 7f5477e00640 1 --2- 172.21.15.5:0/400359183 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5478158c90 0x7f5478169590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.773+0000 7f5477e00640 1 -- 172.21.15.5:0/400359183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54780a9680 msgr2=0x7f5478154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.773+0000 7f5477e00640 1 --2- 172.21.15.5:0/400359183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54780a9680 0x7f5478154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.773+0000 7f5477e00640 1 -- 172.21.15.5:0/400359183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5470009a20 con 0x7f5478062fb0 2024-08-17T02:50:28.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.773+0000 7f546fe00640 1 --2- 172.21.15.5:0/400359183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54780a9680 0x7f5478154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:28.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.773+0000 7f5477e00640 1 --2- 172.21.15.5:0/400359183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5478062fb0 0x7f54780aca40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f546800e900 tx=0x7f54680090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:28.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.773+0000 7f546f400640 1 -- 172.21.15.5:0/400359183 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546800c8e0 con 0x7f5478062fb0 2024-08-17T02:50:28.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.773+0000 7f546f400640 1 -- 172.21.15.5:0/400359183 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546800ca40 con 0x7f5478062fb0 2024-08-17T02:50:28.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.773+0000 7f546f400640 1 -- 172.21.15.5:0/400359183 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546800cde0 con 0x7f5478062fb0 2024-08-17T02:50:28.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.773+0000 7f547da00640 1 -- 172.21.15.5:0/400359183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54780ad850 con 0x7f5478062fb0 2024-08-17T02:50:28.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.773+0000 7f547da00640 1 -- 172.21.15.5:0/400359183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54780acf80 con 0x7f5478062fb0 2024-08-17T02:50:28.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.774+0000 7f547da00640 1 -- 172.21.15.5:0/400359183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5478168c20 con 0x7f5478062fb0 2024-08-17T02:50:28.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.775+0000 7f546f400640 1 -- 172.21.15.5:0/400359183 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5468013680 con 0x7f5478062fb0 2024-08-17T02:50:28.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.776+0000 7f546f400640 1 --2- 172.21.15.5:0/400359183 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5454065180 0x7f5454067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.776+0000 7f546f400640 1 -- 172.21.15.5:0/400359183 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5468082350 con 0x7f5478062fb0 2024-08-17T02:50:28.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.776+0000 7f546f400640 1 --2- 172.21.15.5:0/400359183 >> [v2:172.21.15.107:6800/37108,v1:172.21.15.107:6801/37108] conn(0x7f545406b070 0x7f545406d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.776+0000 7f546f400640 1 -- 172.21.15.5:0/400359183 --> [v2:172.21.15.107:6800/37108,v1:172.21.15.107:6801/37108] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f545406db30 con 0x7f545406b070 2024-08-17T02:50:28.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.776+0000 7f546f400640 1 -- 172.21.15.5:0/400359183 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54680848b0 con 0x7f5478062fb0 2024-08-17T02:50:28.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.776+0000 7f546fe00640 1 --2- 172.21.15.5:0/400359183 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5454065180 0x7f5454067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.777+0000 7f547d000640 1 --2- 172.21.15.5:0/400359183 >> [v2:172.21.15.107:6800/37108,v1:172.21.15.107:6801/37108] conn(0x7f545406b070 0x7f545406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.777+0000 7f546fe00640 1 --2- 172.21.15.5:0/400359183 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5454065180 0x7f5454067630 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f547816c160 tx=0x7f5460009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:28.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.777+0000 7f547d000640 1 --2- 172.21.15.5:0/400359183 >> [v2:172.21.15.107:6800/37108,v1:172.21.15.107:6801/37108] conn(0x7f545406b070 0x7f545406d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:28.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.778+0000 7f546f400640 1 -- 172.21.15.5:0/400359183 <== osd.4 v2:172.21.15.107:6800/37108 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f545406db30 con 0x7f545406b070 2024-08-17T02:50:28.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.791+0000 7f547da00640 1 -- 172.21.15.5:0/400359183 --> [v2:172.21.15.107:6800/37108,v1:172.21.15.107:6801/37108] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5478063f10 con 0x7f545406b070 2024-08-17T02:50:28.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.792+0000 7f546f400640 1 -- 172.21.15.5:0/400359183 <== osd.4 v2:172.21.15.107:6800/37108 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5478063f10 con 0x7f545406b070 2024-08-17T02:50:28.792 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:50:28.792 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:50:28.793 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:50:28.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.792+0000 7f547da00640 1 -- 172.21.15.5:0/400359183 >> [v2:172.21.15.107:6800/37108,v1:172.21.15.107:6801/37108] conn(0x7f545406b070 msgr2=0x7f545406d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.792+0000 7f547da00640 1 --2- 172.21.15.5:0/400359183 >> [v2:172.21.15.107:6800/37108,v1:172.21.15.107:6801/37108] conn(0x7f545406b070 0x7f545406d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.793+0000 7f547da00640 1 -- 172.21.15.5:0/400359183 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5454065180 msgr2=0x7f5454067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.793+0000 7f547da00640 1 --2- 172.21.15.5:0/400359183 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f5454065180 0x7f5454067630 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f547816c160 tx=0x7f5460009040 comp rx=0 tx=0).stop 2024-08-17T02:50:28.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.793+0000 7f547da00640 1 -- 172.21.15.5:0/400359183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5478062fb0 msgr2=0x7f54780aca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.793+0000 7f547da00640 1 --2- 172.21.15.5:0/400359183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5478062fb0 0x7f54780aca40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f546800e900 tx=0x7f54680090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.793+0000 7f547d000640 1 -- 172.21.15.5:0/400359183 reap_dead start 2024-08-17T02:50:28.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.793+0000 7f547da00640 1 -- 172.21.15.5:0/400359183 shutdown_connections 2024-08-17T02:50:28.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.793+0000 7f547da00640 1 -- 172.21.15.5:0/400359183 >> 172.21.15.5:0/400359183 conn(0x7f54780cc040 msgr2=0x7f5478155b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:28.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.793+0000 7f547da00640 1 -- 172.21.15.5:0/400359183 shutdown_connections 2024-08-17T02:50:28.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.793+0000 7f547da00640 1 -- 172.21.15.5:0/400359183 wait complete. 2024-08-17T02:50:28.807 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:50:28.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.959+0000 7f0a3ee00640 1 Processor -- start 2024-08-17T02:50:28.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.959+0000 7f0a3ee00640 1 -- start start 2024-08-17T02:50:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.961+0000 7f0a3ee00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a38158a20 0x7f0a380a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.961+0000 7f0a3ee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a3806dee0 0x7f0a380afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.961+0000 7f0a3ee00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a380aed90 con 0x7f0a380ae860 2024-08-17T02:50:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.961+0000 7f0a3ee00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a380af070 con 0x7f0a38158a20 2024-08-17T02:50:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.961+0000 7f0a3ee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a380af350 con 0x7f0a3806dee0 2024-08-17T02:50:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.961+0000 7f0a2f400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0a380ae860 0x7f0a3806d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34314/0 (socket says 172.21.15.5:34314) 2024-08-17T02:50:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.961+0000 7f0a2f400640 1 -- 172.21.15.5:0/1308347754 learned_addr learned my addr 172.21.15.5:0/1308347754 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.961+0000 7f0a37e00640 1 --2- 172.21.15.5:0/1308347754 >> v2:172.21.15.107:3300/0 conn(0x7f0a38158a20 0x7f0a380a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.961+0000 7f0a3ce00640 1 --2- 172.21.15.5:0/1308347754 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a3806dee0 0x7f0a380afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.961+0000 7f0a37400640 1 -- 172.21.15.5:0/1308347754 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 78331499 0 0) 0x7f0a380aed90 con 0x7f0a380ae860 2024-08-17T02:50:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.961+0000 7f0a37400640 1 -- 172.21.15.5:0/1308347754 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a1c0034e0 con 0x7f0a380ae860 2024-08-17T02:50:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.962+0000 7f0a3ce00640 1 -- 172.21.15.5:0/1308347754 >> v2:172.21.15.107:3300/0 conn(0x7f0a38158a20 msgr2=0x7f0a380a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.962+0000 7f0a3ce00640 1 --2- 172.21.15.5:0/1308347754 >> v2:172.21.15.107:3300/0 conn(0x7f0a38158a20 0x7f0a380a89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.962+0000 7f0a3ce00640 1 -- 172.21.15.5:0/1308347754 >> v1:172.21.15.5:6789/0 conn(0x7f0a380ae860 legacy=0x7f0a3806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.962+0000 7f0a37400640 1 -- 172.21.15.5:0/1308347754 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3684992103 0 0) 0x7f0a1c0034e0 con 0x7f0a380ae860 2024-08-17T02:50:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.962+0000 7f0a3ce00640 1 -- 172.21.15.5:0/1308347754 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a380af630 con 0x7f0a3806dee0 2024-08-17T02:50:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.962+0000 7f0a37e00640 1 --2- 172.21.15.5:0/1308347754 >> v2:172.21.15.107:3300/0 conn(0x7f0a38158a20 0x7f0a380a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.963+0000 7f0a3ce00640 1 --2- 172.21.15.5:0/1308347754 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a3806dee0 0x7f0a380afe30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009e60 tx=0x7f0a30009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a620dc12d620917 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.963+0000 7f0a37400640 1 -- 172.21.15.5:0/1308347754 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20001470 con 0x7f0a3806dee0 2024-08-17T02:50:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.963+0000 7f0a37400640 1 -- 172.21.15.5:0/1308347754 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3002d050 con 0x7f0a3806dee0 2024-08-17T02:50:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.963+0000 7f0a37400640 1 -- 172.21.15.5:0/1308347754 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a30031610 con 0x7f0a3806dee0 2024-08-17T02:50:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.964+0000 7f0a3ee00640 1 -- 172.21.15.5:0/1308347754 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a3806dee0 msgr2=0x7f0a380afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.964+0000 7f0a3ee00640 1 --2- 172.21.15.5:0/1308347754 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a3806dee0 0x7f0a380afe30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009e60 tx=0x7f0a30009780 comp rx=0 tx=0).stop 2024-08-17T02:50:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.964+0000 7f0a3ee00640 1 -- 172.21.15.5:0/1308347754 shutdown_connections 2024-08-17T02:50:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.964+0000 7f0a3ee00640 1 --2- 172.21.15.5:0/1308347754 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a3806dee0 0x7f0a380afe30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.964+0000 7f0a3ee00640 1 --2- 172.21.15.5:0/1308347754 >> v2:172.21.15.107:3300/0 conn(0x7f0a38158a20 0x7f0a380a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.964+0000 7f0a3ee00640 1 -- 172.21.15.5:0/1308347754 >> 172.21.15.5:0/1308347754 conn(0x7f0a38066e60 msgr2=0x7f0a38067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.964+0000 7f0a3ee00640 1 -- 172.21.15.5:0/1308347754 shutdown_connections 2024-08-17T02:50:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.964+0000 7f0a3ee00640 1 -- 172.21.15.5:0/1308347754 wait complete. 2024-08-17T02:50:28.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.965+0000 7f0a3ee00640 1 Processor -- start 2024-08-17T02:50:28.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.965+0000 7f0a3ee00640 1 -- start start 2024-08-17T02:50:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.966+0000 7f0a3ee00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3806dee0 0x7f0a38168500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.966+0000 7f0a3ee00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a380ae860 0x7f0a38156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.966+0000 7f0a3ee00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a38158a20 0x7f0a381571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.966+0000 7f0a3ee00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a38151bf0 con 0x7f0a38158a20 2024-08-17T02:50:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.966+0000 7f0a3ee00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a38151ed0 con 0x7f0a3806dee0 2024-08-17T02:50:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.966+0000 7f0a3ee00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a381521b0 con 0x7f0a380ae860 2024-08-17T02:50:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.966+0000 7f0a3ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a38158a20 0x7f0a381571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.966+0000 7f0a37e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3806dee0 0x7f0a38168500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.966+0000 7f0a2f400640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a380ae860 0x7f0a38156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.966+0000 7f0a37e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3806dee0 0x7f0a38168500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:40056/0 (socket says 172.21.15.5:40056) 2024-08-17T02:50:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.966+0000 7f0a37e00640 1 -- 172.21.15.5:0/4112604753 learned_addr learned my addr 172.21.15.5:0/4112604753 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.967+0000 7f0a2f400640 1 -- 172.21.15.5:0/4112604753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3806dee0 msgr2=0x7f0a38168500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.967+0000 7f0a2f400640 1 --2- 172.21.15.5:0/4112604753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3806dee0 0x7f0a38168500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.967+0000 7f0a2f400640 1 -- 172.21.15.5:0/4112604753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a38158a20 msgr2=0x7f0a381571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.967+0000 7f0a2f400640 1 --2- 172.21.15.5:0/4112604753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a38158a20 0x7f0a381571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:28.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.967+0000 7f0a2f400640 1 -- 172.21.15.5:0/4112604753 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a28009390 con 0x7f0a380ae860 2024-08-17T02:50:28.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.967+0000 7f0a37e00640 1 --2- 172.21.15.5:0/4112604753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3806dee0 0x7f0a38168500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:28.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.967+0000 7f0a2f400640 1 --2- 172.21.15.5:0/4112604753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a380ae860 0x7f0a38156c60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0a200011e0 tx=0x7f0a20001aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:28.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.967+0000 7f0a2fe00640 1 -- 172.21.15.5:0/4112604753 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20005aa0 con 0x7f0a380ae860 2024-08-17T02:50:28.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.968+0000 7f0a2fe00640 1 -- 172.21.15.5:0/4112604753 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a20005c00 con 0x7f0a380ae860 2024-08-17T02:50:28.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.968+0000 7f0a3ee00640 1 -- 172.21.15.5:0/4112604753 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a30009a20 con 0x7f0a380ae860 2024-08-17T02:50:28.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.968+0000 7f0a2fe00640 1 -- 172.21.15.5:0/4112604753 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a200070f0 con 0x7f0a380ae860 2024-08-17T02:50:28.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.968+0000 7f0a3ee00640 1 -- 172.21.15.5:0/4112604753 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a38168a40 con 0x7f0a380ae860 2024-08-17T02:50:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.969+0000 7f0a3ee00640 1 -- 172.21.15.5:0/4112604753 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a38063fb0 con 0x7f0a380ae860 2024-08-17T02:50:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.970+0000 7f0a2fe00640 1 -- 172.21.15.5:0/4112604753 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0a200074e0 con 0x7f0a380ae860 2024-08-17T02:50:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.970+0000 7f0a2fe00640 1 --2- 172.21.15.5:0/4112604753 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0a14065180 0x7f0a14067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.970+0000 7f0a2fe00640 1 -- 172.21.15.5:0/4112604753 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0a20081e60 con 0x7f0a380ae860 2024-08-17T02:50:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.971+0000 7f0a37e00640 1 --2- 172.21.15.5:0/4112604753 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0a14065180 0x7f0a14067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.971+0000 7f0a37e00640 1 --2- 172.21.15.5:0/4112604753 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0a14065180 0x7f0a14067630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009fd0 tx=0x7f0a280090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:28.975+0000 7f0a2fe00640 1 -- 172.21.15.5:0/4112604753 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0a20050250 con 0x7f0a380ae860 2024-08-17T02:50:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.157+0000 7f0a3ee00640 1 -- 172.21.15.5:0/4112604753 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a38152040 con 0x7f0a14065180 2024-08-17T02:50:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.158+0000 7f0a2fe00640 1 -- 172.21.15.5:0/4112604753 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0a38152040 con 0x7f0a14065180 2024-08-17T02:50:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:50:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.160+0000 7f0a3ee00640 1 -- 172.21.15.5:0/4112604753 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0a14065180 msgr2=0x7f0a14067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.160+0000 7f0a3ee00640 1 --2- 172.21.15.5:0/4112604753 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0a14065180 0x7f0a14067630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009fd0 tx=0x7f0a280090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.160+0000 7f0a3ee00640 1 -- 172.21.15.5:0/4112604753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a380ae860 msgr2=0x7f0a38156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.160+0000 7f0a3ee00640 1 --2- 172.21.15.5:0/4112604753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a380ae860 0x7f0a38156c60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0a200011e0 tx=0x7f0a20001aa0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.160+0000 7f0a3ee00640 1 -- 172.21.15.5:0/4112604753 shutdown_connections 2024-08-17T02:50:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.160+0000 7f0a3ee00640 1 --2- 172.21.15.5:0/4112604753 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f0a14065180 0x7f0a14067630 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.160+0000 7f0a3ee00640 1 --2- 172.21.15.5:0/4112604753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a38158a20 0x7f0a381571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.160+0000 7f0a3ee00640 1 --2- 172.21.15.5:0/4112604753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0a380ae860 0x7f0a38156c60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.160+0000 7f0a3ee00640 1 --2- 172.21.15.5:0/4112604753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a3806dee0 0x7f0a38168500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.160+0000 7f0a3ee00640 1 -- 172.21.15.5:0/4112604753 >> 172.21.15.5:0/4112604753 conn(0x7f0a38066e60 msgr2=0x7f0a380caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:29.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.160+0000 7f0a3ee00640 1 -- 172.21.15.5:0/4112604753 shutdown_connections 2024-08-17T02:50:29.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.160+0000 7f0a3ee00640 1 -- 172.21.15.5:0/4112604753 wait complete. 2024-08-17T02:50:29.176 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:50:29.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:50:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.330+0000 7f4efe800640 1 Processor -- start 2024-08-17T02:50:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.330+0000 7f4efe800640 1 -- start start 2024-08-17T02:50:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.332+0000 7f4efe800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ef8158c70 0x7f4ef80a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.332+0000 7f4efe800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef80a9e90 con 0x7f4ef80af120 2024-08-17T02:50:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.332+0000 7f4efe800640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef80aec90 con 0x7f4ef8159040 2024-08-17T02:50:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.332+0000 7f4efe800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80a98d0 con 0x7f4ef8158c70 2024-08-17T02:50:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.332+0000 7f4ef7e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4ef80af120 0x7f4ef806d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34330/0 (socket says 172.21.15.5:34330) 2024-08-17T02:50:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.332+0000 7f4ef7e00640 1 -- 172.21.15.5:0/2921925333 learned_addr learned my addr 172.21.15.5:0/2921925333 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.332+0000 7f4ef7400640 1 --2- 172.21.15.5:0/2921925333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ef8158c70 0x7f4ef80a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.332+0000 7f4ef6000640 1 -- 172.21.15.5:0/2921925333 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469879725 0 0) 0x7f4ef80a9e90 con 0x7f4ef80af120 2024-08-17T02:50:29.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.332+0000 7f4ef6000640 1 -- 172.21.15.5:0/2921925333 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4edc0034e0 con 0x7f4ef80af120 2024-08-17T02:50:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.332+0000 7f4ef6000640 1 -- 172.21.15.5:0/2921925333 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678208487 0 0) 0x7f4ef80aec90 con 0x7f4ef8159040 2024-08-17T02:50:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.332+0000 7f4ef6000640 1 -- 172.21.15.5:0/2921925333 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ef80a9e90 con 0x7f4ef8159040 2024-08-17T02:50:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.333+0000 7f4ef7400640 1 -- 172.21.15.5:0/2921925333 >> v1:172.21.15.107:6789/0 conn(0x7f4ef8159040 legacy=0x7f4ef815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.333+0000 7f4ef7400640 1 -- 172.21.15.5:0/2921925333 >> v1:172.21.15.5:6789/0 conn(0x7f4ef80af120 legacy=0x7f4ef806d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.333+0000 7f4ef6000640 1 -- 172.21.15.5:0/2921925333 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 243264142 0 0) 0x7f4edc0034e0 con 0x7f4ef80af120 2024-08-17T02:50:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.333+0000 7f4ef7400640 1 -- 172.21.15.5:0/2921925333 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef80a9bb0 con 0x7f4ef8158c70 2024-08-17T02:50:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.334+0000 7f4ef7400640 1 --2- 172.21.15.5:0/2921925333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ef8158c70 0x7f4ef80a92f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009880 tx=0x7f4ee80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40ad1beac7545a39 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.334+0000 7f4ef6000640 1 -- 172.21.15.5:0/2921925333 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef00017f0 con 0x7f4ef8158c70 2024-08-17T02:50:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.334+0000 7f4ef6000640 1 -- 172.21.15.5:0/2921925333 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee802aa30 con 0x7f4ef8158c70 2024-08-17T02:50:29.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.334+0000 7f4ef6000640 1 -- 172.21.15.5:0/2921925333 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee802adb0 con 0x7f4ef8158c70 2024-08-17T02:50:29.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.334+0000 7f4efe800640 1 -- 172.21.15.5:0/2921925333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ef8158c70 msgr2=0x7f4ef80a92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.334+0000 7f4efe800640 1 --2- 172.21.15.5:0/2921925333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ef8158c70 0x7f4ef80a92f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009880 tx=0x7f4ee80090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.335+0000 7f4efe800640 1 -- 172.21.15.5:0/2921925333 shutdown_connections 2024-08-17T02:50:29.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.335+0000 7f4efe800640 1 --2- 172.21.15.5:0/2921925333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ef8158c70 0x7f4ef80a92f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.335+0000 7f4efe800640 1 -- 172.21.15.5:0/2921925333 >> 172.21.15.5:0/2921925333 conn(0x7f4ef8066e60 msgr2=0x7f4ef8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:29.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.335+0000 7f4efe800640 1 -- 172.21.15.5:0/2921925333 shutdown_connections 2024-08-17T02:50:29.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.335+0000 7f4efe800640 1 -- 172.21.15.5:0/2921925333 wait complete. 2024-08-17T02:50:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.336+0000 7f4efe800640 1 Processor -- start 2024-08-17T02:50:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.336+0000 7f4efe800640 1 -- start start 2024-08-17T02:50:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.337+0000 7f4efe800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ef80af120 0x7f4ef8148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.337+0000 7f4efe800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ef8158c70 0x7f4ef8149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.337+0000 7f4efe800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8159040 0x7f4ef80acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.337+0000 7f4efe800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef814b5a0 con 0x7f4ef8159040 2024-08-17T02:50:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.337+0000 7f4efe800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef814a990 con 0x7f4ef80af120 2024-08-17T02:50:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.337+0000 7f4efe800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef814ac70 con 0x7f4ef8158c70 2024-08-17T02:50:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.337+0000 7f4ef7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8159040 0x7f4ef80acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.337+0000 7f4ef7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8159040 0x7f4ef80acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43564/0 (socket says 172.21.15.5:43564) 2024-08-17T02:50:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.337+0000 7f4ef7e00640 1 -- 172.21.15.5:0/3016095230 learned_addr learned my addr 172.21.15.5:0/3016095230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.337+0000 7f4ef7400640 1 --2- 172.21.15.5:0/3016095230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ef80af120 0x7f4ef8148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.337+0000 7f4ef6a00640 1 --2- 172.21.15.5:0/3016095230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ef8158c70 0x7f4ef8149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.338+0000 7f4ef7e00640 1 -- 172.21.15.5:0/3016095230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ef8158c70 msgr2=0x7f4ef8149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.338+0000 7f4ef7e00640 1 --2- 172.21.15.5:0/3016095230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4ef8158c70 0x7f4ef8149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.338+0000 7f4ef7e00640 1 -- 172.21.15.5:0/3016095230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ef80af120 msgr2=0x7f4ef8148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.338+0000 7f4ef7e00640 1 --2- 172.21.15.5:0/3016095230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ef80af120 0x7f4ef8148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.338+0000 7f4ef7e00640 1 -- 172.21.15.5:0/3016095230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee8009390 con 0x7f4ef8159040 2024-08-17T02:50:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.338+0000 7f4ef7e00640 1 --2- 172.21.15.5:0/3016095230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8159040 0x7f4ef80acd30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0007fd0 tx=0x7f4ef0007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.338+0000 7f4eeea00640 1 -- 172.21.15.5:0/3016095230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0004d30 con 0x7f4ef8159040 2024-08-17T02:50:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.338+0000 7f4eeea00640 1 -- 172.21.15.5:0/3016095230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef0004e90 con 0x7f4ef8159040 2024-08-17T02:50:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.338+0000 7f4eeea00640 1 -- 172.21.15.5:0/3016095230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef000aa80 con 0x7f4ef8159040 2024-08-17T02:50:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.338+0000 7f4efe800640 1 -- 172.21.15.5:0/3016095230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef814af50 con 0x7f4ef8159040 2024-08-17T02:50:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.338+0000 7f4efe800640 1 -- 172.21.15.5:0/3016095230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef8148c60 con 0x7f4ef8159040 2024-08-17T02:50:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.339+0000 7f4efe800640 1 -- 172.21.15.5:0/3016095230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ef815a860 con 0x7f4ef8159040 2024-08-17T02:50:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.340+0000 7f4eeea00640 1 -- 172.21.15.5:0/3016095230 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4ef0007150 con 0x7f4ef8159040 2024-08-17T02:50:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.341+0000 7f4eeea00640 1 --2- 172.21.15.5:0/3016095230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4ed8065150 0x7f4ed8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.341+0000 7f4eeea00640 1 -- 172.21.15.5:0/3016095230 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f4ef0081ae0 con 0x7f4ef8159040 2024-08-17T02:50:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.341+0000 7f4eeea00640 1 --2- 172.21.15.5:0/3016095230 >> [v2:172.21.15.107:6808/37109,v1:172.21.15.107:6809/37109] conn(0x7f4ed806b040 0x7f4ed806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.341+0000 7f4eeea00640 1 -- 172.21.15.5:0/3016095230 --> [v2:172.21.15.107:6808/37109,v1:172.21.15.107:6809/37109] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ed806db00 con 0x7f4ed806b040 2024-08-17T02:50:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.341+0000 7f4eeea00640 1 -- 172.21.15.5:0/3016095230 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ef0086220 con 0x7f4ef8159040 2024-08-17T02:50:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.341+0000 7f4ef7400640 1 --2- 172.21.15.5:0/3016095230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4ed8065150 0x7f4ed8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.342+0000 7f4ef6a00640 1 --2- 172.21.15.5:0/3016095230 >> [v2:172.21.15.107:6808/37109,v1:172.21.15.107:6809/37109] conn(0x7f4ed806b040 0x7f4ed806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.342+0000 7f4ef7400640 1 --2- 172.21.15.5:0/3016095230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4ed8065150 0x7f4ed8067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8034000 tx=0x7f4ee8032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.342+0000 7f4ef6a00640 1 --2- 172.21.15.5:0/3016095230 >> [v2:172.21.15.107:6808/37109,v1:172.21.15.107:6809/37109] conn(0x7f4ed806b040 0x7f4ed806d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.343+0000 7f4eeea00640 1 -- 172.21.15.5:0/3016095230 <== osd.5 v2:172.21.15.107:6808/37109 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f4ed806db00 con 0x7f4ed806b040 2024-08-17T02:50:29.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.356+0000 7f4efe800640 1 -- 172.21.15.5:0/3016095230 --> [v2:172.21.15.107:6808/37109,v1:172.21.15.107:6809/37109] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4ef8063fb0 con 0x7f4ed806b040 2024-08-17T02:50:29.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.357+0000 7f4eeea00640 1 -- 172.21.15.5:0/3016095230 <== osd.5 v2:172.21.15.107:6808/37109 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4ef8063fb0 con 0x7f4ed806b040 2024-08-17T02:50:29.357 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:50:29.357 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:50:29.358 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:50:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.357+0000 7f4efe800640 1 -- 172.21.15.5:0/3016095230 >> [v2:172.21.15.107:6808/37109,v1:172.21.15.107:6809/37109] conn(0x7f4ed806b040 msgr2=0x7f4ed806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.357+0000 7f4efe800640 1 --2- 172.21.15.5:0/3016095230 >> [v2:172.21.15.107:6808/37109,v1:172.21.15.107:6809/37109] conn(0x7f4ed806b040 0x7f4ed806d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.357+0000 7f4efe800640 1 -- 172.21.15.5:0/3016095230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4ed8065150 msgr2=0x7f4ed8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.357+0000 7f4efe800640 1 --2- 172.21.15.5:0/3016095230 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f4ed8065150 0x7f4ed8067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8034000 tx=0x7f4ee8032000 comp rx=0 tx=0).stop 2024-08-17T02:50:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.357+0000 7f4efe800640 1 -- 172.21.15.5:0/3016095230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8159040 msgr2=0x7f4ef80acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.357+0000 7f4efe800640 1 --2- 172.21.15.5:0/3016095230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8159040 0x7f4ef80acd30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0007fd0 tx=0x7f4ef0007d10 comp rx=0 tx=0).stop 2024-08-17T02:50:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.357+0000 7f4ef7e00640 1 -- 172.21.15.5:0/3016095230 reap_dead start 2024-08-17T02:50:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.357+0000 7f4efe800640 1 -- 172.21.15.5:0/3016095230 shutdown_connections 2024-08-17T02:50:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.357+0000 7f4efe800640 1 -- 172.21.15.5:0/3016095230 >> 172.21.15.5:0/3016095230 conn(0x7f4ef8066e60 msgr2=0x7f4ef806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:29.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.358+0000 7f4efe800640 1 -- 172.21.15.5:0/3016095230 shutdown_connections 2024-08-17T02:50:29.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.358+0000 7f4efe800640 1 -- 172.21.15.5:0/3016095230 wait complete. 2024-08-17T02:50:29.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:50:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.523+0000 7f3f24800640 1 Processor -- start 2024-08-17T02:50:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.523+0000 7f3f24800640 1 -- start start 2024-08-17T02:50:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.524+0000 7f3f24800640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3f1c158b90 0x7f3f1c0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.524+0000 7f3f24800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f1c0af130 0x7f3f1c0ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.524+0000 7f3f24800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f1c0afd20 con 0x7f3f1c0b2370 2024-08-17T02:50:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.524+0000 7f3f24800640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1c0affe0 con 0x7f3f1c158b90 2024-08-17T02:50:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.524+0000 7f3f24800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c0b02c0 con 0x7f3f1c0af130 2024-08-17T02:50:29.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.524+0000 7f3f21400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3f1c0b2370 0x7f3f1c0aea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34344/0 (socket says 172.21.15.5:34344) 2024-08-17T02:50:29.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.524+0000 7f3f21400640 1 -- 172.21.15.5:0/3869931832 learned_addr learned my addr 172.21.15.5:0/3869931832 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:29.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.525+0000 7f3f21e00640 1 --2- 172.21.15.5:0/3869931832 >> v2:172.21.15.107:3300/0 conn(0x7f3f1c158b90 0x7f3f1c0b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.525+0000 7f3f22800640 1 --2- 172.21.15.5:0/3869931832 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f1c0af130 0x7f3f1c0ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.525+0000 7f3f20a00640 1 -- 172.21.15.5:0/3869931832 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962721550 0 0) 0x7f3f1c0afd20 con 0x7f3f1c0b2370 2024-08-17T02:50:29.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.525+0000 7f3f20a00640 1 -- 172.21.15.5:0/3869931832 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f040034e0 con 0x7f3f1c0b2370 2024-08-17T02:50:29.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.525+0000 7f3f21e00640 1 -- 172.21.15.5:0/3869931832 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f1c0af130 msgr2=0x7f3f1c0ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.525+0000 7f3f21e00640 1 --2- 172.21.15.5:0/3869931832 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f1c0af130 0x7f3f1c0ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.525+0000 7f3f21e00640 1 -- 172.21.15.5:0/3869931832 >> v1:172.21.15.5:6789/0 conn(0x7f3f1c0b2370 legacy=0x7f3f1c0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.525+0000 7f3f21e00640 1 -- 172.21.15.5:0/3869931832 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c0ca3c0 con 0x7f3f1c158b90 2024-08-17T02:50:29.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.525+0000 7f3f22800640 1 --2- 172.21.15.5:0/3869931832 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f1c0af130 0x7f3f1c0ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.526+0000 7f3f21e00640 1 --2- 172.21.15.5:0/3869931832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f1c158b90 0x7f3f1c0b1e30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3f10009850 tx=0x7f3f100090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41d8a053e2aa5cc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:29.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.526+0000 7f3f20a00640 1 -- 172.21.15.5:0/3869931832 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1002ad80 con 0x7f3f1c158b90 2024-08-17T02:50:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.526+0000 7f3f20a00640 1 -- 172.21.15.5:0/3869931832 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f10032440 con 0x7f3f1c158b90 2024-08-17T02:50:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.526+0000 7f3f20a00640 1 -- 172.21.15.5:0/3869931832 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f10032800 con 0x7f3f1c158b90 2024-08-17T02:50:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.527+0000 7f3f24800640 1 -- 172.21.15.5:0/3869931832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f1c158b90 msgr2=0x7f3f1c0b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.527+0000 7f3f24800640 1 --2- 172.21.15.5:0/3869931832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f1c158b90 0x7f3f1c0b1e30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3f10009850 tx=0x7f3f100090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.527+0000 7f3f24800640 1 -- 172.21.15.5:0/3869931832 shutdown_connections 2024-08-17T02:50:29.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.527+0000 7f3f24800640 1 --2- 172.21.15.5:0/3869931832 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f1c0af130 0x7f3f1c0ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.527+0000 7f3f24800640 1 --2- 172.21.15.5:0/3869931832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f1c158b90 0x7f3f1c0b1e30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.527+0000 7f3f24800640 1 -- 172.21.15.5:0/3869931832 >> 172.21.15.5:0/3869931832 conn(0x7f3f1c06e590 msgr2=0x7f3f1c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:29.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.527+0000 7f3f24800640 1 -- 172.21.15.5:0/3869931832 shutdown_connections 2024-08-17T02:50:29.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.527+0000 7f3f24800640 1 -- 172.21.15.5:0/3869931832 wait complete. 2024-08-17T02:50:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.529+0000 7f3f24800640 1 Processor -- start 2024-08-17T02:50:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.529+0000 7f3f24800640 1 -- start start 2024-08-17T02:50:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f24800640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f1c0af130 0x7f3f1c0c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f24800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f1c0b2370 0x7f3f1c0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f24800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c158b90 0x7f3f1c0b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f24800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c152b30 con 0x7f3f1c158b90 2024-08-17T02:50:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f24800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c153a10 con 0x7f3f1c0b2370 2024-08-17T02:50:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f24800640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c15cb30 con 0x7f3f1c0af130 2024-08-17T02:50:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f22800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c158b90 0x7f3f1c0b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f21400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f1c0b2370 0x7f3f1c0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f21e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f1c0af130 0x7f3f1c0c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f22800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c158b90 0x7f3f1c0b4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43572/0 (socket says 172.21.15.5:43572) 2024-08-17T02:50:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f21400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f1c0b2370 0x7f3f1c0b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:40068/0 (socket says 172.21.15.5:40068) 2024-08-17T02:50:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f21e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f1c0af130 0x7f3f1c0c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:47562/0 (socket says 172.21.15.5:47562) 2024-08-17T02:50:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f22800640 1 -- 172.21.15.5:0/1506438410 learned_addr learned my addr 172.21.15.5:0/1506438410 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f22800640 1 -- 172.21.15.5:0/1506438410 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f1c0af130 msgr2=0x7f3f1c0c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f22800640 1 --2- 172.21.15.5:0/1506438410 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f1c0af130 0x7f3f1c0c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f22800640 1 -- 172.21.15.5:0/1506438410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f1c0b2370 msgr2=0x7f3f1c0b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f22800640 1 --2- 172.21.15.5:0/1506438410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f1c0b2370 0x7f3f1c0b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.530+0000 7f3f22800640 1 -- 172.21.15.5:0/1506438410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f18009a20 con 0x7f3f1c158b90 2024-08-17T02:50:29.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.531+0000 7f3f22800640 1 --2- 172.21.15.5:0/1506438410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c158b90 0x7f3f1c0b4be0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009ef0 tx=0x7f3f1800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:29.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.531+0000 7f3f15600640 1 -- 172.21.15.5:0/1506438410 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1800ce10 con 0x7f3f1c158b90 2024-08-17T02:50:29.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.531+0000 7f3f15600640 1 -- 172.21.15.5:0/1506438410 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1800f040 con 0x7f3f1c158b90 2024-08-17T02:50:29.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.531+0000 7f3f15600640 1 -- 172.21.15.5:0/1506438410 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f180146d0 con 0x7f3f1c158b90 2024-08-17T02:50:29.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.531+0000 7f3f24800640 1 -- 172.21.15.5:0/1506438410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f10009390 con 0x7f3f1c158b90 2024-08-17T02:50:29.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.531+0000 7f3f24800640 1 -- 172.21.15.5:0/1506438410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1c1530e0 con 0x7f3f1c158b90 2024-08-17T02:50:29.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.532+0000 7f3f24800640 1 -- 172.21.15.5:0/1506438410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1c153ba0 con 0x7f3f1c158b90 2024-08-17T02:50:29.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.533+0000 7f3f15600640 1 -- 172.21.15.5:0/1506438410 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3f18014a40 con 0x7f3f1c158b90 2024-08-17T02:50:29.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.534+0000 7f3f15600640 1 --2- 172.21.15.5:0/1506438410 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3f00065150 0x7f3f00067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.535+0000 7f3f15600640 1 -- 172.21.15.5:0/1506438410 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f3f18082f70 con 0x7f3f1c158b90 2024-08-17T02:50:29.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.535+0000 7f3f21e00640 1 --2- 172.21.15.5:0/1506438410 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3f00065150 0x7f3f00067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.535+0000 7f3f21e00640 1 --2- 172.21.15.5:0/1506438410 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3f00065150 0x7f3f00067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3f10034000 tx=0x7f3f10032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:29.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.539+0000 7f3f15600640 1 -- 172.21.15.5:0/1506438410 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3f180513a0 con 0x7f3f1c158b90 2024-08-17T02:50:29.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.723+0000 7f3f24800640 1 -- 172.21.15.5:0/1506438410 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f1c063fb0 con 0x7f3f00065150 2024-08-17T02:50:29.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.723+0000 7f3f15600640 1 -- 172.21.15.5:0/1506438410 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3f1c063fb0 con 0x7f3f00065150 2024-08-17T02:50:29.724 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:50:29.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.725+0000 7f3f24800640 1 -- 172.21.15.5:0/1506438410 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3f00065150 msgr2=0x7f3f00067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.725+0000 7f3f24800640 1 --2- 172.21.15.5:0/1506438410 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3f00065150 0x7f3f00067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3f10034000 tx=0x7f3f10032000 comp rx=0 tx=0).stop 2024-08-17T02:50:29.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.725+0000 7f3f24800640 1 -- 172.21.15.5:0/1506438410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c158b90 msgr2=0x7f3f1c0b4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.725+0000 7f3f24800640 1 --2- 172.21.15.5:0/1506438410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c158b90 0x7f3f1c0b4be0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009ef0 tx=0x7f3f1800b040 comp rx=0 tx=0).stop 2024-08-17T02:50:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.726+0000 7f3f24800640 1 -- 172.21.15.5:0/1506438410 shutdown_connections 2024-08-17T02:50:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.726+0000 7f3f24800640 1 --2- 172.21.15.5:0/1506438410 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3f00065150 0x7f3f00067600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.726+0000 7f3f24800640 1 --2- 172.21.15.5:0/1506438410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f1c158b90 0x7f3f1c0b4be0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.726+0000 7f3f24800640 1 --2- 172.21.15.5:0/1506438410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3f1c0b2370 0x7f3f1c0b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.726+0000 7f3f24800640 1 --2- 172.21.15.5:0/1506438410 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3f1c0af130 0x7f3f1c0c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.726+0000 7f3f24800640 1 -- 172.21.15.5:0/1506438410 >> 172.21.15.5:0/1506438410 conn(0x7f3f1c06e590 msgr2=0x7f3f1c0ca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.726+0000 7f3f24800640 1 -- 172.21.15.5:0/1506438410 shutdown_connections 2024-08-17T02:50:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.726+0000 7f3f24800640 1 -- 172.21.15.5:0/1506438410 wait complete. 2024-08-17T02:50:29.741 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:50:29.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:50:29.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.896+0000 7f202ca00640 1 Processor -- start 2024-08-17T02:50:29.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.896+0000 7f202ca00640 1 -- start start 2024-08-17T02:50:29.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.897+0000 7f202ca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20281568f0 0x7f20281571e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.898+0000 7f202ca00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2028156cc0 0x7f202806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.898+0000 7f202ca00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2028069d20 con 0x7f2028157720 2024-08-17T02:50:29.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.898+0000 7f202ca00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202815a0d0 con 0x7f2028156cc0 2024-08-17T02:50:29.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.898+0000 7f202ca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202815a3b0 con 0x7f20281568f0 2024-08-17T02:50:29.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.898+0000 7f201fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2028157720 0x7f2028159610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34354/0 (socket says 172.21.15.5:34354) 2024-08-17T02:50:29.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.898+0000 7f201fe00640 1 -- 172.21.15.5:0/1099805030 learned_addr learned my addr 172.21.15.5:0/1099805030 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:29.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.898+0000 7f2025e00640 1 --2- 172.21.15.5:0/1099805030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20281568f0 0x7f20281571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.898+0000 7f2026800640 1 --2- 172.21.15.5:0/1099805030 >> v2:172.21.15.107:3300/0 conn(0x7f2028156cc0 0x7f202806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.898+0000 7f2025400640 1 -- 172.21.15.5:0/1099805030 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184842458 0 0) 0x7f2028069d20 con 0x7f2028157720 2024-08-17T02:50:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.898+0000 7f2025400640 1 -- 172.21.15.5:0/1099805030 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f200c0034e0 con 0x7f2028157720 2024-08-17T02:50:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.899+0000 7f2026800640 1 -- 172.21.15.5:0/1099805030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20281568f0 msgr2=0x7f20281571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.899+0000 7f2026800640 1 --2- 172.21.15.5:0/1099805030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20281568f0 0x7f20281571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.899+0000 7f2026800640 1 -- 172.21.15.5:0/1099805030 >> v1:172.21.15.5:6789/0 conn(0x7f2028157720 legacy=0x7f2028159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.899+0000 7f2026800640 1 -- 172.21.15.5:0/1099805030 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2028069f70 con 0x7f2028156cc0 2024-08-17T02:50:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.899+0000 7f2025e00640 1 --2- 172.21.15.5:0/1099805030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20281568f0 0x7f20281571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.900+0000 7f2026800640 1 --2- 172.21.15.5:0/1099805030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2028156cc0 0x7f202806a770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2020009e60 tx=0x7f2020009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc500f6c270c6d57 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.900+0000 7f2025400640 1 -- 172.21.15.5:0/1099805030 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020007550 con 0x7f2028156cc0 2024-08-17T02:50:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.900+0000 7f2025400640 1 -- 172.21.15.5:0/1099805030 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202002d050 con 0x7f2028156cc0 2024-08-17T02:50:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.900+0000 7f2025400640 1 -- 172.21.15.5:0/1099805030 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020007900 con 0x7f2028156cc0 2024-08-17T02:50:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.900+0000 7f202ca00640 1 -- 172.21.15.5:0/1099805030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2028156cc0 msgr2=0x7f202806a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.900+0000 7f202ca00640 1 --2- 172.21.15.5:0/1099805030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2028156cc0 0x7f202806a770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2020009e60 tx=0x7f2020009780 comp rx=0 tx=0).stop 2024-08-17T02:50:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.901+0000 7f202ca00640 1 -- 172.21.15.5:0/1099805030 shutdown_connections 2024-08-17T02:50:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.901+0000 7f202ca00640 1 --2- 172.21.15.5:0/1099805030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2028156cc0 0x7f202806a770 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.901+0000 7f202ca00640 1 --2- 172.21.15.5:0/1099805030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f20281568f0 0x7f20281571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.901+0000 7f202ca00640 1 -- 172.21.15.5:0/1099805030 >> 172.21.15.5:0/1099805030 conn(0x7f2028066e60 msgr2=0x7f2028067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.901+0000 7f202ca00640 1 -- 172.21.15.5:0/1099805030 shutdown_connections 2024-08-17T02:50:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.901+0000 7f202ca00640 1 -- 172.21.15.5:0/1099805030 wait complete. 2024-08-17T02:50:29.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.902+0000 7f202ca00640 1 Processor -- start 2024-08-17T02:50:29.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.902+0000 7f202ca00640 1 -- start start 2024-08-17T02:50:29.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.903+0000 7f202ca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20281568f0 0x7f202814c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.903+0000 7f202ca00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2028156cc0 0x7f2028153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.903+0000 7f202ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2028157720 0x7f20280c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.903+0000 7f202ca00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20280aef50 con 0x7f2028157720 2024-08-17T02:50:29.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.903+0000 7f202ca00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20280af230 con 0x7f20281568f0 2024-08-17T02:50:29.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.903+0000 7f202ca00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20280af510 con 0x7f2028156cc0 2024-08-17T02:50:29.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.903+0000 7f2026800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2028157720 0x7f20280c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.903+0000 7f201fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2028156cc0 0x7f2028153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.903+0000 7f2025e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20281568f0 0x7f202814c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.903+0000 7f2025e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20281568f0 0x7f202814c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:40090/0 (socket says 172.21.15.5:40090) 2024-08-17T02:50:29.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.903+0000 7f2025e00640 1 -- 172.21.15.5:0/1146020841 learned_addr learned my addr 172.21.15.5:0/1146020841 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:29.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.903+0000 7f201fe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2028156cc0 0x7f2028153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.5:47590/0 (socket says 172.21.15.5:47590) 2024-08-17T02:50:29.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.904+0000 7f2025e00640 1 -- 172.21.15.5:0/1146020841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2028156cc0 msgr2=0x7f2028153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.904+0000 7f2025e00640 1 --2- 172.21.15.5:0/1146020841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2028156cc0 0x7f2028153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.904+0000 7f2025e00640 1 -- 172.21.15.5:0/1146020841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2028157720 msgr2=0x7f20280c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.904+0000 7f2025e00640 1 --2- 172.21.15.5:0/1146020841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2028157720 0x7f20280c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.904+0000 7f2025e00640 1 -- 172.21.15.5:0/1146020841 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2018009390 con 0x7f20281568f0 2024-08-17T02:50:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.904+0000 7f2026800640 1 --2- 172.21.15.5:0/1146020841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2028157720 0x7f20280c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.904+0000 7f201fe00640 1 --2- 172.21.15.5:0/1146020841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2028156cc0 0x7f2028153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.904+0000 7f2025e00640 1 --2- 172.21.15.5:0/1146020841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20281568f0 0x7f202814c1d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f201800ec80 tx=0x7f20180090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.904+0000 7f201d600640 1 -- 172.21.15.5:0/1146020841 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201800eec0 con 0x7f20281568f0 2024-08-17T02:50:29.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.904+0000 7f201d600640 1 -- 172.21.15.5:0/1146020841 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201800cbc0 con 0x7f20281568f0 2024-08-17T02:50:29.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.904+0000 7f202ca00640 1 -- 172.21.15.5:0/1146020841 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2020009a20 con 0x7f20281568f0 2024-08-17T02:50:29.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.904+0000 7f201d600640 1 -- 172.21.15.5:0/1146020841 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018013470 con 0x7f20281568f0 2024-08-17T02:50:29.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.905+0000 7f202ca00640 1 -- 172.21.15.5:0/1146020841 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202814c710 con 0x7f20281568f0 2024-08-17T02:50:29.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.905+0000 7f202ca00640 1 -- 172.21.15.5:0/1146020841 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2028063fb0 con 0x7f20281568f0 2024-08-17T02:50:29.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.906+0000 7f201d600640 1 -- 172.21.15.5:0/1146020841 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2018038970 con 0x7f20281568f0 2024-08-17T02:50:29.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.907+0000 7f201d600640 1 --2- 172.21.15.5:0/1146020841 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2004065150 0x7f2004067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.907+0000 7f201d600640 1 -- 172.21.15.5:0/1146020841 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f20180827a0 con 0x7f20281568f0 2024-08-17T02:50:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.907+0000 7f201fe00640 1 --2- 172.21.15.5:0/1146020841 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2004065150 0x7f2004067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.908+0000 7f201d600640 1 --2- 172.21.15.5:0/1146020841 >> [v2:172.21.15.107:6816/37110,v1:172.21.15.107:6817/37110] conn(0x7f200406b040 0x7f200406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.908+0000 7f201d600640 1 -- 172.21.15.5:0/1146020841 --> [v2:172.21.15.107:6816/37110,v1:172.21.15.107:6817/37110] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f200406db00 con 0x7f200406b040 2024-08-17T02:50:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.908+0000 7f201d600640 1 -- 172.21.15.5:0/1146020841 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2018082a90 con 0x7f20281568f0 2024-08-17T02:50:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.908+0000 7f2026800640 1 --2- 172.21.15.5:0/1146020841 >> [v2:172.21.15.107:6816/37110,v1:172.21.15.107:6817/37110] conn(0x7f200406b040 0x7f200406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.908+0000 7f201fe00640 1 --2- 172.21.15.5:0/1146020841 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2004065150 0x7f2004067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f20280cb080 tx=0x7f2010009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.908+0000 7f2026800640 1 --2- 172.21.15.5:0/1146020841 >> [v2:172.21.15.107:6816/37110,v1:172.21.15.107:6817/37110] conn(0x7f200406b040 0x7f200406d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.910+0000 7f201d600640 1 -- 172.21.15.5:0/1146020841 <== osd.6 v2:172.21.15.107:6816/37110 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f200406db00 con 0x7f200406b040 2024-08-17T02:50:29.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.922+0000 7f202ca00640 1 -- 172.21.15.5:0/1146020841 --> [v2:172.21.15.107:6816/37110,v1:172.21.15.107:6817/37110] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f20280af370 con 0x7f200406b040 2024-08-17T02:50:29.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.923+0000 7f201d600640 1 -- 172.21.15.5:0/1146020841 <== osd.6 v2:172.21.15.107:6816/37110 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f20280af370 con 0x7f200406b040 2024-08-17T02:50:29.924 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:50:29.924 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:50:29.924 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:50:29.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.923+0000 7f202ca00640 1 -- 172.21.15.5:0/1146020841 >> [v2:172.21.15.107:6816/37110,v1:172.21.15.107:6817/37110] conn(0x7f200406b040 msgr2=0x7f200406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.923+0000 7f202ca00640 1 --2- 172.21.15.5:0/1146020841 >> [v2:172.21.15.107:6816/37110,v1:172.21.15.107:6817/37110] conn(0x7f200406b040 0x7f200406d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.923+0000 7f202ca00640 1 -- 172.21.15.5:0/1146020841 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2004065150 msgr2=0x7f2004067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.923+0000 7f202ca00640 1 --2- 172.21.15.5:0/1146020841 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2004065150 0x7f2004067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f20280cb080 tx=0x7f2010009040 comp rx=0 tx=0).stop 2024-08-17T02:50:29.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.923+0000 7f202ca00640 1 -- 172.21.15.5:0/1146020841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20281568f0 msgr2=0x7f202814c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:29.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.923+0000 7f202ca00640 1 --2- 172.21.15.5:0/1146020841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20281568f0 0x7f202814c1d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f201800ec80 tx=0x7f20180090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.923+0000 7f2026800640 1 -- 172.21.15.5:0/1146020841 reap_dead start 2024-08-17T02:50:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.924+0000 7f202ca00640 1 -- 172.21.15.5:0/1146020841 shutdown_connections 2024-08-17T02:50:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.924+0000 7f202ca00640 1 -- 172.21.15.5:0/1146020841 >> 172.21.15.5:0/1146020841 conn(0x7f2028066e60 msgr2=0x7f202814e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.924+0000 7f202ca00640 1 -- 172.21.15.5:0/1146020841 shutdown_connections 2024-08-17T02:50:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:29.924+0000 7f202ca00640 1 -- 172.21.15.5:0/1146020841 wait complete. 2024-08-17T02:50:29.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:50:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.089+0000 7faebde00640 1 Processor -- start 2024-08-17T02:50:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.089+0000 7faebde00640 1 -- start start 2024-08-17T02:50:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.090+0000 7faebde00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faeb80afca0 0x7faeb80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.091+0000 7faebde00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faeb81590b0 0x7faeb8159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.091+0000 7faebde00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb815a4e0 con 0x7faeb80acf10 2024-08-17T02:50:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.091+0000 7faebde00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb80b0980 con 0x7faeb81590b0 2024-08-17T02:50:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.091+0000 7faebde00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb80c92b0 con 0x7faeb80afca0 2024-08-17T02:50:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.091+0000 7faeb7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faeb81590b0 0x7faeb8159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.091+0000 7faeb6a00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faeb80afca0 0x7faeb80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.091+0000 7faeafe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faeb80acf10 0x7faeb81589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34360/0 (socket says 172.21.15.5:34360) 2024-08-17T02:50:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.091+0000 7faeafe00640 1 -- 172.21.15.5:0/3897595565 learned_addr learned my addr 172.21.15.5:0/3897595565 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.091+0000 7faeb6a00640 1 -- 172.21.15.5:0/3897595565 >> v2:172.21.15.5:3300/0 conn(0x7faeb81590b0 msgr2=0x7faeb8159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.091+0000 7faeb6a00640 1 --2- 172.21.15.5:0/3897595565 >> v2:172.21.15.5:3300/0 conn(0x7faeb81590b0 0x7faeb8159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.091+0000 7faeb6a00640 1 -- 172.21.15.5:0/3897595565 >> v1:172.21.15.5:6789/0 conn(0x7faeb80acf10 legacy=0x7faeb81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.091+0000 7faeb6a00640 1 -- 172.21.15.5:0/3897595565 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80ad480 con 0x7faeb80afca0 2024-08-17T02:50:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.091+0000 7faeb6000640 1 -- 172.21.15.5:0/3897595565 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492427790 0 0) 0x7faea0001110 con 0x7faeb80acf10 2024-08-17T02:50:30.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.091+0000 7faeb7400640 1 --2- 172.21.15.5:0/3897595565 >> v2:172.21.15.5:3300/0 conn(0x7faeb81590b0 0x7faeb8159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:30.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.092+0000 7faeb6a00640 1 --2- 172.21.15.5:0/3897595565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faeb80afca0 0x7faeb80b0070 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faeb8067e40 tx=0x7faea80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f472d32e6b45a3d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:30.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.093+0000 7faeb6000640 1 -- 172.21.15.5:0/3897595565 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea802adb0 con 0x7faeb80afca0 2024-08-17T02:50:30.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.093+0000 7faeb6000640 1 -- 172.21.15.5:0/3897595565 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea8032440 con 0x7faeb80afca0 2024-08-17T02:50:30.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.093+0000 7faeb6000640 1 -- 172.21.15.5:0/3897595565 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea80327e0 con 0x7faeb80afca0 2024-08-17T02:50:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.093+0000 7faebde00640 1 -- 172.21.15.5:0/3897595565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faeb80afca0 msgr2=0x7faeb80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.093+0000 7faebde00640 1 --2- 172.21.15.5:0/3897595565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faeb80afca0 0x7faeb80b0070 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faeb8067e40 tx=0x7faea80090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.093+0000 7faebde00640 1 -- 172.21.15.5:0/3897595565 shutdown_connections 2024-08-17T02:50:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.093+0000 7faebde00640 1 --2- 172.21.15.5:0/3897595565 >> v2:172.21.15.5:3300/0 conn(0x7faeb81590b0 0x7faeb8159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.093+0000 7faebde00640 1 --2- 172.21.15.5:0/3897595565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faeb80afca0 0x7faeb80b0070 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.093+0000 7faebde00640 1 -- 172.21.15.5:0/3897595565 >> 172.21.15.5:0/3897595565 conn(0x7faeb8066e60 msgr2=0x7faeb8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.093+0000 7faebde00640 1 -- 172.21.15.5:0/3897595565 shutdown_connections 2024-08-17T02:50:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.093+0000 7faebde00640 1 -- 172.21.15.5:0/3897595565 wait complete. 2024-08-17T02:50:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.095+0000 7faebde00640 1 Processor -- start 2024-08-17T02:50:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.095+0000 7faebde00640 1 -- start start 2024-08-17T02:50:30.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.096+0000 7faebde00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faeb80acf10 0x7faeb813a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.096+0000 7faebde00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faeb80afca0 0x7faeb8148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.096+0000 7faebde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeb81590b0 0x7faeb81530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.096+0000 7faebde00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb81496d0 con 0x7faeb81590b0 2024-08-17T02:50:30.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.096+0000 7faebde00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb81499b0 con 0x7faeb80afca0 2024-08-17T02:50:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.096+0000 7faebde00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb8149c90 con 0x7faeb80acf10 2024-08-17T02:50:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.096+0000 7faeb7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeb81590b0 0x7faeb81530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.096+0000 7faeb7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeb81590b0 0x7faeb81530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43590/0 (socket says 172.21.15.5:43590) 2024-08-17T02:50:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.096+0000 7faeb7400640 1 -- 172.21.15.5:0/738042333 learned_addr learned my addr 172.21.15.5:0/738042333 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.096+0000 7faeafe00640 1 --2- 172.21.15.5:0/738042333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faeb80afca0 0x7faeb8148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.096+0000 7faeb6a00640 1 --2- 172.21.15.5:0/738042333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faeb80acf10 0x7faeb813a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.096+0000 7faeb7400640 1 -- 172.21.15.5:0/738042333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faeb80acf10 msgr2=0x7faeb813a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.096+0000 7faeb7400640 1 --2- 172.21.15.5:0/738042333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faeb80acf10 0x7faeb813a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.096+0000 7faeb7400640 1 -- 172.21.15.5:0/738042333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faeb80afca0 msgr2=0x7faeb8148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.096+0000 7faeb7400640 1 --2- 172.21.15.5:0/738042333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faeb80afca0 0x7faeb8148c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.097+0000 7faeb7400640 1 -- 172.21.15.5:0/738042333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb0009a20 con 0x7faeb81590b0 2024-08-17T02:50:30.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.097+0000 7faeb7400640 1 --2- 172.21.15.5:0/738042333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeb81590b0 0x7faeb81530c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009f90 tx=0x7faeb000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:30.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.097+0000 7faeae000640 1 -- 172.21.15.5:0/738042333 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb000ce70 con 0x7faeb81590b0 2024-08-17T02:50:30.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.097+0000 7faeae000640 1 -- 172.21.15.5:0/738042333 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb000f040 con 0x7faeb81590b0 2024-08-17T02:50:30.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.097+0000 7faeae000640 1 -- 172.21.15.5:0/738042333 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb00146d0 con 0x7faeb81590b0 2024-08-17T02:50:30.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.097+0000 7faebde00640 1 -- 172.21.15.5:0/738042333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea8009390 con 0x7faeb81590b0 2024-08-17T02:50:30.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.097+0000 7faebde00640 1 -- 172.21.15.5:0/738042333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb814a250 con 0x7faeb81590b0 2024-08-17T02:50:30.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.098+0000 7faebde00640 1 -- 172.21.15.5:0/738042333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb814a4a0 con 0x7faeb81590b0 2024-08-17T02:50:30.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.099+0000 7faeae000640 1 -- 172.21.15.5:0/738042333 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faeb0014a40 con 0x7faeb81590b0 2024-08-17T02:50:30.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.100+0000 7faeae000640 1 --2- 172.21.15.5:0/738042333 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fae94065150 0x7fae94067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.100+0000 7faeae000640 1 -- 172.21.15.5:0/738042333 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7faeb0082fe0 con 0x7faeb81590b0 2024-08-17T02:50:30.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.100+0000 7faeb6a00640 1 --2- 172.21.15.5:0/738042333 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fae94065150 0x7fae94067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.101+0000 7faeb6a00640 1 --2- 172.21.15.5:0/738042333 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fae94065150 0x7fae94067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faea8034000 tx=0x7faea8032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:30.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.104+0000 7faeae000640 1 -- 172.21.15.5:0/738042333 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faeb0051450 con 0x7faeb81590b0 2024-08-17T02:50:30.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.288+0000 7faebde00640 1 -- 172.21.15.5:0/738042333 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7faeb814cf40 con 0x7fae94065150 2024-08-17T02:50:30.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.288+0000 7faeae000640 1 -- 172.21.15.5:0/738042333 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faeb814cf40 con 0x7fae94065150 2024-08-17T02:50:30.289 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:50:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.291+0000 7faebde00640 1 -- 172.21.15.5:0/738042333 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fae94065150 msgr2=0x7fae94067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.291+0000 7faebde00640 1 --2- 172.21.15.5:0/738042333 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fae94065150 0x7fae94067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faea8034000 tx=0x7faea8032000 comp rx=0 tx=0).stop 2024-08-17T02:50:30.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.291+0000 7faebde00640 1 -- 172.21.15.5:0/738042333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeb81590b0 msgr2=0x7faeb81530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.291+0000 7faebde00640 1 --2- 172.21.15.5:0/738042333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeb81590b0 0x7faeb81530c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009f90 tx=0x7faeb000b040 comp rx=0 tx=0).stop 2024-08-17T02:50:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.291+0000 7faebde00640 1 -- 172.21.15.5:0/738042333 shutdown_connections 2024-08-17T02:50:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.291+0000 7faebde00640 1 --2- 172.21.15.5:0/738042333 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fae94065150 0x7fae94067600 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.291+0000 7faebde00640 1 --2- 172.21.15.5:0/738042333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faeb81590b0 0x7faeb81530c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.291+0000 7faebde00640 1 --2- 172.21.15.5:0/738042333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faeb80afca0 0x7faeb8148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.291+0000 7faebde00640 1 --2- 172.21.15.5:0/738042333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faeb80acf10 0x7faeb813a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.291+0000 7faebde00640 1 -- 172.21.15.5:0/738042333 >> 172.21.15.5:0/738042333 conn(0x7faeb8066e60 msgr2=0x7faeb81522b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.291+0000 7faebde00640 1 -- 172.21.15.5:0/738042333 shutdown_connections 2024-08-17T02:50:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.291+0000 7faebde00640 1 -- 172.21.15.5:0/738042333 wait complete. 2024-08-17T02:50:30.306 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:50:30.307 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:50:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.462+0000 7f951e200640 1 Processor -- start 2024-08-17T02:50:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.462+0000 7f951e200640 1 -- start start 2024-08-17T02:50:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.463+0000 7f951e200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9518156a90 0x7f95180ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.463+0000 7f951e200640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f95180aef00 0x7f95180ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.463+0000 7f951e200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95181582b0 con 0x7f95180adba0 2024-08-17T02:50:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.463+0000 7f951e200640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95180c9f80 con 0x7f95180aef00 2024-08-17T02:50:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.463+0000 7f951e200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95180ca110 con 0x7f9518156a90 2024-08-17T02:50:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.463+0000 7f9516a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f95180adba0 0x7f95180ae7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34362/0 (socket says 172.21.15.5:34362) 2024-08-17T02:50:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.464+0000 7f9516a00640 1 -- 172.21.15.5:0/1513653428 learned_addr learned my addr 172.21.15.5:0/1513653428 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:30.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.464+0000 7f9517400640 1 --2- 172.21.15.5:0/1513653428 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9518156a90 0x7f95180ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.464+0000 7f9517e00640 1 --2- 172.21.15.5:0/1513653428 >> v2:172.21.15.107:3300/0 conn(0x7f95180aef00 0x7f95180ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.464+0000 7f9516000640 1 -- 172.21.15.5:0/1513653428 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594222572 0 0) 0x7f95181582b0 con 0x7f95180adba0 2024-08-17T02:50:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.464+0000 7f9516000640 1 -- 172.21.15.5:0/1513653428 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94fc0034e0 con 0x7f95180adba0 2024-08-17T02:50:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.464+0000 7f9517400640 1 -- 172.21.15.5:0/1513653428 >> v2:172.21.15.107:3300/0 conn(0x7f95180aef00 msgr2=0x7f95180ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.464+0000 7f9517400640 1 --2- 172.21.15.5:0/1513653428 >> v2:172.21.15.107:3300/0 conn(0x7f95180aef00 0x7f95180ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.464+0000 7f9517400640 1 -- 172.21.15.5:0/1513653428 >> v1:172.21.15.5:6789/0 conn(0x7f95180adba0 legacy=0x7f95180ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.464+0000 7f9517400640 1 -- 172.21.15.5:0/1513653428 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95180adff0 con 0x7f9518156a90 2024-08-17T02:50:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.464+0000 7f9517e00640 1 --2- 172.21.15.5:0/1513653428 >> v2:172.21.15.107:3300/0 conn(0x7f95180aef00 0x7f95180ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.465+0000 7f9517400640 1 --2- 172.21.15.5:0/1513653428 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9518156a90 0x7f95180ad660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9508009850 tx=0x7f95080090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50bcc241edf9467e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:30.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.466+0000 7f9516000640 1 -- 172.21.15.5:0/1513653428 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950802ad00 con 0x7f9518156a90 2024-08-17T02:50:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.466+0000 7f9516000640 1 -- 172.21.15.5:0/1513653428 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950802ae60 con 0x7f9518156a90 2024-08-17T02:50:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.466+0000 7f9516000640 1 -- 172.21.15.5:0/1513653428 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508032650 con 0x7f9518156a90 2024-08-17T02:50:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.466+0000 7f951e200640 1 -- 172.21.15.5:0/1513653428 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9518156a90 msgr2=0x7f95180ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.466+0000 7f951e200640 1 --2- 172.21.15.5:0/1513653428 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9518156a90 0x7f95180ad660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9508009850 tx=0x7f95080090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.466+0000 7f951e200640 1 -- 172.21.15.5:0/1513653428 shutdown_connections 2024-08-17T02:50:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.466+0000 7f951e200640 1 --2- 172.21.15.5:0/1513653428 >> v2:172.21.15.107:3300/0 conn(0x7f95180aef00 0x7f95180ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.466+0000 7f951e200640 1 --2- 172.21.15.5:0/1513653428 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9518156a90 0x7f95180ad660 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.466+0000 7f951e200640 1 -- 172.21.15.5:0/1513653428 >> 172.21.15.5:0/1513653428 conn(0x7f9518066e60 msgr2=0x7f9518067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.466+0000 7f951e200640 1 -- 172.21.15.5:0/1513653428 shutdown_connections 2024-08-17T02:50:30.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.466+0000 7f951e200640 1 -- 172.21.15.5:0/1513653428 wait complete. 2024-08-17T02:50:30.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.468+0000 7f951e200640 1 Processor -- start 2024-08-17T02:50:30.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.468+0000 7f951e200640 1 -- start start 2024-08-17T02:50:30.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.469+0000 7f951e200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95180adba0 0x7f9518145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.469+0000 7f951e200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95180aef00 0x7f9518158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.469+0000 7f951e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9518156a90 0x7f9518158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.469+0000 7f951e200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951815f300 con 0x7f9518156a90 2024-08-17T02:50:30.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.469+0000 7f951e200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951815e6f0 con 0x7f95180adba0 2024-08-17T02:50:30.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.469+0000 7f951e200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951815e9d0 con 0x7f95180aef00 2024-08-17T02:50:30.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.469+0000 7f9517e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9518156a90 0x7f9518158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.469+0000 7f9517400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95180adba0 0x7f9518145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.469+0000 7f9517400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95180adba0 0x7f9518145340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:40128/0 (socket says 172.21.15.5:40128) 2024-08-17T02:50:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.469+0000 7f9517400640 1 -- 172.21.15.5:0/3483056556 learned_addr learned my addr 172.21.15.5:0/3483056556 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.469+0000 7f9516a00640 1 --2- 172.21.15.5:0/3483056556 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95180aef00 0x7f9518158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.470+0000 7f9517e00640 1 -- 172.21.15.5:0/3483056556 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95180aef00 msgr2=0x7f9518158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.470+0000 7f9517e00640 1 --2- 172.21.15.5:0/3483056556 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95180aef00 0x7f9518158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.470+0000 7f9517e00640 1 -- 172.21.15.5:0/3483056556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95180adba0 msgr2=0x7f9518145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.470+0000 7f9517e00640 1 --2- 172.21.15.5:0/3483056556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95180adba0 0x7f9518145340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.470+0000 7f9517e00640 1 -- 172.21.15.5:0/3483056556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9510009a20 con 0x7f9518156a90 2024-08-17T02:50:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.470+0000 7f9517400640 1 --2- 172.21.15.5:0/3483056556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95180adba0 0x7f9518145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.470+0000 7f9517e00640 1 --2- 172.21.15.5:0/3483056556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9518156a90 0x7f9518158bb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9510009f10 tx=0x7f951000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.470+0000 7f950ea00640 1 -- 172.21.15.5:0/3483056556 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951000cdb0 con 0x7f9518156a90 2024-08-17T02:50:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.470+0000 7f950ea00640 1 -- 172.21.15.5:0/3483056556 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951000f040 con 0x7f9518156a90 2024-08-17T02:50:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.470+0000 7f950ea00640 1 -- 172.21.15.5:0/3483056556 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95100146d0 con 0x7f9518156a90 2024-08-17T02:50:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.470+0000 7f951e200640 1 -- 172.21.15.5:0/3483056556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9508009390 con 0x7f9518156a90 2024-08-17T02:50:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.470+0000 7f951e200640 1 -- 172.21.15.5:0/3483056556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951815ef90 con 0x7f9518156a90 2024-08-17T02:50:30.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.471+0000 7f951e200640 1 -- 172.21.15.5:0/3483056556 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9518063fb0 con 0x7f9518156a90 2024-08-17T02:50:30.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.472+0000 7f950ea00640 1 -- 172.21.15.5:0/3483056556 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9510003020 con 0x7f9518156a90 2024-08-17T02:50:30.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.473+0000 7f950ea00640 1 --2- 172.21.15.5:0/3483056556 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f94f8065150 0x7f94f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.473+0000 7f950ea00640 1 -- 172.21.15.5:0/3483056556 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9510082b10 con 0x7f9518156a90 2024-08-17T02:50:30.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.473+0000 7f9517400640 1 --2- 172.21.15.5:0/3483056556 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f94f8065150 0x7f94f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.473+0000 7f950ea00640 1 --2- 172.21.15.5:0/3483056556 >> [v2:172.21.15.107:6824/37152,v1:172.21.15.107:6825/37152] conn(0x7f94f806b040 0x7f94f806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.473+0000 7f950ea00640 1 -- 172.21.15.5:0/3483056556 --> [v2:172.21.15.107:6824/37152,v1:172.21.15.107:6825/37152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94f806db00 con 0x7f94f806b040 2024-08-17T02:50:30.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.473+0000 7f950ea00640 1 -- 172.21.15.5:0/3483056556 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9510087220 con 0x7f9518156a90 2024-08-17T02:50:30.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.474+0000 7f9517400640 1 --2- 172.21.15.5:0/3483056556 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f94f8065150 0x7f94f8067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9508009130 tx=0x7f9508032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:30.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.474+0000 7f9516a00640 1 --2- 172.21.15.5:0/3483056556 >> [v2:172.21.15.107:6824/37152,v1:172.21.15.107:6825/37152] conn(0x7f94f806b040 0x7f94f806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.475+0000 7f9516a00640 1 --2- 172.21.15.5:0/3483056556 >> [v2:172.21.15.107:6824/37152,v1:172.21.15.107:6825/37152] conn(0x7f94f806b040 0x7f94f806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:30.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.475+0000 7f950ea00640 1 -- 172.21.15.5:0/3483056556 <== osd.7 v2:172.21.15.107:6824/37152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f94f806db00 con 0x7f94f806b040 2024-08-17T02:50:30.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.488+0000 7f951e200640 1 -- 172.21.15.5:0/3483056556 --> [v2:172.21.15.107:6824/37152,v1:172.21.15.107:6825/37152] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f95181573c0 con 0x7f94f806b040 2024-08-17T02:50:30.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.489+0000 7f950ea00640 1 -- 172.21.15.5:0/3483056556 <== osd.7 v2:172.21.15.107:6824/37152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f95181573c0 con 0x7f94f806b040 2024-08-17T02:50:30.489 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-17T02:50:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:50:30.490 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-17T02:50:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.489+0000 7f951e200640 1 -- 172.21.15.5:0/3483056556 >> [v2:172.21.15.107:6824/37152,v1:172.21.15.107:6825/37152] conn(0x7f94f806b040 msgr2=0x7f94f806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.489+0000 7f951e200640 1 --2- 172.21.15.5:0/3483056556 >> [v2:172.21.15.107:6824/37152,v1:172.21.15.107:6825/37152] conn(0x7f94f806b040 0x7f94f806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.489+0000 7f951e200640 1 -- 172.21.15.5:0/3483056556 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f94f8065150 msgr2=0x7f94f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.489+0000 7f951e200640 1 --2- 172.21.15.5:0/3483056556 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f94f8065150 0x7f94f8067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9508009130 tx=0x7f9508032000 comp rx=0 tx=0).stop 2024-08-17T02:50:30.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.489+0000 7f951e200640 1 -- 172.21.15.5:0/3483056556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9518156a90 msgr2=0x7f9518158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.489+0000 7f951e200640 1 --2- 172.21.15.5:0/3483056556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9518156a90 0x7f9518158bb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9510009f10 tx=0x7f951000b040 comp rx=0 tx=0).stop 2024-08-17T02:50:30.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.489+0000 7f9517e00640 1 -- 172.21.15.5:0/3483056556 reap_dead start 2024-08-17T02:50:30.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.489+0000 7f951e200640 1 -- 172.21.15.5:0/3483056556 shutdown_connections 2024-08-17T02:50:30.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.489+0000 7f951e200640 1 -- 172.21.15.5:0/3483056556 >> 172.21.15.5:0/3483056556 conn(0x7f9518066e60 msgr2=0x7f9518153f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:30.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.489+0000 7f951e200640 1 -- 172.21.15.5:0/3483056556 shutdown_connections 2024-08-17T02:50:30.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.489+0000 7f951e200640 1 -- 172.21.15.5:0/3483056556 wait complete. 2024-08-17T02:50:30.503 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:50:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.655+0000 7f3aba200640 1 Processor -- start 2024-08-17T02:50:30.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.655+0000 7f3aba200640 1 -- start start 2024-08-17T02:50:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.656+0000 7f3aba200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ab41590b0 0x7f3ab40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.656+0000 7f3aba200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ab40acf10 0x7f3ab4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.656+0000 7f3aba200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab415a4e0 con 0x7f3ab40afca0 2024-08-17T02:50:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.656+0000 7f3aba200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab40b0980 con 0x7f3ab41590b0 2024-08-17T02:50:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.656+0000 7f3aba200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab40c92b0 con 0x7f3ab40acf10 2024-08-17T02:50:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.657+0000 7f3ab3400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3ab40afca0 0x7f3ab41589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34374/0 (socket says 172.21.15.5:34374) 2024-08-17T02:50:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.657+0000 7f3ab3400640 1 -- 172.21.15.5:0/2906205024 learned_addr learned my addr 172.21.15.5:0/2906205024 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.657+0000 7f3aaaa00640 1 --2- 172.21.15.5:0/2906205024 >> v2:172.21.15.5:3300/0 conn(0x7f3ab41590b0 0x7f3ab40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.657+0000 7f3ab3e00640 1 --2- 172.21.15.5:0/2906205024 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ab40acf10 0x7f3ab4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.657+0000 7f3ab2a00640 1 -- 172.21.15.5:0/2906205024 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242870237 0 0) 0x7f3aa4001110 con 0x7f3ab40afca0 2024-08-17T02:50:30.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.657+0000 7f3ab2a00640 1 -- 172.21.15.5:0/2906205024 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a980034e0 con 0x7f3ab40afca0 2024-08-17T02:50:30.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.657+0000 7f3aaaa00640 1 -- 172.21.15.5:0/2906205024 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ab40acf10 msgr2=0x7f3ab4159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:30.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.657+0000 7f3aaaa00640 1 --2- 172.21.15.5:0/2906205024 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ab40acf10 0x7f3ab4159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.657+0000 7f3aaaa00640 1 -- 172.21.15.5:0/2906205024 >> v1:172.21.15.5:6789/0 conn(0x7f3ab40afca0 legacy=0x7f3ab41589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.657+0000 7f3aaaa00640 1 -- 172.21.15.5:0/2906205024 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab40ad480 con 0x7f3ab41590b0 2024-08-17T02:50:30.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.658+0000 7f3aaaa00640 1 --2- 172.21.15.5:0/2906205024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab41590b0 0x7f3ab40b0070 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c009850 tx=0x7f3a9c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97ec1df9bdcc847 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:30.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.659+0000 7f3ab2a00640 1 -- 172.21.15.5:0/2906205024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c02ad90 con 0x7f3ab41590b0 2024-08-17T02:50:30.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.659+0000 7f3ab2a00640 1 -- 172.21.15.5:0/2906205024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9c032440 con 0x7f3ab41590b0 2024-08-17T02:50:30.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.659+0000 7f3ab2a00640 1 -- 172.21.15.5:0/2906205024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c032820 con 0x7f3ab41590b0 2024-08-17T02:50:30.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.659+0000 7f3aba200640 1 -- 172.21.15.5:0/2906205024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab41590b0 msgr2=0x7f3ab40b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.659+0000 7f3aba200640 1 --2- 172.21.15.5:0/2906205024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab41590b0 0x7f3ab40b0070 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c009850 tx=0x7f3a9c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.659+0000 7f3aba200640 1 -- 172.21.15.5:0/2906205024 shutdown_connections 2024-08-17T02:50:30.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.659+0000 7f3aba200640 1 --2- 172.21.15.5:0/2906205024 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ab40acf10 0x7f3ab4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.659+0000 7f3aba200640 1 --2- 172.21.15.5:0/2906205024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab41590b0 0x7f3ab40b0070 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.659+0000 7f3aba200640 1 -- 172.21.15.5:0/2906205024 >> 172.21.15.5:0/2906205024 conn(0x7f3ab4066e60 msgr2=0x7f3ab4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:30.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.659+0000 7f3aba200640 1 -- 172.21.15.5:0/2906205024 shutdown_connections 2024-08-17T02:50:30.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.659+0000 7f3aba200640 1 -- 172.21.15.5:0/2906205024 wait complete. 2024-08-17T02:50:30.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.661+0000 7f3aba200640 1 Processor -- start 2024-08-17T02:50:30.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.661+0000 7f3aba200640 1 -- start start 2024-08-17T02:50:30.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.662+0000 7f3aba200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab40acf10 0x7f3ab41460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.662+0000 7f3aba200640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ab40afca0 0x7f3ab414aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.662+0000 7f3aba200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab41590b0 0x7f3ab4146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.662+0000 7f3aba200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab41450d0 con 0x7f3ab41590b0 2024-08-17T02:50:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.662+0000 7f3aba200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab41452e0 con 0x7f3ab40acf10 2024-08-17T02:50:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.662+0000 7f3aba200640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab41455c0 con 0x7f3ab40afca0 2024-08-17T02:50:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.662+0000 7f3ab3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab41590b0 0x7f3ab4146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.662+0000 7f3ab3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab41590b0 0x7f3ab4146fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43614/0 (socket says 172.21.15.5:43614) 2024-08-17T02:50:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.662+0000 7f3ab3e00640 1 -- 172.21.15.5:0/2604222782 learned_addr learned my addr 172.21.15.5:0/2604222782 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.662+0000 7f3aaaa00640 1 --2- 172.21.15.5:0/2604222782 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ab40afca0 0x7f3ab414aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.662+0000 7f3ab3400640 1 --2- 172.21.15.5:0/2604222782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab40acf10 0x7f3ab41460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.662+0000 7f3ab3e00640 1 -- 172.21.15.5:0/2604222782 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ab40afca0 msgr2=0x7f3ab414aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.662+0000 7f3ab3e00640 1 --2- 172.21.15.5:0/2604222782 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ab40afca0 0x7f3ab414aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.662+0000 7f3ab3e00640 1 -- 172.21.15.5:0/2604222782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab40acf10 msgr2=0x7f3ab41460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.662+0000 7f3ab3e00640 1 --2- 172.21.15.5:0/2604222782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab40acf10 0x7f3ab41460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.662+0000 7f3ab3e00640 1 -- 172.21.15.5:0/2604222782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9c009390 con 0x7f3ab41590b0 2024-08-17T02:50:30.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.663+0000 7f3ab3e00640 1 --2- 172.21.15.5:0/2604222782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab41590b0 0x7f3ab4146fa0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3aac007f30 tx=0x7f3aac0098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.663+0000 7f3aab400640 1 -- 172.21.15.5:0/2604222782 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac00ee30 con 0x7f3ab41590b0 2024-08-17T02:50:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.663+0000 7f3aab400640 1 -- 172.21.15.5:0/2604222782 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac014420 con 0x7f3ab41590b0 2024-08-17T02:50:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.663+0000 7f3aab400640 1 -- 172.21.15.5:0/2604222782 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac0147e0 con 0x7f3ab41590b0 2024-08-17T02:50:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.663+0000 7f3aba200640 1 -- 172.21.15.5:0/2604222782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab41458a0 con 0x7f3ab41590b0 2024-08-17T02:50:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.663+0000 7f3aba200640 1 -- 172.21.15.5:0/2604222782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab414b020 con 0x7f3ab41590b0 2024-08-17T02:50:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.664+0000 7f3aba200640 1 -- 172.21.15.5:0/2604222782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab414b240 con 0x7f3ab41590b0 2024-08-17T02:50:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.665+0000 7f3aab400640 1 -- 172.21.15.5:0/2604222782 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3aac014b90 con 0x7f3ab41590b0 2024-08-17T02:50:30.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.666+0000 7f3aab400640 1 --2- 172.21.15.5:0/2604222782 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3a90065150 0x7f3a90067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:30.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.666+0000 7f3aab400640 1 -- 172.21.15.5:0/2604222782 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f3aac082910 con 0x7f3ab41590b0 2024-08-17T02:50:30.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.666+0000 7f3ab3400640 1 --2- 172.21.15.5:0/2604222782 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3a90065150 0x7f3a90067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:30.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.667+0000 7f3ab3400640 1 --2- 172.21.15.5:0/2604222782 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3a90065150 0x7f3a90067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4001270 tx=0x7f3aa4007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:30.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.670+0000 7f3aab400640 1 -- 172.21.15.5:0/2604222782 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3aac050c80 con 0x7f3ab41590b0 2024-08-17T02:50:30.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.853+0000 7f3aba200640 1 -- 172.21.15.5:0/2604222782 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ab4063fb0 con 0x7f3a90065150 2024-08-17T02:50:30.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.853+0000 7f3aab400640 1 -- 172.21.15.5:0/2604222782 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3ab4063fb0 con 0x7f3a90065150 2024-08-17T02:50:30.854 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:50:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.856+0000 7f3aba200640 1 -- 172.21.15.5:0/2604222782 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3a90065150 msgr2=0x7f3a90067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.856+0000 7f3aba200640 1 --2- 172.21.15.5:0/2604222782 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3a90065150 0x7f3a90067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4001270 tx=0x7f3aa4007b60 comp rx=0 tx=0).stop 2024-08-17T02:50:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.856+0000 7f3aba200640 1 -- 172.21.15.5:0/2604222782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab41590b0 msgr2=0x7f3ab4146fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.856+0000 7f3aba200640 1 --2- 172.21.15.5:0/2604222782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab41590b0 0x7f3ab4146fa0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3aac007f30 tx=0x7f3aac0098e0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.856+0000 7f3aba200640 1 -- 172.21.15.5:0/2604222782 shutdown_connections 2024-08-17T02:50:30.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.856+0000 7f3aba200640 1 --2- 172.21.15.5:0/2604222782 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f3a90065150 0x7f3a90067600 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.856+0000 7f3aba200640 1 --2- 172.21.15.5:0/2604222782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ab41590b0 0x7f3ab4146fa0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.856+0000 7f3aba200640 1 --2- 172.21.15.5:0/2604222782 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3ab40afca0 0x7f3ab414aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.856+0000 7f3aba200640 1 --2- 172.21.15.5:0/2604222782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab40acf10 0x7f3ab41460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.856+0000 7f3aba200640 1 -- 172.21.15.5:0/2604222782 >> 172.21.15.5:0/2604222782 conn(0x7f3ab4066e60 msgr2=0x7f3ab414f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.856+0000 7f3aba200640 1 -- 172.21.15.5:0/2604222782 shutdown_connections 2024-08-17T02:50:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:30.856+0000 7f3aba200640 1 -- 172.21.15.5:0/2604222782 wait complete. 2024-08-17T02:50:30.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:50:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.021+0000 7ff3cce00640 1 Processor -- start 2024-08-17T02:50:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.021+0000 7ff3cce00640 1 -- start start 2024-08-17T02:50:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.022+0000 7ff3cce00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3c80afca0 0x7ff3c80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.022+0000 7ff3cce00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3c80acf10 0x7ff3c8159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.023+0000 7ff3cce00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c815a4e0 con 0x7ff3c81589a0 2024-08-17T02:50:31.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.023+0000 7ff3cce00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c80b0980 con 0x7ff3c80acf10 2024-08-17T02:50:31.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.023+0000 7ff3cce00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80c92b0 con 0x7ff3c80afca0 2024-08-17T02:50:31.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.023+0000 7ff3bfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3c80acf10 0x7ff3c8159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:31.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.023+0000 7ff3bfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3c80acf10 0x7ff3c8159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43622/0 (socket says 172.21.15.5:43622) 2024-08-17T02:50:31.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.023+0000 7ff3bfe00640 1 -- 172.21.15.5:0/1489162933 learned_addr learned my addr 172.21.15.5:0/1489162933 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:31.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.023+0000 7ff3c5e00640 1 --2- 172.21.15.5:0/1489162933 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3c80afca0 0x7ff3c80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:31.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.023+0000 7ff3bfe00640 1 -- 172.21.15.5:0/1489162933 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3c80afca0 msgr2=0x7ff3c80b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:31.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.023+0000 7ff3bfe00640 1 --2- 172.21.15.5:0/1489162933 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3c80afca0 0x7ff3c80b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:31.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.023+0000 7ff3bfe00640 1 -- 172.21.15.5:0/1489162933 >> v1:172.21.15.107:6789/0 conn(0x7ff3c81589a0 legacy=0x7ff3c806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:31.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.023+0000 7ff3bfe00640 1 -- 172.21.15.5:0/1489162933 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c80ad480 con 0x7ff3c80acf10 2024-08-17T02:50:31.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.024+0000 7ff3bfe00640 1 --2- 172.21.15.5:0/1489162933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c80acf10 0x7ff3c8159fa0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009940 tx=0x7ff3b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da832c6a49cefc9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:31.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.025+0000 7ff3c5400640 1 -- 172.21.15.5:0/1489162933 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b002ae40 con 0x7ff3c80acf10 2024-08-17T02:50:31.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.025+0000 7ff3c5400640 1 -- 172.21.15.5:0/1489162933 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b0032440 con 0x7ff3c80acf10 2024-08-17T02:50:31.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.025+0000 7ff3c5400640 1 -- 172.21.15.5:0/1489162933 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0032820 con 0x7ff3c80acf10 2024-08-17T02:50:31.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.025+0000 7ff3cce00640 1 -- 172.21.15.5:0/1489162933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c80acf10 msgr2=0x7ff3c8159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:31.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.025+0000 7ff3cce00640 1 --2- 172.21.15.5:0/1489162933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c80acf10 0x7ff3c8159fa0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009940 tx=0x7ff3b00091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:31.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.025+0000 7ff3cce00640 1 -- 172.21.15.5:0/1489162933 shutdown_connections 2024-08-17T02:50:31.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.025+0000 7ff3cce00640 1 --2- 172.21.15.5:0/1489162933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c80acf10 0x7ff3c8159fa0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:31.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.025+0000 7ff3cce00640 1 --2- 172.21.15.5:0/1489162933 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3c80afca0 0x7ff3c80b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:31.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.025+0000 7ff3cce00640 1 -- 172.21.15.5:0/1489162933 >> 172.21.15.5:0/1489162933 conn(0x7ff3c8066e60 msgr2=0x7ff3c8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:31.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.025+0000 7ff3cce00640 1 -- 172.21.15.5:0/1489162933 shutdown_connections 2024-08-17T02:50:31.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.025+0000 7ff3cce00640 1 -- 172.21.15.5:0/1489162933 wait complete. 2024-08-17T02:50:31.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.027+0000 7ff3cce00640 1 Processor -- start 2024-08-17T02:50:31.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.027+0000 7ff3cce00640 1 -- start start 2024-08-17T02:50:31.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3cce00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3c80acf10 0x7ff3c8143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:31.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3cce00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3c80afca0 0x7ff3c806a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:31.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3cce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c81589a0 0x7ff3c806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:31.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3cce00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c815ffa0 con 0x7ff3c81589a0 2024-08-17T02:50:31.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3cce00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c815af30 con 0x7ff3c80acf10 2024-08-17T02:50:31.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3cce00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c8160180 con 0x7ff3c80afca0 2024-08-17T02:50:31.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3c6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c81589a0 0x7ff3c806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:31.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3c5e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3c80acf10 0x7ff3c8143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:31.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3bfe00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3c80afca0 0x7ff3c806a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:31.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3c6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c81589a0 0x7ff3c806abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43634/0 (socket says 172.21.15.5:43634) 2024-08-17T02:50:31.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3c5e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3c80acf10 0x7ff3c8143f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.5:40142/0 (socket says 172.21.15.5:40142) 2024-08-17T02:50:31.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3c6800640 1 -- 172.21.15.5:0/2650665831 learned_addr learned my addr 172.21.15.5:0/2650665831 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:31.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3c6800640 1 -- 172.21.15.5:0/2650665831 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3c80afca0 msgr2=0x7ff3c806a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:31.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3c6800640 1 --2- 172.21.15.5:0/2650665831 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3c80afca0 0x7ff3c806a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:31.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3c6800640 1 -- 172.21.15.5:0/2650665831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3c80acf10 msgr2=0x7ff3c8143f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:31.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3c6800640 1 --2- 172.21.15.5:0/2650665831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3c80acf10 0x7ff3c8143f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.028+0000 7ff3c6800640 1 -- 172.21.15.5:0/2650665831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b0009450 con 0x7ff3c81589a0 2024-08-17T02:50:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.029+0000 7ff3c6800640 1 --2- 172.21.15.5:0/2650665831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c81589a0 0x7ff3c806abd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000c7c0 tx=0x7ff3c00015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.029+0000 7ff3bd600640 1 -- 172.21.15.5:0/2650665831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c000a640 con 0x7ff3c81589a0 2024-08-17T02:50:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.029+0000 7ff3bd600640 1 -- 172.21.15.5:0/2650665831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c000a7c0 con 0x7ff3c81589a0 2024-08-17T02:50:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.029+0000 7ff3cce00640 1 -- 172.21.15.5:0/2650665831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c8160460 con 0x7ff3c81589a0 2024-08-17T02:50:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.029+0000 7ff3bd600640 1 -- 172.21.15.5:0/2650665831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c000ab80 con 0x7ff3c81589a0 2024-08-17T02:50:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.029+0000 7ff3cce00640 1 -- 172.21.15.5:0/2650665831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c8160a20 con 0x7ff3c81589a0 2024-08-17T02:50:31.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.030+0000 7ff3cce00640 1 -- 172.21.15.5:0/2650665831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c815b0a0 con 0x7ff3c81589a0 2024-08-17T02:50:31.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.031+0000 7ff3bd600640 1 -- 172.21.15.5:0/2650665831 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff3c0003030 con 0x7ff3c81589a0 2024-08-17T02:50:31.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.032+0000 7ff3bd600640 1 --2- 172.21.15.5:0/2650665831 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff3a4065150 0x7ff3a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:31.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.032+0000 7ff3bd600640 1 -- 172.21.15.5:0/2650665831 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff3c0081eb0 con 0x7ff3c81589a0 2024-08-17T02:50:31.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.032+0000 7ff3c5e00640 1 --2- 172.21.15.5:0/2650665831 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff3a4065150 0x7ff3a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:31.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.033+0000 7ff3c5e00640 1 --2- 172.21.15.5:0/2650665831 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff3a4065150 0x7ff3a4067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80c8150 tx=0x7ff3b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:31.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.036+0000 7ff3bd600640 1 -- 172.21.15.5:0/2650665831 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff3c0050220 con 0x7ff3c81589a0 2024-08-17T02:50:31.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.214+0000 7ff3cce00640 1 -- 172.21.15.5:0/2650665831 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3c815a4e0 con 0x7ff3a4065150 2024-08-17T02:50:31.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.217+0000 7ff3bd600640 1 -- 172.21.15.5:0/2650665831 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50910 (secure 0 0 0) 0x7ff3c815a4e0 con 0x7ff3a4065150 2024-08-17T02:50:31.217 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:31.218 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:50:31.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.219+0000 7ff3cce00640 1 -- 172.21.15.5:0/2650665831 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff3a4065150 msgr2=0x7ff3a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:31.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.219+0000 7ff3cce00640 1 --2- 172.21.15.5:0/2650665831 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff3a4065150 0x7ff3a4067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80c8150 tx=0x7ff3b8008040 comp rx=0 tx=0).stop 2024-08-17T02:50:31.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.219+0000 7ff3cce00640 1 -- 172.21.15.5:0/2650665831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c81589a0 msgr2=0x7ff3c806abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:31.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.219+0000 7ff3cce00640 1 --2- 172.21.15.5:0/2650665831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c81589a0 0x7ff3c806abd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000c7c0 tx=0x7ff3c00015f0 comp rx=0 tx=0).stop 2024-08-17T02:50:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.219+0000 7ff3cce00640 1 -- 172.21.15.5:0/2650665831 shutdown_connections 2024-08-17T02:50:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.219+0000 7ff3cce00640 1 --2- 172.21.15.5:0/2650665831 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ff3a4065150 0x7ff3a4067600 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.219+0000 7ff3cce00640 1 --2- 172.21.15.5:0/2650665831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3c81589a0 0x7ff3c806abd0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.219+0000 7ff3cce00640 1 --2- 172.21.15.5:0/2650665831 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff3c80afca0 0x7ff3c806a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.219+0000 7ff3cce00640 1 --2- 172.21.15.5:0/2650665831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3c80acf10 0x7ff3c8143f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.219+0000 7ff3cce00640 1 -- 172.21.15.5:0/2650665831 >> 172.21.15.5:0/2650665831 conn(0x7ff3c8066e60 msgr2=0x7ff3c80ca910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.219+0000 7ff3cce00640 1 -- 172.21.15.5:0/2650665831 shutdown_connections 2024-08-17T02:50:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:31.219+0000 7ff3cce00640 1 -- 172.21.15.5:0/2650665831 wait complete. 2024-08-17T02:50:31.233 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-08-17T02:50:31.107256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400688,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574032,"statfs":{"total":773094113280,"available":770635808768,"internally_reserved":0,"allocated":5283840,"data_stored":2894840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.612491"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:50:20.661589+0000","last_change":"2024-08-17T02:46:48.424689+0000","last_active":"2024-08-17T02:50:20.661589+0000","last_peered":"2024-08-17T02:50:20.661589+0000","last_clean":"2024-08-17T02:50:20.661589+0000","last_became_active":"2024-08-17T02:46:48.423437+0000","last_became_peered":"2024-08-17T02:46:48.423437+0000","last_unstale":"2024-08-17T02:50:20.661589+0000","last_undegraded":"2024-08-17T02:50:20.661589+0000","last_fullsized":"2024-08-17T02:50:20.661589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:47.106569+0000","last_clean_scrub_stamp":"2024-08-17T02:46:47.106569+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1105920,"data_stored":804631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.66800000000000004,"15min":0.63500000000000001},"min":{"1min":0.65900000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.69899999999999995,"15min":0.67000000000000004},"min":{"1min":0.70299999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90600000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.66200000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.64800000000000002,"15min":0.63600000000000001},"min":{"1min":0.63200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.63600000000000001,"15min":0.60599999999999998},"min":{"1min":0.60499999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92400000000000004,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.59499999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.69599999999999995,"15min":0.66800000000000004},"min":{"1min":0.70199999999999996,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95199999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.72899999999999998,"15min":0.72099999999999997},"min":{"1min":0.56699999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.621}]},{"osd":3,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.55400000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.875,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.70799999999999996,"15min":0.69399999999999995},"min":{"1min":0.63100000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.52400000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69399999999999995,"15min":0.70899999999999996},"min":{"1min":0.53200000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.50600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63100000000000001,"15min":0.64300000000000002},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.46100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.47899999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.84799999999999998,"5min":1.024,"15min":1.024},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65700000000000003,"15min":0.66900000000000004},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.67800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.56599999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.878,"5min":0.996,"15min":0.996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.69599999999999995},"min":{"1min":0.57099999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88700000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.67800000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82999999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.74199999999999999,"15min":0.72799999999999998},"min":{"1min":0.65300000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.84599999999999997,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72199999999999998,"15min":0.71599999999999997},"min":{"1min":0.67300000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90600000000000003,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.66800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.88100000000000001,"5min":1.458,"15min":1.458},"last":0.56999999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.63800000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92200000000000004,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69799999999999995,"15min":0.69199999999999995},"min":{"1min":0.53700000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.81299999999999994,"5min":1.099,"15min":1.099},"last":0.623}]},{"osd":4,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84999999999999998,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":1.55,"15min":1.55},"last":0.63300000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.65600000000000003},"min":{"1min":0.49199999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88300000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.69899999999999995,"15min":0.73399999999999999},"min":{"1min":0.46400000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.86199999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73099999999999998,"15min":0.77200000000000002},"min":{"1min":0.46600000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84099999999999997,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.499,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85299999999999998,"5min":1.077,"15min":1.077},"last":0.57999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.65700000000000003,"15min":0.63400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96399999999999997,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.63800000000000001,"15min":0.60599999999999998},"min":{"1min":0.52100000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88800000000000001,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.61699999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.65400000000000003,"15min":0.627},"min":{"1min":0.61499999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92100000000000004,"5min":1.095,"15min":1.095},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.68999999999999995,"15min":0.66400000000000003},"min":{"1min":0.47399999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56499999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71499999999999997,"15min":0.69099999999999995},"min":{"1min":0.67200000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91900000000000004,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.53100000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98899999999999999,"5min":1.25,"15min":1.25},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.68799999999999994,"15min":0.66300000000000003},"min":{"1min":0.64400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.90200000000000002,"5min":1.014,"15min":1.014},"last":0.505},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70499999999999996,"15min":0.69599999999999995},"min":{"1min":0.54700000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.91600000000000004,"5min":1.087,"15min":1.087},"last":0.49199999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64100000000000001,"15min":0.65000000000000002},"min":{"1min":0.47099999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81100000000000005,"5min":1.206,"15min":1.206},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70999999999999996,"15min":0.71599999999999997},"min":{"1min":0.435,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89100000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64500000000000002,"15min":0.65600000000000003},"min":{"1min":0.47899999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.76900000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.76200000000000001,"15min":0.77200000000000002},"min":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.871,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.55700000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70599999999999996,"15min":0.71999999999999997},"min":{"1min":0.54800000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.90600000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.53300000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.77800000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.46700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.52500000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92300000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67200000000000004,"15min":0.65400000000000003},"min":{"1min":0.55700000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89200000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.39500000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67400000000000004,"15min":0.65200000000000002},"min":{"1min":0.59699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85899999999999999,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.57299999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85499999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.48999999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69499999999999995,"15min":0.66900000000000004},"min":{"1min":0.63800000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.55700000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89700000000000002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67900000000000005,"15min":0.65900000000000003},"min":{"1min":0.55900000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93899999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.72399999999999998,"15min":0.71199999999999997},"min":{"1min":0.62,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91000000000000003,"5min":1.022,"15min":1.022},"last":0.60499999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79800000000000004,"5min":0.999,"15min":0.999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89200000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54400000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.89100000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.47299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89300000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.52500000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.51300000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94599999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72399999999999998},"min":{"1min":0.54200000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91600000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.41899999999999998,"15min":0.40899999999999997},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.375},{"interface":"front","average":{"1min":0.498,"5min":0.44400000000000001,"15min":0.42799999999999999},"min":{"1min":0.32600000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.746,"5min":0.879,"15min":0.879},"last":0.39600000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42699999999999999,"15min":0.41899999999999998},"min":{"1min":0.34699999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71299999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.501,"15min":0.496},"min":{"1min":0.39200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.44}]},{"osd":2,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54700000000000004,"15min":0.52900000000000003},"min":{"1min":0.438,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.748,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75,"15min":0.76000000000000001},"min":{"1min":0.56200000000000006,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93600000000000005,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78500000000000003,"15min":0.80200000000000005},"min":{"1min":0.60099999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91600000000000004,"5min":1.196,"15min":1.196},"last":0.57199999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.82599999999999996},"min":{"1min":0.65200000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.96399999999999997,"5min":1.704,"15min":1.704},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79400000000000004,"15min":0.80800000000000005},"min":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0580000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.626,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.091,"5min":1.21,"15min":1.21},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.77200000000000002,"15min":0.78300000000000003},"min":{"1min":0.57699999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98599999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:49:49 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.60499999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92500000000000004,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.629},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.81499999999999995,"15min":0.82999999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0089999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.54300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.309,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67600000000000005,"5min":1.417,"15min":1.417},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.498,"15min":0.5},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.60299999999999998,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.50700000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59899999999999998,"15min":0.621},"min":{"1min":0.40500000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73499999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.47699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.79500000000000004,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.73199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.496},"min":{"1min":0.33500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.67600000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.629},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.48599999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.72999999999999998,"5min":1.343,"15min":1.343},"last":0.75800000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80200000000000005,"15min":0.79200000000000004},"min":{"1min":0.67400000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.03,"5min":1.466,"15min":1.466},"last":1.028},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.61399999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.03,"5min":1.548,"15min":1.548},"last":1.052}]},{"osd":5,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.80100000000000005,"15min":0.79000000000000004},"min":{"1min":0.57699999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0680000000000001,"5min":1.617,"15min":1.617},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.77700000000000002},"min":{"1min":0.57999999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93300000000000005,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.1060000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82299999999999995,"15min":0.81899999999999995},"min":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.079,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.66100000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0249999999999999,"5min":1.5,"15min":1.5},"last":1.091}]},{"osd":7,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.83499999999999996,"15min":0.83899999999999997},"min":{"1min":0.59699999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.99299999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.008},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.117,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0669999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34499999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64000000000000001,"5min":1.093,"15min":1.093},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71599999999999997,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.44700000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65700000000000003,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.48599999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72599999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.36699999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.64400000000000002},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.754,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.39600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81599999999999995,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85899999999999999,"15min":0.875},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2809999999999999,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.85499999999999998,"15min":0.872},"min":{"1min":0.67800000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1619999999999999,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.60099999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.874,"15min":0.90200000000000002},"min":{"1min":0.625,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3859999999999999,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.83199999999999996},"min":{"1min":0.65600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.24,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.874,"15min":0.89400000000000002},"min":{"1min":0.61199999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.2130000000000001,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.89000000000000001,"15min":0.91600000000000004},"min":{"1min":0.63700000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.302,"5min":3.3820000000000001,"15min":3.3820000000000001},"last":0.65200000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86199999999999999,"15min":0.871},"min":{"1min":0.61399999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1200000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.875,"15min":0.88700000000000001},"min":{"1min":0.65100000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.272,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":0.746}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1105920,"data_stored":804631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48099999999999998,"15min":0.47699999999999998},"min":{"1min":0.33900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.748,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.46100000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47699999999999998,"15min":0.46700000000000003},"min":{"1min":0.38500000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.40999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.68700000000000006,"5min":1.702,"15min":1.702},"last":0.51900000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.47799999999999998,"15min":0.46700000000000003},"min":{"1min":0.35999999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.624,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.48499999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71899999999999997,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.44800000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.79600000000000004,"15min":0.77800000000000002},"min":{"1min":0.63300000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.141,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78200000000000003,"15min":0.77000000000000002},"min":{"1min":0.61699999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.75700000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.82299999999999995,"15min":0.81699999999999995},"min":{"1min":0.69499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.413,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79300000000000004,"15min":0.79100000000000004},"min":{"1min":0.63700000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1359999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.82199999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.82199999999999995,"15min":0.80800000000000005},"min":{"1min":0.65600000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.216,"5min":1.784,"15min":1.784},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.58499999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.288,"5min":1.538,"15min":1.538},"last":0.78200000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.67200000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83399999999999996,"15min":0.82399999999999995},"min":{"1min":0.73099999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3500000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.84099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:50:31.237 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:46:47.106569+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=46, tm_sec=47, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=50, tm_sec=25, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:50:31.237 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:50:51.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:50:51.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.400+0000 7ffa71000640 1 Processor -- start 2024-08-17T02:50:51.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.401+0000 7ffa71000640 1 -- start start 2024-08-17T02:50:51.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.402+0000 7ffa71000640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa6c158c60 0x7ffa6c15a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:51.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.402+0000 7ffa71000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa6c159030 0x7ffa6c0ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:51.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.402+0000 7ffa71000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa6c0b1920 0x7ffa6c0b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:51.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.402+0000 7ffa71000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c0b0540 con 0x7ffa6c159030 2024-08-17T02:50:51.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.402+0000 7ffa71000640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c15b6b0 con 0x7ffa6c158c60 2024-08-17T02:50:51.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.402+0000 7ffa71000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c15aac0 con 0x7ffa6c0b1920 2024-08-17T02:50:51.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.402+0000 7ffa6aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa6c159030 0x7ffa6c0ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:51.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.402+0000 7ffa6aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa6c159030 0x7ffa6c0ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40472/0 (socket says 172.21.15.5:40472) 2024-08-17T02:50:51.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.402+0000 7ffa6aa00640 1 -- 172.21.15.5:0/767328996 learned_addr learned my addr 172.21.15.5:0/767328996 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:51.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.402+0000 7ffa6be00640 1 --2- 172.21.15.5:0/767328996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa6c0b1920 0x7ffa6c0b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:51.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.402+0000 7ffa6b400640 1 --2- 172.21.15.5:0/767328996 >> v2:172.21.15.107:3300/0 conn(0x7ffa6c158c60 0x7ffa6c15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:51.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.403+0000 7ffa6aa00640 1 -- 172.21.15.5:0/767328996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa6c0b1920 msgr2=0x7ffa6c0b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:51.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.403+0000 7ffa6aa00640 1 --2- 172.21.15.5:0/767328996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa6c0b1920 0x7ffa6c0b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.403+0000 7ffa6aa00640 1 -- 172.21.15.5:0/767328996 >> v2:172.21.15.107:3300/0 conn(0x7ffa6c158c60 msgr2=0x7ffa6c15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:51.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.403+0000 7ffa6aa00640 1 --2- 172.21.15.5:0/767328996 >> v2:172.21.15.107:3300/0 conn(0x7ffa6c158c60 0x7ffa6c15a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.403+0000 7ffa6aa00640 1 -- 172.21.15.5:0/767328996 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c15ad80 con 0x7ffa6c159030 2024-08-17T02:50:51.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.403+0000 7ffa6aa00640 1 --2- 172.21.15.5:0/767328996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c159030 0x7ffa6c0ca8b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0889c0 tx=0x7ffa580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f4b8207af9ad6c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:51.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.404+0000 7ffa6a000640 1 -- 172.21.15.5:0/767328996 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5802ad40 con 0x7ffa6c159030 2024-08-17T02:50:51.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.404+0000 7ffa6a000640 1 -- 172.21.15.5:0/767328996 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa58032440 con 0x7ffa6c159030 2024-08-17T02:50:51.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.404+0000 7ffa6a000640 1 -- 172.21.15.5:0/767328996 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5802aea0 con 0x7ffa6c159030 2024-08-17T02:50:51.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.404+0000 7ffa71000640 1 -- 172.21.15.5:0/767328996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c159030 msgr2=0x7ffa6c0ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:51.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.404+0000 7ffa71000640 1 --2- 172.21.15.5:0/767328996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c159030 0x7ffa6c0ca8b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0889c0 tx=0x7ffa580091d0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.404+0000 7ffa71000640 1 -- 172.21.15.5:0/767328996 shutdown_connections 2024-08-17T02:50:51.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.404+0000 7ffa71000640 1 --2- 172.21.15.5:0/767328996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa6c0b1920 0x7ffa6c0b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.404+0000 7ffa71000640 1 --2- 172.21.15.5:0/767328996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c159030 0x7ffa6c0ca8b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.404+0000 7ffa71000640 1 --2- 172.21.15.5:0/767328996 >> v2:172.21.15.107:3300/0 conn(0x7ffa6c158c60 0x7ffa6c15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.404+0000 7ffa71000640 1 -- 172.21.15.5:0/767328996 >> 172.21.15.5:0/767328996 conn(0x7ffa6c06e590 msgr2=0x7ffa6c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:51.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.404+0000 7ffa71000640 1 -- 172.21.15.5:0/767328996 shutdown_connections 2024-08-17T02:50:51.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.405+0000 7ffa71000640 1 -- 172.21.15.5:0/767328996 wait complete. 2024-08-17T02:50:51.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.406+0000 7ffa71000640 1 Processor -- start 2024-08-17T02:50:51.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.406+0000 7ffa71000640 1 -- start start 2024-08-17T02:50:51.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.407+0000 7ffa71000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa6c0b1920 0x7ffa6c151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:51.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.407+0000 7ffa71000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c158c60 0x7ffa6c0c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:51.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.407+0000 7ffa71000640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa6c159030 0x7ffa6c0c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:51.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.407+0000 7ffa71000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c151840 con 0x7ffa6c158c60 2024-08-17T02:50:51.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.407+0000 7ffa71000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0c4480 con 0x7ffa6c0b1920 2024-08-17T02:50:51.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.407+0000 7ffa71000640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0ceff0 con 0x7ffa6c159030 2024-08-17T02:50:51.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.407+0000 7ffa6aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c158c60 0x7ffa6c0c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:51.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.407+0000 7ffa6aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c158c60 0x7ffa6c0c3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40484/0 (socket says 172.21.15.5:40484) 2024-08-17T02:50:51.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.407+0000 7ffa6b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa6c0b1920 0x7ffa6c151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:51.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.407+0000 7ffa6aa00640 1 -- 172.21.15.5:0/3696543625 learned_addr learned my addr 172.21.15.5:0/3696543625 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:51.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.407+0000 7ffa6be00640 1 --2- 172.21.15.5:0/3696543625 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa6c159030 0x7ffa6c0c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:51.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.408+0000 7ffa6aa00640 1 -- 172.21.15.5:0/3696543625 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa6c159030 msgr2=0x7ffa6c0c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.408+0000 7ffa6aa00640 1 --2- 172.21.15.5:0/3696543625 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa6c159030 0x7ffa6c0c4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.408+0000 7ffa6aa00640 1 -- 172.21.15.5:0/3696543625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa6c0b1920 msgr2=0x7ffa6c151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.408+0000 7ffa6aa00640 1 --2- 172.21.15.5:0/3696543625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa6c0b1920 0x7ffa6c151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.408+0000 7ffa6aa00640 1 -- 172.21.15.5:0/3696543625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa58009450 con 0x7ffa6c158c60 2024-08-17T02:50:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.408+0000 7ffa6aa00640 1 --2- 172.21.15.5:0/3696543625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c158c60 0x7ffa6c0c3f40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009210 tx=0x7ffa58032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.408+0000 7ffa62a00640 1 -- 172.21.15.5:0/3696543625 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa58032700 con 0x7ffa6c158c60 2024-08-17T02:50:51.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.408+0000 7ffa62a00640 1 -- 172.21.15.5:0/3696543625 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa58031a60 con 0x7ffa6c158c60 2024-08-17T02:50:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.408+0000 7ffa62a00640 1 -- 172.21.15.5:0/3696543625 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa58031e60 con 0x7ffa6c158c60 2024-08-17T02:50:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.408+0000 7ffa71000640 1 -- 172.21.15.5:0/3696543625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c0cf2d0 con 0x7ffa6c158c60 2024-08-17T02:50:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.409+0000 7ffa71000640 1 -- 172.21.15.5:0/3696543625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c0c3a20 con 0x7ffa6c158c60 2024-08-17T02:50:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.409+0000 7ffa71000640 1 -- 172.21.15.5:0/3696543625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c070720 con 0x7ffa6c158c60 2024-08-17T02:50:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.410+0000 7ffa62a00640 1 -- 172.21.15.5:0/3696543625 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffa58039040 con 0x7ffa6c158c60 2024-08-17T02:50:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.411+0000 7ffa62a00640 1 --2- 172.21.15.5:0/3696543625 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ffa4c065150 0x7ffa4c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.412+0000 7ffa62a00640 1 -- 172.21.15.5:0/3696543625 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ffa580a1cf0 con 0x7ffa6c158c60 2024-08-17T02:50:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.412+0000 7ffa6b400640 1 --2- 172.21.15.5:0/3696543625 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ffa4c065150 0x7ffa4c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:51.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.412+0000 7ffa6b400640 1 --2- 172.21.15.5:0/3696543625 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ffa4c065150 0x7ffa4c067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c007ba0 tx=0x7ffa5c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:51.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.416+0000 7ffa62a00640 1 -- 172.21.15.5:0/3696543625 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffa58070060 con 0x7ffa6c158c60 2024-08-17T02:50:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.594+0000 7ffa71000640 1 -- 172.21.15.5:0/3696543625 --> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa6c0afc20 con 0x7ffa4c065150 2024-08-17T02:50:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.596+0000 7ffa62a00640 1 -- 172.21.15.5:0/3696543625 <== mgr.4101 v2:172.21.15.5:6832/36929 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51024 (secure 0 0 0) 0x7ffa6c0afc20 con 0x7ffa4c065150 2024-08-17T02:50:51.598 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-17T02:50:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.598+0000 7ffa71000640 1 -- 172.21.15.5:0/3696543625 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ffa4c065150 msgr2=0x7ffa4c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.598+0000 7ffa71000640 1 --2- 172.21.15.5:0/3696543625 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ffa4c065150 0x7ffa4c067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c007ba0 tx=0x7ffa5c008040 comp rx=0 tx=0).stop 2024-08-17T02:50:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.598+0000 7ffa71000640 1 -- 172.21.15.5:0/3696543625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c158c60 msgr2=0x7ffa6c0c3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.598+0000 7ffa71000640 1 --2- 172.21.15.5:0/3696543625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c158c60 0x7ffa6c0c3f40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009210 tx=0x7ffa58032000 comp rx=0 tx=0).stop 2024-08-17T02:50:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.599+0000 7ffa71000640 1 -- 172.21.15.5:0/3696543625 shutdown_connections 2024-08-17T02:50:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.599+0000 7ffa71000640 1 --2- 172.21.15.5:0/3696543625 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7ffa4c065150 0x7ffa4c067600 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.599+0000 7ffa71000640 1 --2- 172.21.15.5:0/3696543625 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ffa6c159030 0x7ffa6c0c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.599+0000 7ffa71000640 1 --2- 172.21.15.5:0/3696543625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa6c158c60 0x7ffa6c0c3f40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.599+0000 7ffa71000640 1 --2- 172.21.15.5:0/3696543625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa6c0b1920 0x7ffa6c151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.599+0000 7ffa71000640 1 -- 172.21.15.5:0/3696543625 >> 172.21.15.5:0/3696543625 conn(0x7ffa6c06e590 msgr2=0x7ffa6c159430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.599+0000 7ffa71000640 1 -- 172.21.15.5:0/3696543625 shutdown_connections 2024-08-17T02:50:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.599+0000 7ffa71000640 1 -- 172.21.15.5:0/3696543625 wait complete. 2024-08-17T02:50:51.615 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-08-17T02:50:51.111544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400668,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574052,"statfs":{"total":773094113280,"available":770635829248,"internally_reserved":0,"allocated":5283840,"data_stored":2894840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002592"},"pg_stats":[{"pgid":"1.0","version":"43'119","reported_seq":197,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:50:35.088907+0000","last_change":"2024-08-17T02:50:35.088874+0000","last_active":"2024-08-17T02:50:35.088907+0000","last_peered":"2024-08-17T02:50:35.088907+0000","last_clean":"2024-08-17T02:50:35.088907+0000","last_became_active":"2024-08-17T02:46:48.423437+0000","last_became_peered":"2024-08-17T02:46:48.423437+0000","last_unstale":"2024-08-17T02:50:35.088907+0000","last_undegraded":"2024-08-17T02:50:35.088907+0000","last_fullsized":"2024-08-17T02:50:35.088907+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2024-08-17T02:50:35.088771+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2024-08-17T02:50:35.088771+0000","last_clean_scrub_stamp":"2024-08-17T02:50:35.088771+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:08:58.074167+0000","scrub_duration":0.005836964,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298432,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073408,"statfs":{"total":96636764160,"available":96331169792,"internally_reserved":0,"allocated":1105920,"data_stored":804631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.66800000000000004,"15min":0.63500000000000001},"min":{"1min":0.65900000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.69899999999999995,"15min":0.67000000000000004},"min":{"1min":0.70299999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90600000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.83599999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.64800000000000002,"15min":0.63600000000000001},"min":{"1min":0.63200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.63600000000000001,"15min":0.60599999999999998},"min":{"1min":0.60499999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92400000000000004,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.90400000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.69599999999999995,"15min":0.66800000000000004},"min":{"1min":0.70199999999999996,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95199999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.72899999999999998,"15min":0.72099999999999997},"min":{"1min":0.56699999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.88600000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.55400000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.875,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.70799999999999996,"15min":0.69399999999999995},"min":{"1min":0.63100000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.76800000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69399999999999995,"15min":0.70899999999999996},"min":{"1min":0.53200000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63100000000000001,"15min":0.64300000000000002},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89100000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.46100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.94699999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.84799999999999998,"5min":1.024,"15min":1.024},"last":0.996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65700000000000003,"15min":0.66900000000000004},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.70499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.56599999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.878,"5min":0.996,"15min":0.996},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.70599999999999996,"15min":0.69599999999999995},"min":{"1min":0.57099999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88700000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.63400000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.67800000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82999999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.74199999999999999,"15min":0.72799999999999998},"min":{"1min":0.65300000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.84599999999999997,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.72899999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72199999999999998,"15min":0.71599999999999997},"min":{"1min":0.67300000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90600000000000003,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.66800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.88100000000000001,"5min":1.458,"15min":1.458},"last":0.79100000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.63800000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92200000000000004,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69799999999999995,"15min":0.69199999999999995},"min":{"1min":0.53700000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.81299999999999994,"5min":1.099,"15min":1.099},"last":0.70899999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84999999999999998,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":1.55,"15min":1.55},"last":0.51200000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.65600000000000003},"min":{"1min":0.49199999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88300000000000001,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.69899999999999995,"15min":0.73399999999999999},"min":{"1min":0.46400000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.86199999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:49:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73099999999999998,"15min":0.77200000000000002},"min":{"1min":0.46600000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84099999999999997,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.499,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85299999999999998,"5min":1.077,"15min":1.077},"last":0.48599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.63500000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.877,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.75},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.66600000000000004,"15min":0.61499999999999999},"min":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.79000000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67600000000000005,"15min":0.63400000000000001},"min":{"1min":0.48499999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.996,"5min":1.095,"15min":1.095},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70499999999999996,"15min":0.66900000000000004},"min":{"1min":0.47499999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94699999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.88}]},{"osd":2,"last update":"Sat Aug 17 02:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72199999999999998,"15min":0.69399999999999995},"min":{"1min":0.47799999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0069999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.74299999999999999,"15min":0.72599999999999998},"min":{"1min":0.52400000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0309999999999999,"5min":1.25,"15min":1.25},"last":0.92000000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70399999999999996,"15min":0.66800000000000004},"min":{"1min":0.505,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70699999999999996,"15min":0.69699999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92600000000000005,"5min":1.087,"15min":1.087},"last":0.83599999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.622,"15min":0.64400000000000002},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80100000000000005,"5min":1.206,"15min":1.206},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.53500000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92600000000000005,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71799999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.65500000000000003},"min":{"1min":0.42599999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.82299999999999995,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.747,"15min":0.76700000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.86599999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.621}]},{"osd":7,"last update":"Sat Aug 17 02:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69499999999999995,"15min":0.71599999999999997},"min":{"1min":0.47699999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68300000000000005,"15min":0.70199999999999996},"min":{"1min":0.46700000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.879,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.52500000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92300000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67200000000000004,"15min":0.65400000000000003},"min":{"1min":0.55700000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89200000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56999999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67400000000000004,"15min":0.65200000000000002},"min":{"1min":0.59699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85899999999999999,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.57299999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85499999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55800000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69499999999999995,"15min":0.66900000000000004},"min":{"1min":0.63800000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.55700000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89700000000000002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.63900000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.67900000000000005,"15min":0.65900000000000003},"min":{"1min":0.55900000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93899999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.72399999999999998,"15min":0.71199999999999997},"min":{"1min":0.62,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91000000000000003,"5min":1.022,"15min":1.022},"last":0.79900000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79800000000000004,"5min":0.999,"15min":0.999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89200000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.62}]},{"osd":6,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.89100000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.47299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89300000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.51300000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94599999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72399999999999998},"min":{"1min":0.54200000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91600000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41699999999999998,"15min":0.40899999999999997},"min":{"1min":0.28799999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.63600000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.44},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.42999999999999999},"min":{"1min":0.312,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58099999999999996,"5min":0.879,"15min":0.879},"last":0.56799999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.434,"15min":0.42199999999999999},"min":{"1min":0.31900000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.498,"15min":0.495},"min":{"1min":0.35399999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.747,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.499}]},{"osd":2,"last update":"Sat Aug 17 02:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55200000000000005,"15min":0.53000000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78900000000000003,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61399999999999999,"15min":0.58599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84299999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.69999999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.745,"15min":0.75800000000000001},"min":{"1min":0.51600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0169999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.77300000000000002,"15min":0.79800000000000004},"min":{"1min":0.57199999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.995,"5min":1.196,"15min":1.196},"last":0.82999999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79200000000000004,"15min":0.82199999999999995},"min":{"1min":0.52700000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.004,"5min":1.704,"15min":1.704},"last":0.752},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78900000000000003,"15min":0.80600000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0880000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.77500000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77500000000000002,"15min":0.78700000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0609999999999999,"5min":1.21,"15min":1.21},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65300000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:50:50 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.57699999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.02,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.80700000000000005,"15min":0.82699999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1359999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.60499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47899999999999998,"15min":0.48699999999999999},"min":{"1min":0.309,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67600000000000005,"5min":1.417,"15min":1.417},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.498,"15min":0.5},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.60299999999999998,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.34100000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59899999999999998,"15min":0.621},"min":{"1min":0.40500000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73499999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.47699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.79500000000000004,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.53800000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.496},"min":{"1min":0.33500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.67600000000000005,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.48599999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.72999999999999998,"5min":1.343,"15min":1.343},"last":0.56499999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80200000000000005,"15min":0.79200000000000004},"min":{"1min":0.67400000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.03,"5min":1.466,"15min":1.466},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.61399999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.03,"5min":1.548,"15min":1.548},"last":0.71299999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.80100000000000005,"15min":0.79000000000000004},"min":{"1min":0.57699999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0680000000000001,"5min":1.617,"15min":1.617},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.77700000000000002},"min":{"1min":0.57999999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.93300000000000005,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.66400000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82299999999999995,"15min":0.81899999999999995},"min":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.079,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.66100000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0249999999999999,"5min":1.5,"15min":1.5},"last":0.68799999999999994}]},{"osd":7,"last update":"Sat Aug 17 02:49:54 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.83499999999999996,"15min":0.83899999999999997},"min":{"1min":0.59699999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.99299999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.117,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.61299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":214263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34499999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64000000000000001,"5min":1.093,"15min":1.093},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71599999999999997,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.54500000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65700000000000003,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.48599999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72599999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.45500000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.64400000000000002},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.754,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.39600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81599999999999995,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.58699999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85899999999999999,"15min":0.875},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2809999999999999,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.85499999999999998,"15min":0.872},"min":{"1min":0.67800000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1619999999999999,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.64800000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.874,"15min":0.90200000000000002},"min":{"1min":0.625,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3859999999999999,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.83199999999999996},"min":{"1min":0.65600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.24,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.82199999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.874,"15min":0.89400000000000002},"min":{"1min":0.61199999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.2130000000000001,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.89000000000000001,"15min":0.91600000000000004},"min":{"1min":0.63700000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.302,"5min":3.3820000000000001,"15min":3.3820000000000001},"last":0.68300000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:49:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86199999999999999,"15min":0.871},"min":{"1min":0.61399999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1200000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.875,"15min":0.88700000000000001},"min":{"1min":0.65100000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.272,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":0.89900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302592,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069248,"statfs":{"total":96636764160,"available":96326909952,"internally_reserved":0,"allocated":1105920,"data_stored":804631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48099999999999998,"15min":0.47699999999999998},"min":{"1min":0.33900000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.748,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.46100000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.74199999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47699999999999998,"15min":0.46700000000000003},"min":{"1min":0.38500000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.40999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.68700000000000006,"5min":1.702,"15min":1.702},"last":0.81499999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.47799999999999998,"15min":0.46700000000000003},"min":{"1min":0.35999999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.624,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.48499999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71899999999999997,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.60899999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.79600000000000004,"15min":0.77800000000000002},"min":{"1min":0.63300000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.141,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78200000000000003,"15min":0.77000000000000002},"min":{"1min":0.61699999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.88500000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.82299999999999995,"15min":0.81699999999999995},"min":{"1min":0.69499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.413,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.877},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79300000000000004,"15min":0.79100000000000004},"min":{"1min":0.63700000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1359999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.70899999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.82199999999999995,"15min":0.80800000000000005},"min":{"1min":0.65600000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.216,"5min":1.784,"15min":1.784},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.58499999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.288,"5min":1.538,"15min":1.538},"last":0.76100000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:49:52 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.67200000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83399999999999996,"15min":0.82399999999999995},"min":{"1min":0.73099999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3500000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.72999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:50:51.617 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:50:51.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.762+0000 7fb240c00640 1 Processor -- start 2024-08-17T02:50:51.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.762+0000 7fb240c00640 1 -- start start 2024-08-17T02:50:51.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.763+0000 7fb240c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb23c0ad960 0x7fb23c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:51.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.763+0000 7fb240c00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb23c0add30 0x7fb23c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:51.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.763+0000 7fb240c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23c15b5e0 con 0x7fb23c0ca050 2024-08-17T02:50:51.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.763+0000 7fb240c00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23c0cb160 con 0x7fb23c0add30 2024-08-17T02:50:51.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.763+0000 7fb240c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0b0d10 con 0x7fb23c0ad960 2024-08-17T02:50:51.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.763+0000 7fb233e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb23c0ca050 0x7fb23c156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37156/0 (socket says 172.21.15.5:37156) 2024-08-17T02:50:51.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.763+0000 7fb233e00640 1 -- 172.21.15.5:0/3841180874 learned_addr learned my addr 172.21.15.5:0/3841180874 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:51.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.763+0000 7fb239e00640 1 --2- 172.21.15.5:0/3841180874 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb23c0ad960 0x7fb23c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:51.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.763+0000 7fb23a800640 1 --2- 172.21.15.5:0/3841180874 >> v2:172.21.15.107:3300/0 conn(0x7fb23c0add30 0x7fb23c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:51.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.764+0000 7fb239400640 1 -- 172.21.15.5:0/3841180874 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558156492 0 0) 0x7fb224001110 con 0x7fb23c0ca050 2024-08-17T02:50:51.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.764+0000 7fb239400640 1 -- 172.21.15.5:0/3841180874 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2200034e0 con 0x7fb23c0ca050 2024-08-17T02:50:51.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.764+0000 7fb239e00640 1 -- 172.21.15.5:0/3841180874 >> v2:172.21.15.107:3300/0 conn(0x7fb23c0add30 msgr2=0x7fb23c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:51.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.764+0000 7fb239e00640 1 --2- 172.21.15.5:0/3841180874 >> v2:172.21.15.107:3300/0 conn(0x7fb23c0add30 0x7fb23c156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.764+0000 7fb239e00640 1 -- 172.21.15.5:0/3841180874 >> v1:172.21.15.5:6789/0 conn(0x7fb23c0ca050 legacy=0x7fb23c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:51.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.764+0000 7fb239e00640 1 -- 172.21.15.5:0/3841180874 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c0ca550 con 0x7fb23c0ad960 2024-08-17T02:50:51.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.764+0000 7fb23a800640 1 --2- 172.21.15.5:0/3841180874 >> v2:172.21.15.107:3300/0 conn(0x7fb23c0add30 0x7fb23c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:50:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.765+0000 7fb239e00640 1 --2- 172.21.15.5:0/3841180874 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb23c0ad960 0x7fb23c15b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009850 tx=0x7fb22c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b6333af2e212392 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.766+0000 7fb239400640 1 -- 172.21.15.5:0/3841180874 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c02ae20 con 0x7fb23c0ad960 2024-08-17T02:50:51.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.766+0000 7fb239400640 1 -- 172.21.15.5:0/3841180874 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c032440 con 0x7fb23c0ad960 2024-08-17T02:50:51.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.766+0000 7fb239400640 1 -- 172.21.15.5:0/3841180874 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c032820 con 0x7fb23c0ad960 2024-08-17T02:50:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.766+0000 7fb240c00640 1 -- 172.21.15.5:0/3841180874 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb23c0ad960 msgr2=0x7fb23c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.766+0000 7fb240c00640 1 --2- 172.21.15.5:0/3841180874 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb23c0ad960 0x7fb23c15b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009850 tx=0x7fb22c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.766+0000 7fb240c00640 1 -- 172.21.15.5:0/3841180874 shutdown_connections 2024-08-17T02:50:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.766+0000 7fb240c00640 1 --2- 172.21.15.5:0/3841180874 >> v2:172.21.15.107:3300/0 conn(0x7fb23c0add30 0x7fb23c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.766+0000 7fb240c00640 1 --2- 172.21.15.5:0/3841180874 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb23c0ad960 0x7fb23c15b0a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.766+0000 7fb240c00640 1 -- 172.21.15.5:0/3841180874 >> 172.21.15.5:0/3841180874 conn(0x7fb23c066e60 msgr2=0x7fb23c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.767+0000 7fb240c00640 1 -- 172.21.15.5:0/3841180874 shutdown_connections 2024-08-17T02:50:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.767+0000 7fb240c00640 1 -- 172.21.15.5:0/3841180874 wait complete. 2024-08-17T02:50:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.768+0000 7fb240c00640 1 Processor -- start 2024-08-17T02:50:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.768+0000 7fb240c00640 1 -- start start 2024-08-17T02:50:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.769+0000 7fb240c00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb23c0ad960 0x7fb23c166d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.769+0000 7fb240c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb23c0add30 0x7fb23c0a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.769+0000 7fb240c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23c0ca050 0x7fb23c151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.769+0000 7fb240c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0aa3f0 con 0x7fb23c0ca050 2024-08-17T02:50:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.769+0000 7fb240c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c157700 con 0x7fb23c0add30 2024-08-17T02:50:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.769+0000 7fb240c00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c1673e0 con 0x7fb23c0ad960 2024-08-17T02:50:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.769+0000 7fb23a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23c0ca050 0x7fb23c151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.769+0000 7fb23a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23c0ca050 0x7fb23c151cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40500/0 (socket says 172.21.15.5:40500) 2024-08-17T02:50:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.769+0000 7fb23a800640 1 -- 172.21.15.5:0/1377295865 learned_addr learned my addr 172.21.15.5:0/1377295865 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.769+0000 7fb233e00640 1 --2- 172.21.15.5:0/1377295865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb23c0add30 0x7fb23c0a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.769+0000 7fb239e00640 1 --2- 172.21.15.5:0/1377295865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb23c0ad960 0x7fb23c166d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.770+0000 7fb23a800640 1 -- 172.21.15.5:0/1377295865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb23c0ad960 msgr2=0x7fb23c166d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.770+0000 7fb23a800640 1 --2- 172.21.15.5:0/1377295865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb23c0ad960 0x7fb23c166d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.770+0000 7fb23a800640 1 -- 172.21.15.5:0/1377295865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb23c0add30 msgr2=0x7fb23c0a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.770+0000 7fb23a800640 1 --2- 172.21.15.5:0/1377295865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb23c0add30 0x7fb23c0a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.770+0000 7fb23a800640 1 -- 172.21.15.5:0/1377295865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb234009a20 con 0x7fb23c0ca050 2024-08-17T02:50:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.770+0000 7fb23a800640 1 --2- 172.21.15.5:0/1377295865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23c0ca050 0x7fb23c151cb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb234009fc0 tx=0x7fb23400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.770+0000 7fb231600640 1 -- 172.21.15.5:0/1377295865 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23400ce70 con 0x7fb23c0ca050 2024-08-17T02:50:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.770+0000 7fb231600640 1 -- 172.21.15.5:0/1377295865 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23400f040 con 0x7fb23c0ca050 2024-08-17T02:50:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.770+0000 7fb240c00640 1 -- 172.21.15.5:0/1377295865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22c009390 con 0x7fb23c0ca050 2024-08-17T02:50:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.770+0000 7fb231600640 1 -- 172.21.15.5:0/1377295865 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2340146d0 con 0x7fb23c0ca050 2024-08-17T02:50:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.770+0000 7fb240c00640 1 -- 172.21.15.5:0/1377295865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23c1679a0 con 0x7fb23c0ca050 2024-08-17T02:50:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.772+0000 7fb240c00640 1 -- 172.21.15.5:0/1377295865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23c1574c0 con 0x7fb23c0ca050 2024-08-17T02:50:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.772+0000 7fb231600640 1 -- 172.21.15.5:0/1377295865 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb234003020 con 0x7fb23c0ca050 2024-08-17T02:50:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.774+0000 7fb231600640 1 --2- 172.21.15.5:0/1377295865 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb218065150 0x7fb218067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.774+0000 7fb231600640 1 -- 172.21.15.5:0/1377295865 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb234082cb0 con 0x7fb23c0ca050 2024-08-17T02:50:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.774+0000 7fb239e00640 1 --2- 172.21.15.5:0/1377295865 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb218065150 0x7fb218067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:51.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.775+0000 7fb239e00640 1 --2- 172.21.15.5:0/1377295865 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb218065150 0x7fb218067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb22c034000 tx=0x7fb22c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:51.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.779+0000 7fb231600640 1 -- 172.21.15.5:0/1377295865 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb234051020 con 0x7fb23c0ca050 2024-08-17T02:50:51.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.962+0000 7fb240c00640 1 -- 172.21.15.5:0/1377295865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb23c063fb0 con 0x7fb23c0ca050 2024-08-17T02:50:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.966+0000 7fb231600640 1 -- 172.21.15.5:0/1377295865 <== mon.0 v2:172.21.15.5:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb234051020 con 0x7fb23c0ca050 2024-08-17T02:50:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.967+0000 7fb231600640 1 -- 172.21.15.5:0/1377295865 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb234054640 con 0x7fb23c0ca050 2024-08-17T02:50:51.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.970+0000 7fb240c00640 1 -- 172.21.15.5:0/1377295865 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb218065150 msgr2=0x7fb218067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:51.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.970+0000 7fb240c00640 1 --2- 172.21.15.5:0/1377295865 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb218065150 0x7fb218067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb22c034000 tx=0x7fb22c032000 comp rx=0 tx=0).stop 2024-08-17T02:50:51.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.970+0000 7fb240c00640 1 -- 172.21.15.5:0/1377295865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23c0ca050 msgr2=0x7fb23c151cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:51.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.970+0000 7fb240c00640 1 --2- 172.21.15.5:0/1377295865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23c0ca050 0x7fb23c151cb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb234009fc0 tx=0x7fb23400b040 comp rx=0 tx=0).stop 2024-08-17T02:50:51.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.970+0000 7fb240c00640 1 -- 172.21.15.5:0/1377295865 shutdown_connections 2024-08-17T02:50:51.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.970+0000 7fb240c00640 1 --2- 172.21.15.5:0/1377295865 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7fb218065150 0x7fb218067600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.970+0000 7fb240c00640 1 --2- 172.21.15.5:0/1377295865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23c0ca050 0x7fb23c151cb0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.970+0000 7fb240c00640 1 --2- 172.21.15.5:0/1377295865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb23c0add30 0x7fb23c0a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.970+0000 7fb240c00640 1 --2- 172.21.15.5:0/1377295865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb23c0ad960 0x7fb23c166d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:51.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.970+0000 7fb240c00640 1 -- 172.21.15.5:0/1377295865 >> 172.21.15.5:0/1377295865 conn(0x7fb23c066e60 msgr2=0x7fb23c15a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:51.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.970+0000 7fb240c00640 1 -- 172.21.15.5:0/1377295865 shutdown_connections 2024-08-17T02:50:51.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:51.970+0000 7fb240c00640 1 -- 172.21.15.5:0/1377295865 wait complete. 2024-08-17T02:50:51.988 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:50:51.988 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:50:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.139+0000 7f2f77e00640 1 Processor -- start 2024-08-17T02:50:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.140+0000 7f2f77e00640 1 -- start start 2024-08-17T02:50:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.141+0000 7f2f77e00640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2f78069840 0x7f2f780cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.141+0000 7f2f77e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7815c9d0 con 0x7f2f780cbe10 2024-08-17T02:50:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.141+0000 7f2f77e00640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7815a200 con 0x7f2f780cd550 2024-08-17T02:50:52.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.141+0000 7f2f77e00640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f780b0830 con 0x7f2f78069840 2024-08-17T02:50:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.141+0000 7f2f77400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2f780cbe10 0x7f2f780ca340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37168/0 (socket says 172.21.15.5:37168) 2024-08-17T02:50:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.141+0000 7f2f77400640 1 -- 172.21.15.5:0/1575309113 learned_addr learned my addr 172.21.15.5:0/1575309113 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-17T02:50:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.141+0000 7f2f76a00640 1 --2- 172.21.15.5:0/1575309113 >> v2:172.21.15.107:3300/0 conn(0x7f2f78069840 0x7f2f780cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f75600640 1 -- 172.21.15.5:0/1575309113 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192982351 0 0) 0x7f2f7815c9d0 con 0x7f2f780cbe10 2024-08-17T02:50:52.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f75600640 1 -- 172.21.15.5:0/1575309113 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f5c0034e0 con 0x7f2f780cbe10 2024-08-17T02:50:52.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f75600640 1 -- 172.21.15.5:0/1575309113 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 670862499 0 0) 0x7f2f5c0034e0 con 0x7f2f780cbe10 2024-08-17T02:50:52.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f75600640 1 -- 172.21.15.5:0/1575309113 >> v2:172.21.15.107:3300/0 conn(0x7f2f78069840 msgr2=0x7f2f780cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:52.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f75600640 1 --2- 172.21.15.5:0/1575309113 >> v2:172.21.15.107:3300/0 conn(0x7f2f78069840 0x7f2f780cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:52.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f75600640 1 -- 172.21.15.5:0/1575309113 >> v1:172.21.15.107:6789/0 conn(0x7f2f780cd550 legacy=0x7f2f7815ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:52.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f75600640 1 -- 172.21.15.5:0/1575309113 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f780b0b10 con 0x7f2f780cbe10 2024-08-17T02:50:52.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f75600640 1 -- 172.21.15.5:0/1575309113 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2191692446 0 0) 0x7f2f700017f0 con 0x7f2f780cbe10 2024-08-17T02:50:52.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f75600640 1 -- 172.21.15.5:0/1575309113 >> v1:172.21.15.5:6789/0 conn(0x7f2f780cbe10 legacy=0x7f2f780ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:52.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f75600640 1 --2- 172.21.15.5:0/1575309113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f5c003a40 0x7f2f5c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:52.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f75600640 1 --2- 172.21.15.5:0/1575309113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f5c004780 0x7f2f5c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:52.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f75600640 1 --2- 172.21.15.5:0/1575309113 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f5c005130 0x7f2f5c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:52.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f75600640 1 -- 172.21.15.5:0/1575309113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f780b0830 con 0x7f2f5c003a40 2024-08-17T02:50:52.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f75600640 1 -- 172.21.15.5:0/1575309113 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c00c020 con 0x7f2f5c004780 2024-08-17T02:50:52.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f75600640 1 -- 172.21.15.5:0/1575309113 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c00c1e0 con 0x7f2f5c005130 2024-08-17T02:50:52.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f76a00640 1 --2- 172.21.15.5:0/1575309113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f5c003a40 0x7f2f5c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:52.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f77400640 1 --2- 172.21.15.5:0/1575309113 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f5c005130 0x7f2f5c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:52.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.142+0000 7f2f76000640 1 --2- 172.21.15.5:0/1575309113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f5c004780 0x7f2f5c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:52.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.143+0000 7f2f76a00640 1 -- 172.21.15.5:0/1575309113 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f5c005130 msgr2=0x7f2f5c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:52.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.143+0000 7f2f76a00640 1 --2- 172.21.15.5:0/1575309113 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f5c005130 0x7f2f5c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:52.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.143+0000 7f2f76a00640 1 -- 172.21.15.5:0/1575309113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f5c004780 msgr2=0x7f2f5c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:52.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.143+0000 7f2f76a00640 1 --2- 172.21.15.5:0/1575309113 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f5c004780 0x7f2f5c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:52.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.143+0000 7f2f76a00640 1 -- 172.21.15.5:0/1575309113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c0034e0 con 0x7f2f5c003a40 2024-08-17T02:50:52.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.143+0000 7f2f77400640 1 -- 172.21.15.5:0/1575309113 reap_dead start 2024-08-17T02:50:52.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.144+0000 7f2f76a00640 1 --2- 172.21.15.5:0/1575309113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f5c003a40 0x7f2f5c003e10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009b70 tx=0x7f2f680090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150a53975dc30787 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:52.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.144+0000 7f2f75600640 1 -- 172.21.15.5:0/1575309113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68031400 con 0x7f2f5c003a40 2024-08-17T02:50:52.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.144+0000 7f2f75600640 1 -- 172.21.15.5:0/1575309113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2f6802d050 con 0x7f2f5c003a40 2024-08-17T02:50:52.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.144+0000 7f2f75600640 1 -- 172.21.15.5:0/1575309113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f680317b0 con 0x7f2f5c003a40 2024-08-17T02:50:52.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.145+0000 7f2f77e00640 1 -- 172.21.15.5:0/1575309113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f5c003a40 msgr2=0x7f2f5c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:52.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.145+0000 7f2f77e00640 1 --2- 172.21.15.5:0/1575309113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f5c003a40 0x7f2f5c003e10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009b70 tx=0x7f2f680090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:52.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.145+0000 7f2f77e00640 1 -- 172.21.15.5:0/1575309113 shutdown_connections 2024-08-17T02:50:52.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.145+0000 7f2f77e00640 1 --2- 172.21.15.5:0/1575309113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f5c003a40 0x7f2f5c003e10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:52.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.145+0000 7f2f77e00640 1 -- 172.21.15.5:0/1575309113 >> 172.21.15.5:0/1575309113 conn(0x7f2f78066e60 msgr2=0x7f2f78067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:52.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.145+0000 7f2f77e00640 1 -- 172.21.15.5:0/1575309113 shutdown_connections 2024-08-17T02:50:52.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.145+0000 7f2f77e00640 1 -- 172.21.15.5:0/1575309113 wait complete. 2024-08-17T02:50:52.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.146+0000 7f2f77e00640 1 Processor -- start 2024-08-17T02:50:52.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.146+0000 7f2f77e00640 1 -- start start 2024-08-17T02:50:52.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.147+0000 7f2f77e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f5c003a40 0x7f2f7816caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:52.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.147+0000 7f2f77e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7815a3f0 0x7f2f7814f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:52.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.147+0000 7f2f77e00640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f7806cb20 0x7f2f7806cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:52.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.147+0000 7f2f77e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7806d4d0 con 0x7f2f7815a3f0 2024-08-17T02:50:52.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.147+0000 7f2f77e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f781559e0 con 0x7f2f5c003a40 2024-08-17T02:50:52.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.147+0000 7f2f77e00640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7815a920 con 0x7f2f7806cb20 2024-08-17T02:50:52.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.147+0000 7f2f76000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7815a3f0 0x7f2f7814f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:52.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.147+0000 7f2f76000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7815a3f0 0x7f2f7814f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40526/0 (socket says 172.21.15.5:40526) 2024-08-17T02:50:52.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.147+0000 7f2f76000640 1 -- 172.21.15.5:0/1327834327 learned_addr learned my addr 172.21.15.5:0/1327834327 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-17T02:50:52.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.148+0000 7f2f76a00640 1 --2- 172.21.15.5:0/1327834327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f5c003a40 0x7f2f7816caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:52.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.148+0000 7f2f77400640 1 --2- 172.21.15.5:0/1327834327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f7806cb20 0x7f2f7806cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:52.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.148+0000 7f2f76000640 1 -- 172.21.15.5:0/1327834327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f7806cb20 msgr2=0x7f2f7806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:52.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.148+0000 7f2f76000640 1 --2- 172.21.15.5:0/1327834327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f7806cb20 0x7f2f7806cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:52.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.148+0000 7f2f76000640 1 -- 172.21.15.5:0/1327834327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f5c003a40 msgr2=0x7f2f7816caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:52.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.148+0000 7f2f76000640 1 --2- 172.21.15.5:0/1327834327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f5c003a40 0x7f2f7816caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:52.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.148+0000 7f2f76000640 1 -- 172.21.15.5:0/1327834327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7815c0a0 con 0x7f2f7815a3f0 2024-08-17T02:50:52.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.148+0000 7f2f76000640 1 --2- 172.21.15.5:0/1327834327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7815a3f0 0x7f2f7814f9b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2f64002a80 tx=0x7f2f64007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:52.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.148+0000 7f2f6e000640 1 -- 172.21.15.5:0/1327834327 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f640133f0 con 0x7f2f7815a3f0 2024-08-17T02:50:52.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.148+0000 7f2f6e000640 1 -- 172.21.15.5:0/1327834327 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2f64013550 con 0x7f2f7815a3f0 2024-08-17T02:50:52.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.148+0000 7f2f6e000640 1 -- 172.21.15.5:0/1327834327 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f64013930 con 0x7f2f7815a3f0 2024-08-17T02:50:52.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.148+0000 7f2f77e00640 1 -- 172.21.15.5:0/1327834327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7816d030 con 0x7f2f7815a3f0 2024-08-17T02:50:52.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.149+0000 7f2f77e00640 1 -- 172.21.15.5:0/1327834327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f780cabd0 con 0x7f2f7815a3f0 2024-08-17T02:50:52.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.149+0000 7f2f77e00640 1 -- 172.21.15.5:0/1327834327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7815be70 con 0x7f2f7815a3f0 2024-08-17T02:50:52.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.150+0000 7f2f6e000640 1 -- 172.21.15.5:0/1327834327 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2f64013ce0 con 0x7f2f7815a3f0 2024-08-17T02:50:52.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.151+0000 7f2f6e000640 1 --2- 172.21.15.5:0/1327834327 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2f58065180 0x7f2f58067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:52.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.151+0000 7f2f6e000640 1 -- 172.21.15.5:0/1327834327 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2f64081e90 con 0x7f2f7815a3f0 2024-08-17T02:50:52.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.151+0000 7f2f76a00640 1 --2- 172.21.15.5:0/1327834327 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2f58065180 0x7f2f58067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:52.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.152+0000 7f2f76a00640 1 --2- 172.21.15.5:0/1327834327 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2f58065180 0x7f2f58067630 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2f68034000 tx=0x7f2f680090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:52.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.155+0000 7f2f6e000640 1 -- 172.21.15.5:0/1327834327 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2f7815be70 con 0x7f2f7815a3f0 2024-08-17T02:50:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.376+0000 7f2f77e00640 1 -- 172.21.15.5:0/1327834327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f7815be70 con 0x7f2f7815a3f0 2024-08-17T02:50:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.377+0000 7f2f6e000640 1 -- 172.21.15.5:0/1327834327 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f2f7815be70 con 0x7f2f7815a3f0 2024-08-17T02:50:52.378 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-17T02:50:52.379 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4682,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/2464391944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6833","nonce":2464391944},{"type":"v1","addr":"172.21.15.107:6835","nonce":2464391944}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6834/2049823505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":2049823505},{"type":"v1","addr":"172.21.15.107:6834","nonce":2049823505}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/4240118786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4240118786},{"type":"v1","addr":"172.21.15.5:6836","nonce":4240118786}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3535875438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":3535875438},{"type":"v1","addr":"172.21.15.5:6837","nonce":3535875438}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[]} 2024-08-17T02:50:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 23 2024-08-17T02:50:52.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.379+0000 7f2f77e00640 1 -- 172.21.15.5:0/1327834327 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2f58065180 msgr2=0x7f2f58067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:52.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.379+0000 7f2f77e00640 1 --2- 172.21.15.5:0/1327834327 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2f58065180 0x7f2f58067630 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2f68034000 tx=0x7f2f680090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.379+0000 7f2f77e00640 1 -- 172.21.15.5:0/1327834327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7815a3f0 msgr2=0x7f2f7814f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.379+0000 7f2f77e00640 1 --2- 172.21.15.5:0/1327834327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7815a3f0 0x7f2f7814f9b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2f64002a80 tx=0x7f2f64007ca0 comp rx=0 tx=0).stop 2024-08-17T02:50:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.379+0000 7f2f77e00640 1 -- 172.21.15.5:0/1327834327 shutdown_connections 2024-08-17T02:50:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.379+0000 7f2f77e00640 1 --2- 172.21.15.5:0/1327834327 >> [v2:172.21.15.5:6832/36929,v1:172.21.15.5:6833/36929] conn(0x7f2f58065180 0x7f2f58067630 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.379+0000 7f2f77e00640 1 --2- 172.21.15.5:0/1327834327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2f7806cb20 0x7f2f7806cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.379+0000 7f2f77e00640 1 --2- 172.21.15.5:0/1327834327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7815a3f0 0x7f2f7814f9b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.379+0000 7f2f77e00640 1 --2- 172.21.15.5:0/1327834327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f5c003a40 0x7f2f7816caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:52.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.379+0000 7f2f77e00640 1 -- 172.21.15.5:0/1327834327 >> 172.21.15.5:0/1327834327 conn(0x7f2f78066e60 msgr2=0x7f2f780cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:52.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.379+0000 7f2f77e00640 1 -- 172.21.15.5:0/1327834327 shutdown_connections 2024-08-17T02:50:52.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-17T02:50:52.379+0000 7f2f77e00640 1 -- 172.21.15.5:0/1327834327 wait complete. 2024-08-17T02:50:52.396 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:50:52.396 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:50:52.396 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:50:52.396 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:52.409 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:50:52.410 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:50:52.410 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:52.464 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:50:52.464 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:50:52.464 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:52.480 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:50:52.481 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:50:52.481 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:52.538 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:50:52.538 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:50:52.538 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:50:52.538 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:52.585 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:50:52.585 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:50:52.585 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:52.623 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:50:52.624 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:50:52.624 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:52.707 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:50:52.707 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:50:52.707 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:52.752 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:50:52.753 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:50:52.753 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:52.801 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:50:52.801 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:50:52.801 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:52.853 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:50:52.854 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:50:52.854 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:52.909 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:50:52.909 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:50:52.909 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:52.950 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:50:52.950 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:50:52.951 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:50:52.951 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:53.013 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:50:53.014 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:50:53.014 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:53.070 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:50:53.070 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:50:53.071 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:50:53.071 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:53.090 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:50:53.091 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:50:53.091 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:53.111 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:50:53.111 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:50:53.111 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:53.170 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:50:53.171 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:50:53.171 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:50:53.249 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:50:53.249 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:50:53.445 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:50:53.445 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:50:53.540 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:50:53.540 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:50:53.648 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:50:53.648 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:50:53.749 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:50:53.749 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:50:53.969 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:50:53.970 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:50:54.080 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:50:54.080 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:50:54.181 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:50:54.181 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:50:54.281 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:50:54.282 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858299/data/mon.a.tgz 2024-08-17T02:50:54.282 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-08-17T02:50:54.319 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.QOqkphnTnS 2024-08-17T02:50:54.320 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.QOqkphnTnS 2024-08-17T02:50:54.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.QOqkphnTnS 2024-08-17T02:50:54.591 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.QOqkphnTnS is 308KB 2024-08-17T02:50:54.680 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.QOqkphnTnS 2024-08-17T02:50:54.715 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858299/data/mon.b.tgz 2024-08-17T02:50:54.715 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-08-17T02:50:54.752 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.by2OOgB3bw 2024-08-17T02:50:54.753 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.by2OOgB3bw 2024-08-17T02:50:54.943 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.by2OOgB3bw 2024-08-17T02:50:55.036 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.by2OOgB3bw is 407KB 2024-08-17T02:50:55.125 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.by2OOgB3bw 2024-08-17T02:50:55.160 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858299/data/mon.c.tgz 2024-08-17T02:50:55.161 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-08-17T02:50:55.234 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.XPtWxnx8Hl 2024-08-17T02:50:55.235 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.XPtWxnx8Hl 2024-08-17T02:50:55.411 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.XPtWxnx8Hl 2024-08-17T02:50:55.505 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.XPtWxnx8Hl is 407KB 2024-08-17T02:50:55.594 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.XPtWxnx8Hl 2024-08-17T02:50:55.629 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:50:55.629 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:50:55.633 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:50:55.725 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:50:55.725 DEBUG:teuthology.orchestra.run.smithi005:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:50:55.729 DEBUG:teuthology.orchestra.run.smithi107:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:50:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:50:55.791 INFO:teuthology.orchestra.run.smithi107.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:50:55.801 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:50:55.803 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858299/remote/smithi005/crash 2024-08-17T02:50:55.803 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:50:55.859 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858299/remote/smithi107/crash 2024-08-17T02:50:55.860 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:50:55.914 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:50:55.914 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:55.919 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:56.003 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:56.059 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:56.114 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:50:56.114 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:50:56.119 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:50:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45543.log 2024-08-17T02:50:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47612.log 2024-08-17T02:50:56.170 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44593.log 2024-08-17T02:50:56.170 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45543.log.gz 2024-08-17T02:50:56.171 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48657.log 2024-08-17T02:50:56.171 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47612.log.gz 2024-08-17T02:50:56.172 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36969.log 2024-08-17T02:50:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41386.log 2024-08-17T02:50:56.173 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44593.log.gz 2024-08-17T02:50:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49306.log 2024-08-17T02:50:56.173 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48657.log.gz 2024-08-17T02:50:56.186 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:50:56.187 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36969.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36969.log.gz 2024-08-17T02:50:56.187 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36929.log 2024-08-17T02:50:56.187 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36889.log 2024-08-17T02:50:56.187 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36929.log: 91.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:50:56.187 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43360.log 2024-08-17T02:50:56.187 INFO:teuthology.orchestra.run.smithi107.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36929.log.gz 2024-08-17T02:50:56.187 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36889.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:50:56.187 INFO:teuthology.orchestra.run.smithi107.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36889.log.gz 2024-08-17T02:50:56.188 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.1.43360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43360.log.gz 2024-08-17T02:50:56.188 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42935.log 2024-08-17T02:50:56.188 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42613.log 2024-08-17T02:50:56.188 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.3.42935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42935.log.gz 2024-08-17T02:50:56.188 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:50:56.188 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.1.42613.log: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:50:56.188 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42613.log.gz 2024-08-17T02:50:56.188 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:50:56.189 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:50:56.189 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36718.log 2024-08-17T02:50:56.189 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:50:56.189 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36718.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36718.log.gz 2024-08-17T02:50:56.189 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37009.log 2024-08-17T02:50:56.189 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36758.log 2024-08-17T02:50:56.189 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.37009.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37009.log.gz 2024-08-17T02:50:56.189 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:50:56.190 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36758.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:50:56.190 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48176.log 2024-08-17T02:50:56.190 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41386.log.gz 2024-08-17T02:50:56.190 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45757.log 2024-08-17T02:50:56.190 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49306.log.gz 2024-08-17T02:50:56.190 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45325.log 2024-08-17T02:50:56.190 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48176.log.gz 2024-08-17T02:50:56.190 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44779.log 2024-08-17T02:50:56.191 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45757.log.gz 2024-08-17T02:50:56.191 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48909.log 2024-08-17T02:50:56.191 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45325.log.gz 2024-08-17T02:50:56.191 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44779.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44779.log.gz 2024-08-17T02:50:56.191 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49348.log 2024-08-17T02:50:56.191 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46949.log 2024-08-17T02:50:56.191 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48909.log.gz 2024-08-17T02:50:56.191 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48867.log 2024-08-17T02:50:56.192 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49348.log.gz 2024-08-17T02:50:56.192 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45501.log 2024-08-17T02:50:56.192 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46949.log.gz 2024-08-17T02:50:56.192 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49590.log 2024-08-17T02:50:56.192 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48867.log.gz 2024-08-17T02:50:56.192 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45199.log 2024-08-17T02:50:56.192 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45501.log.gz 2024-08-17T02:50:56.192 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48512.log 2024-08-17T02:50:56.192 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49590.log.gz 2024-08-17T02:50:56.193 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46991.log 2024-08-17T02:50:56.193 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45199.log.gz 2024-08-17T02:50:56.193 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46907.log 2024-08-17T02:50:56.193 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48512.log.gz 2024-08-17T02:50:56.193 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41870.log 2024-08-17T02:50:56.193 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46991.log.gz 2024-08-17T02:50:56.193 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49506.log 2024-08-17T02:50:56.194 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46907.log.gz 2024-08-17T02:50:56.197 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36758.log.gz 2024-08-17T02:50:56.197 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36798.log 2024-08-17T02:50:56.198 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:50:56.198 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36798.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36798.log.gz 2024-08-17T02:50:56.198 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.6.log: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:50:56.198 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:50:56.198 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:50:56.198 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:50:56.201 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36840.log 2024-08-17T02:50:56.201 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36840.log: 90.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:50:56.201 INFO:teuthology.orchestra.run.smithi107.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36840.log.gz 2024-08-17T02:50:56.205 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42333.log 2024-08-17T02:50:56.205 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41870.log.gz 2024-08-17T02:50:56.205 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46059.log 2024-08-17T02:50:56.205 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49506.log.gz 2024-08-17T02:50:56.205 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42333.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:50:56.206 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42333.log.gz 2024-08-17T02:50:56.206 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45073.log 2024-08-17T02:50:56.206 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46059.log.gz 2024-08-17T02:50:56.206 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45367.log 2024-08-17T02:50:56.206 INFO:teuthology.orchestra.run.smithi005.stderr: 84.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:50:56.206 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49758.log 2024-08-17T02:50:56.206 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45073.log.gz 2024-08-17T02:50:56.207 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41302.log 2024-08-17T02:50:56.207 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45367.log.gz 2024-08-17T02:50:56.207 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45975.log 2024-08-17T02:50:56.207 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49758.log.gz 2024-08-17T02:50:56.207 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42342.log 2024-08-17T02:50:56.207 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41302.log.gz 2024-08-17T02:50:56.207 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47033.log 2024-08-17T02:50:56.207 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45975.log.gz 2024-08-17T02:50:56.207 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48554.log 2024-08-17T02:50:56.208 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42342.log.gz 2024-08-17T02:50:56.208 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47472.log 2024-08-17T02:50:56.208 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47033.log.gz 2024-08-17T02:50:56.208 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48050.log 2024-08-17T02:50:56.208 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48554.log.gz 2024-08-17T02:50:56.208 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.47472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47472.log.gz 2024-08-17T02:50:56.208 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:50:56.208 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48470.log 2024-08-17T02:50:56.209 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48050.log.gz 2024-08-17T02:50:56.209 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46431.log 2024-08-17T02:50:56.209 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42878.log 2024-08-17T02:50:56.209 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48470.log.gz 2024-08-17T02:50:56.209 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48302.log 2024-08-17T02:50:56.209 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46431.log.gz 2024-08-17T02:50:56.209 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42920.log 2024-08-17T02:50:56.209 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42878.log.gz 2024-08-17T02:50:56.210 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48302.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48302.log.gz 2024-08-17T02:50:56.210 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41576.log 2024-08-17T02:50:56.210 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48951.log 2024-08-17T02:50:56.210 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42920.log.gz 2024-08-17T02:50:56.210 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44863.log 2024-08-17T02:50:56.210 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41576.log.gz 2024-08-17T02:50:56.213 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41786.log 2024-08-17T02:50:56.213 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48951.log.gz 2024-08-17T02:50:56.214 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49842.log 2024-08-17T02:50:56.214 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44863.log.gz 2024-08-17T02:50:56.214 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41786.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:50:56.214 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41786.log.gz 2024-08-17T02:50:56.214 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48218.log 2024-08-17T02:50:56.214 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49842.log.gz 2024-08-17T02:50:56.214 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45669.log 2024-08-17T02:50:56.215 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44653.log 88.1% 2024-08-17T02:50:56.215 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:50:56.215 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48218.log.gz 2024-08-17T02:50:56.215 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49884.log 2024-08-17T02:50:56.215 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45669.log.gz 2024-08-17T02:50:56.215 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43424.log 2024-08-17T02:50:56.215 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44653.log.gz 2024-08-17T02:50:56.215 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44425.log 2024-08-17T02:50:56.216 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49884.log.gz 2024-08-17T02:50:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43466.log 2024-08-17T02:50:56.218 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43424.log.gz 2024-08-17T02:50:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44425.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44425.log.gz 2024-08-17T02:50:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50322.log 2024-08-17T02:50:56.218 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42346.log 2024-08-17T02:50:56.218 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43466.log.gz 2024-08-17T02:50:56.219 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50448.log 2024-08-17T02:50:56.219 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50322.log.gz 2024-08-17T02:50:56.219 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49716.log 2024-08-17T02:50:56.219 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42346.log.gz 2024-08-17T02:50:56.220 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50448.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:50:56.220 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50448.log.gz 2024-08-17T02:50:56.220 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46863.log 2024-08-17T02:50:56.220 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49716.log.gz 2024-08-17T02:50:56.221 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43340.log 2024-08-17T02:50:56.221 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47837.log 2024-08-17T02:50:56.222 INFO:teuthology.orchestra.run.smithi005.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46863.log.gz 2024-08-17T02:50:56.222 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46303.log 2024-08-17T02:50:56.223 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43340.log.gz 2024-08-17T02:50:56.223 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47568.log 2024-08-17T02:50:56.223 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47837.log.gz 2024-08-17T02:50:56.224 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49119.log 2024-08-17T02:50:56.224 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46303.log.gz 2024-08-17T02:50:56.225 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44905.log 2024-08-17T02:50:56.225 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47568.log.gz 2024-08-17T02:50:56.226 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49119.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:50:56.226 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49119.log.gz 2024-08-17T02:50:56.227 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47655.log 2024-08-17T02:50:56.227 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44905.log.gz 2024-08-17T02:50:56.228 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48260.log 2024-08-17T02:50:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47655.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47655.log.gz 2024-08-17T02:50:56.229 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44039.log 2024-08-17T02:50:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49674.log 2024-08-17T02:50:56.231 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48260.log.gz 2024-08-17T02:50:56.231 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42038.log 2024-08-17T02:50:56.231 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44039.log.gz 2024-08-17T02:50:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49674.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49674.log.gz 2024-08-17T02:50:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44339.log 2024-08-17T02:50:56.233 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42336.log 2024-08-17T02:50:56.234 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42038.log.gz 2024-08-17T02:50:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.2.44339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44339.log.gz 2024-08-17T02:50:56.235 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44947.log 2024-08-17T02:50:56.236 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42336.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42336.log.gz 2024-08-17T02:50:56.236 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46389.log 2024-08-17T02:50:56.237 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44947.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:50:56.238 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44947.log.gz 2024-08-17T02:50:56.238 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46389.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46389.log.gz 2024-08-17T02:50:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44737.log 2024-08-17T02:50:56.240 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41912.log 2024-08-17T02:50:56.242 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44737.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:50:56.242 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44737.log.gz 2024-08-17T02:50:56.242 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42164.log 2024-08-17T02:50:56.243 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41912.log.gz 2024-08-17T02:50:56.244 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48134.log 2024-08-17T02:50:56.244 INFO:teuthology.orchestra.run.smithi005.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:50:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47751.log 2024-08-17T02:50:56.245 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42164.log.gz 2024-08-17T02:50:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47075.log 2024-08-17T02:50:56.246 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48134.log.gz 2024-08-17T02:50:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47751.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47751.log.gz 2024-08-17T02:50:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42962.log 2024-08-17T02:50:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41702.log 2024-08-17T02:50:56.249 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47075.log.gz 2024-08-17T02:50:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42962.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.42962.log.gz --verbose 2024-08-17T02:50:56.250 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:50:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42080.log 2024-08-17T02:50:56.251 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41702.log.gz 2024-08-17T02:50:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47201.log 2024-08-17T02:50:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46729.log 2024-08-17T02:50:56.253 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42080.log.gz 2024-08-17T02:50:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40948.log 2024-08-17T02:50:56.255 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.47201.log.gz 2024-08-17T02:50:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46729.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46729.log.gz 2024-08-17T02:50:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49222.log 2024-08-17T02:50:56.257 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40948.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40948.log.gz 2024-08-17T02:50:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41344.log 2024-08-17T02:50:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49222.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30861.log 2024-08-17T02:50:56.259 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49222.log.gz 2024-08-17T02:50:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46557.log 2024-08-17T02:50:56.261 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41344.log.gz 2024-08-17T02:50:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.tmp-client.admin.30861.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30861.log.gz 2024-08-17T02:50:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46557.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46557.log.gz 2024-08-17T02:50:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44551.log 2024-08-17T02:50:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42676.log 2024-08-17T02:50:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43256.log 2024-08-17T02:50:56.266 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44551.log.gz 2024-08-17T02:50:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42676.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42676.log.gz 2024-08-17T02:50:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43256.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43256.log.gz 2024-08-17T02:50:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45283.log 2024-08-17T02:50:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42670.log 2024-08-17T02:50:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45848.log 2024-08-17T02:50:56.272 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45283.log.gz 2024-08-17T02:50:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42670.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42670.log.gz 2024-08-17T02:50:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45848.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45848.log.gz 2024-08-17T02:50:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44695.log 2024-08-17T02:50:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43130.log 2024-08-17T02:50:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46685.log 2024-08-17T02:50:56.278 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44695.log.gz 2024-08-17T02:50:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43130.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43130.log.gz 2024-08-17T02:50:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46685.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46685.log.gz 2024-08-17T02:50:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42682.log 2024-08-17T02:50:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:50:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43508.log 2024-08-17T02:50:56.283 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42682.log.gz 2024-08-17T02:50:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.43508.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.43508.log.gz 2024-08-17T02:50:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48699.log 2024-08-17T02:50:56.288 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48092.log 2024-08-17T02:50:56.289 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48699.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48699.log.gz 2024-08-17T02:50:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41136.log 2024-08-17T02:50:56.291 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48092.log.gz 2024-08-17T02:50:56.292 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50112.log 2024-08-17T02:50:56.293 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41136.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41136.log.gz 2024-08-17T02:50:56.295 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47517.log 2024-08-17T02:50:56.295 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50112.log.gz 2024-08-17T02:50:56.296 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45031.log 2024-08-17T02:50:56.298 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47517.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47517.log.gz 2024-08-17T02:50:56.300 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.45031.log: /var/log/ceph/ceph-client.admin.41516.log 2024-08-17T02:50:56.300 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45031.log.gz 2024-08-17T02:50:56.300 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49035.log 2024-08-17T02:50:56.301 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41516.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41516.log.gz 2024-08-17T02:50:56.302 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45712.log 2024-08-17T02:50:56.303 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49035.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49035.log.gz 2024-08-17T02:50:56.305 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45712.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45712.log.gz 2024-08-17T02:50:56.305 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49632.log 2024-08-17T02:50:56.307 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42339.log 2024-08-17T02:50:56.308 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49632.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49632.log.gz 2024-08-17T02:50:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42339.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42339.log.gz 2024-08-17T02:50:56.310 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42681.log 2024-08-17T02:50:56.310 INFO:teuthology.orchestra.run.smithi005.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:50:56.311 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46347.log 2024-08-17T02:50:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46779.log 2024-08-17T02:50:56.313 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42681.log.gz 2024-08-17T02:50:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46347.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48428.log 2024-08-17T02:50:56.314 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46347.log.gz 2024-08-17T02:50:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49968.log 2024-08-17T02:50:56.315 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46779.log.gz 2024-08-17T02:50:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48428.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48428.log.gz 2024-08-17T02:50:56.318 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49968.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49968.log.gz 2024-08-17T02:50:56.318 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42122.log 2024-08-17T02:50:56.319 INFO:teuthology.orchestra.run.smithi107.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:50:56.319 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45157.log 2024-08-17T02:50:56.321 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44383.log 2024-08-17T02:50:56.321 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42122.log.gz 2024-08-17T02:50:56.322 INFO:teuthology.orchestra.run.smithi107.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:50:56.322 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43172.log 2024-08-17T02:50:56.322 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45157.log.gz 2024-08-17T02:50:56.323 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50530.log 2024-08-17T02:50:56.323 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44383.log.gz 2024-08-17T02:50:56.325 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43172.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43172.log.gz 2024-08-17T02:50:56.326 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.50530.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41996.log 2024-08-17T02:50:56.326 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50530.log.gz 2024-08-17T02:50:56.327 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46821.log 2024-08-17T02:50:56.328 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48344.log 2024-08-17T02:50:56.329 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41996.log.gz 2024-08-17T02:50:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46821.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46821.log.gz 2024-08-17T02:50:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43004.log 2024-08-17T02:50:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48344.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48344.log.gz 2024-08-17T02:50:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46599.log 2024-08-17T02:50:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42334.log 2024-08-17T02:50:56.333 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43004.log.gz 2024-08-17T02:50:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45241.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46599.log.gz 2024-08-17T02:50:56.334 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-17T02:50:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42334.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48825.log 2024-08-17T02:50:56.336 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42334.log.gz 2024-08-17T02:50:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46139.log 2024-08-17T02:50:56.337 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45241.log.gz 2024-08-17T02:50:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48825.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48825.log.gz 2024-08-17T02:50:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47697.log 2024-08-17T02:50:56.339 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46139.log.gz 2024-08-17T02:50:56.340 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47795.log 2024-08-17T02:50:56.341 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48614.log 2024-08-17T02:50:56.341 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47697.log.gz 2024-08-17T02:50:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47795.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47795.log.gz 2024-08-17T02:50:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49800.log 2024-08-17T02:50:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48614.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48614.log.gz 2024-08-17T02:50:56.344 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46641.log 2024-08-17T02:50:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47159.log 2024-08-17T02:50:56.346 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49800.log.gz 2024-08-17T02:50:56.347 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46641.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46641.log.gz 2024-08-17T02:50:56.348 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41744.log 2024-08-17T02:50:56.348 INFO:teuthology.orchestra.run.smithi107.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:50:56.349 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47159.log.gz 2024-08-17T02:50:56.349 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44821.log 2024-08-17T02:50:56.350 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50280.log 2024-08-17T02:50:56.350 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41744.log.gz 2024-08-17T02:50:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44821.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44821.log.gz 2024-08-17T02:50:56.352 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46219.log 2024-08-17T02:50:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50280.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50280.log.gz 2024-08-17T02:50:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42345.log 2024-08-17T02:50:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46515.log 2024-08-17T02:50:56.355 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46219.log.gz 2024-08-17T02:50:56.356 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42345.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42345.log.gz 2024-08-17T02:50:56.357 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46515.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46515.log.gz 2024-08-17T02:50:56.358 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50154.log 2024-08-17T02:50:56.359 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50238.log 2024-08-17T02:50:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45804.log 2024-08-17T02:50:56.360 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50154.log.gz 2024-08-17T02:50:56.362 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41428.log 2024-08-17T02:50:56.362 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50238.log.gz 2024-08-17T02:50:56.362 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45804.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45804.log.gz 2024-08-17T02:50:56.363 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50010.log 2024-08-17T02:50:56.364 INFO:teuthology.orchestra.run.smithi005.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:50:56.364 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46017.log 2024-08-17T02:50:56.365 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41428.log.gz 2024-08-17T02:50:56.365 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47267.log 2024-08-17T02:50:56.366 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50010.log.gz 2024-08-17T02:50:56.367 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49548.log 2024-08-17T02:50:56.367 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46017.log.gz 2024-08-17T02:50:56.368 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50364.log 2024-08-17T02:50:56.368 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47267.log.gz 2024-08-17T02:50:56.369 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41472.log 2024-08-17T02:50:56.369 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49548.log.gz 2024-08-17T02:50:56.370 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37311.log 2024-08-17T02:50:56.371 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50364.log.gz 2024-08-17T02:50:56.372 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41217.log 2024-08-17T02:50:56.372 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41472.log.gz 2024-08-17T02:50:56.372 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43976.log 2024-08-17T02:50:56.373 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37311.log.gz 2024-08-17T02:50:56.374 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45891.log 2024-08-17T02:50:56.374 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41217.log.gz 2024-08-17T02:50:56.375 INFO:teuthology.orchestra.run.smithi107.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:50:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.43976.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.0.43976.log.gz /var/log/ceph/ceph-client.admin.49264.log 2024-08-17T02:50:56.376 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-17T02:50:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37193.log 2024-08-17T02:50:56.377 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45891.log.gz 2024-08-17T02:50:56.377 INFO:teuthology.orchestra.run.smithi107.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:50:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41259.log 2024-08-17T02:50:56.378 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49264.log.gz 2024-08-17T02:50:56.382 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36927.log 2024-08-17T02:50:56.383 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37193.log.gz 2024-08-17T02:50:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49926.log 2024-08-17T02:50:56.383 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41259.log.gz 2024-08-17T02:50:56.383 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44467.log 2024-08-17T02:50:56.383 INFO:teuthology.orchestra.run.smithi005.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.36927.log.gz 2024-08-17T02:50:56.384 INFO:teuthology.orchestra.run.smithi107.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:50:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45627.log 2024-08-17T02:50:56.384 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49926.log.gz 2024-08-17T02:50:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48741.log 2024-08-17T02:50:56.385 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44467.log.gz 2024-08-17T02:50:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43646.log 2024-08-17T02:50:56.386 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45627.log.gz 2024-08-17T02:50:56.386 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-08-17T02:50:56.387 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m0.234s 2024-08-17T02:50:56.387 INFO:teuthology.orchestra.run.smithi107.stderr:user 0m0.964s 2024-08-17T02:50:56.387 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m0.161s 2024-08-17T02:50:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48993.log 2024-08-17T02:50:56.388 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48741.log.gz 2024-08-17T02:50:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42343.log 2024-08-17T02:50:56.388 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43646.log.gz 2024-08-17T02:50:56.389 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49179.log 2024-08-17T02:50:56.389 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48993.log.gz 2024-08-17T02:50:56.390 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47879.log 2024-08-17T02:50:56.391 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42343.log.gz 2024-08-17T02:50:56.391 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49179.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:50:56.392 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49179.log.gz 2024-08-17T02:50:56.393 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44989.log 2024-08-17T02:50:56.393 INFO:teuthology.orchestra.run.smithi005.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47879.log.gz 2024-08-17T02:50:56.394 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50070.log 2024-08-17T02:50:56.395 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42678.log 2024-08-17T02:50:56.396 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44989.log.gz 2024-08-17T02:50:56.397 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41828.log 2024-08-17T02:50:56.397 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50070.log.gz 2024-08-17T02:50:56.398 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42678.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42678.log.gz 2024-08-17T02:50:56.399 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45115.log 2024-08-17T02:50:56.399 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41828.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41828.log.gz 2024-08-17T02:50:56.400 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46473.log 2024-08-17T02:50:56.401 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47117.log 2024-08-17T02:50:56.402 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45115.log.gz 2024-08-17T02:50:56.403 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45933.log 2024-08-17T02:50:56.403 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46473.log.gz 2024-08-17T02:50:56.404 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43214.log 2024-08-17T02:50:56.404 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47117.log.gz 2024-08-17T02:50:56.405 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42673.log 2024-08-17T02:50:56.405 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45933.log.gz 2024-08-17T02:50:56.406 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46261.log 2024-08-17T02:50:56.407 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43214.log.gz 2024-08-17T02:50:56.408 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41040.log 2024-08-17T02:50:56.408 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42673.log.gz 2024-08-17T02:50:56.409 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50196.log 2024-08-17T02:50:56.409 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46261.log.gz 2024-08-17T02:50:56.410 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48783.log 2024-08-17T02:50:56.411 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41040.log.gz 2024-08-17T02:50:56.412 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50406.log 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50196.log.gz 2024-08-17T02:50:56.412 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-17T02:50:56.413 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48783.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48783.log.gz 2024-08-17T02:50:56.413 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42665.log 2024-08-17T02:50:56.415 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50488.log 2024-08-17T02:50:56.415 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50406.log.gz 2024-08-17T02:50:56.416 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44509.log 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42665.log.gz 2024-08-17T02:50:56.416 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-17T02:50:56.417 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50488.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50488.log.gz 2024-08-17T02:50:56.418 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48386.log 2024-08-17T02:50:56.419 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43088.log 2024-08-17T02:50:56.419 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44509.log.gz 2024-08-17T02:50:56.420 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41954.log 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48386.log.gz 2024-08-17T02:50:56.421 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-17T02:50:56.421 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43088.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43088.log.gz 2024-08-17T02:50:56.422 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43046.log 2024-08-17T02:50:56.423 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43382.log 2024-08-17T02:50:56.423 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41954.log.gz 2024-08-17T02:50:56.424 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41618.log 2024-08-17T02:50:56.425 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43046.log.gz 2024-08-17T02:50:56.426 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49077.log 2024-08-17T02:50:56.426 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43382.log.gz 2024-08-17T02:50:56.427 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42680.log 2024-08-17T02:50:56.427 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41618.log.gz 2024-08-17T02:50:56.428 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41660.log 2024-08-17T02:50:56.428 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49077.log.gz 2024-08-17T02:50:56.430 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45585.log 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42680.log.gz 2024-08-17T02:50:56.430 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-17T02:50:56.431 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41660.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41660.log.gz 2024-08-17T02:50:56.431 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43298.log 2024-08-17T02:50:56.432 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45585.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45585.log.gz 2024-08-17T02:50:56.434 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43298.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43298.log.gz 2024-08-17T02:50:56.439 INFO:teuthology.orchestra.run.smithi005.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:50:56.454 INFO:teuthology.orchestra.run.smithi005.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:50:56.456 INFO:teuthology.orchestra.run.smithi005.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:50:56.466 INFO:teuthology.orchestra.run.smithi005.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:50:56.548 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:50:56.552 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-17T02:50:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m0.404s 2024-08-17T02:50:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:user 0m1.209s 2024-08-17T02:50:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m0.628s 2024-08-17T02:50:56.552 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:50:56.553 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858299/remote/smithi005/log 2024-08-17T02:50:56.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:50:56.891 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858299/remote/smithi107/log 2024-08-17T02:50:56.892 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:50:57.077 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:50:57.100 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:50:57.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:50:57.105 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:50:57.211 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:50:57.221 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:50:57.221 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:50:57.225 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:50:57.254 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:50:57.258 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:50:57.261 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:50:57.261 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-08-17T02:50:57.261 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 -4828ns[ +14us] +/- 46ms 2024-08-17T02:50:57.262 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 -43us[ -24us] +/- 80ms 2024-08-17T02:50:57.262 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 +112us[ +130us] +/- 65ms 2024-08-17T02:50:57.262 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:50:57.265 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:50:57.265 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-08-17T02:50:57.265 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +187ns[ +21us] +/- 46ms 2024-08-17T02:50:57.265 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 -21us[ -21us] +/- 80ms 2024-08-17T02:50:57.265 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 +89us[ +110us] +/- 65ms 2024-08-17T02:50:57.266 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:50:57.266 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:50:57.276 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:50:57.276 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:50:57.284 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:50:57.422 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:50:57.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:50:57.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:50:57.595 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:50:57.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:50:57.655 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:50:57.664 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:50:57.672 INFO:teuthology.task.internal:Duration was 740.715640 seconds 2024-08-17T02:50:57.673 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:50:57.681 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:50:57.682 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:50:57.686 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:50:57.770 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:50:57.773 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:50:58.067 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:50:58.067 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-08-17T02:50:58.067 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:50:58.116 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-08-17T02:50:58.117 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:50:58.166 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:50:58.166 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:50:58.170 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:50:58.229 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:50:58.229 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:50:58.234 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:50:58.376 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:50:58.390 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:50:58.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:50:58.447 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:50:58.503 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:50:58.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:50:58.517 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:50:58.584 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-08-17T02:50:58.587 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-08-17T02:50:58.617 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:50:58.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:50:58.651 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:50:58.684 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:50:58.684 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:50:58.695 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:50:58.696 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858299/remote/smithi005 2024-08-17T02:50:58.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:50:58.760 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858299/remote/smithi107 2024-08-17T02:50:58.760 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:50:58.823 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:50:58.823 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:50:58.827 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:50:58.862 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:50:58.871 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:50:58.871 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:50:58.880 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:50:58.880 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:50:58.903 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:50:58.934 INFO:teuthology.orchestra.run.smithi005.stdout: 393331 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:50 /home/ubuntu/cephtest 2024-08-17T02:50:58.937 INFO:teuthology.orchestra.run.smithi107.stdout: 393274 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:50 /home/ubuntu/cephtest 2024-08-17T02:50:58.939 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:50:58.949 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:50:58.971 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 client.1-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 740.715639591217 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=67685b33dd024587b5825212ab7ff555 status: fail success: false 2024-08-17T02:50:58.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:50:59.053 INFO:teuthology.run:FAIL